-- Logs begin at Sat 2022-08-27 20:01:14 UTC, end at Sat 2022-08-27 22:28:58 UTC. -- Aug 27 20:38:15.026944 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 20:38:15.039798 ncdv-master-1 devstack@n-api.service[124027]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 20:38:15 2022] *** Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: nodename: ncdv-master-1 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: machine: x86_64 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: clock source: unix Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: pcre jit disabled Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: detected number of CPU cores: 4 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: current working directory: / Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: detected binary path: /usr/bin/uwsgi-core Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: your processes number limit is 47680 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: your memory page size is 4096 bytes Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: detected max file descriptor number: 2048 Aug 27 20:38:15.041832 ncdv-master-1 devstack@n-api.service[124027]: lock engine: pthread robust mutexes Aug 27 20:38:15.042705 ncdv-master-1 devstack@n-api.service[124027]: thunder lock: enabled Aug 27 20:38:15.042705 ncdv-master-1 devstack@n-api.service[124027]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 20:38:15.042705 ncdv-master-1 devstack@n-api.service[124027]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 20:38:15.085905 ncdv-master-1 devstack@n-api.service[124027]: Python main interpreter initialized at 0x557a180d89c0 Aug 27 20:38:15.085905 ncdv-master-1 devstack@n-api.service[124027]: python threads support enabled Aug 27 20:38:15.085905 ncdv-master-1 devstack@n-api.service[124027]: your server socket listen backlog is limited to 100 connections Aug 27 20:38:15.085905 ncdv-master-1 devstack@n-api.service[124027]: your mercy for graceful operations on workers is 90 seconds Aug 27 20:38:15.086287 ncdv-master-1 devstack@n-api.service[124027]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 20:38:15.086287 ncdv-master-1 devstack@n-api.service[124027]: *** Operational MODE: preforking *** Aug 27 20:38:15.086544 ncdv-master-1 devstack@n-api.service[124027]: *** uWSGI is running in multiple interpreter mode *** Aug 27 20:38:15.086544 ncdv-master-1 devstack@n-api.service[124027]: spawned uWSGI master process (pid: 124027) Aug 27 20:38:15.086780 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 20:38:15.087291 ncdv-master-1 devstack@n-api.service[124027]: spawned uWSGI worker 1 (pid: 124028, cores: 1) Aug 27 20:38:15.088176 ncdv-master-1 devstack@n-api.service[124027]: spawned uWSGI worker 2 (pid: 124029, cores: 1) Aug 27 20:38:15.088176 ncdv-master-1 devstack@n-api.service[124027]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 20:38:16.374634 ncdv-master-1 devstack@n-api.service[124029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 20:38:16.380386 ncdv-master-1 devstack@n-api.service[124028]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 20:38:17.046492 ncdv-master-1 devstack@n-api.service[124029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:38:17.046492 ncdv-master-1 devstack@n-api.service[124029]: from cryptography.utils import int_from_bytes Aug 27 20:38:17.046824 ncdv-master-1 devstack@n-api.service[124029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:38:17.046824 ncdv-master-1 devstack@n-api.service[124029]: from cryptography.utils import int_from_bytes Aug 27 20:38:17.064905 ncdv-master-1 devstack@n-api.service[124028]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:38:17.064905 ncdv-master-1 devstack@n-api.service[124028]: from cryptography.utils import int_from_bytes Aug 27 20:38:17.065226 ncdv-master-1 devstack@n-api.service[124028]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:38:17.065226 ncdv-master-1 devstack@n-api.service[124028]: from cryptography.utils import int_from_bytes Aug 27 20:38:19.626120 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:38:19.626769 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:38:19.626857 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:38:19.626857 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:38:19.627256 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:38:19.627256 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:38:19.627424 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:38:19.627533 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:38:19.627603 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:38:19.627744 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:38:19.627917 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628004 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628093 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628329 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628432 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628668 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628817 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.628981 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629139 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629298 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629448 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629585 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629696 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.629925 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630069 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630284 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630438 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630438 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630636 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630731 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.630817 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.631082 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.631224 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.631386 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.631507 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.631715 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.632008 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.632120 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.632467 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.632565 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.632920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633017 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633221 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633316 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633541 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633645 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633847 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.633945 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.634334 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.634549 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.634790 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.635094 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.635208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.635422 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.635639 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.635788 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636055 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636157 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636361 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636460 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636674 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.636978 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.637081 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.637298 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.637518 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.637614 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.637979 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.638079 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.638289 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.638559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.638653 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.638877 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639011 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639283 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639618 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639746 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.639924 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.640242 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.640343 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.640559 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.640780 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.640873 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.641168 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.641322 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.641481 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.641772 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.641864 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642086 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642175 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642380 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642479 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642681 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642770 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.642983 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643076 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643293 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643407 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643631 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643735 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.643933 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644027 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644179 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644274 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644484 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644607 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644799 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.644900 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645115 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645418 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645663 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645823 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.645910 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646019 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646207 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646308 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646522 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646625 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646824 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.646910 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647127 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647212 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647486 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647591 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647797 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.647914 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648056 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648147 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648266 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648384 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648579 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648673 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.648896 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649039 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649255 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649371 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649562 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649662 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649858 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.649962 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650158 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650249 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650548 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650757 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.650940 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651057 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651167 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651364 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651453 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651678 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651783 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.651989 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652083 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652294 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652381 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652590 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652693 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652900 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.652993 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653203 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653331 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653505 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653596 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653803 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.653900 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654111 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654201 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654425 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654738 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654835 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.654964 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655073 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655261 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655378 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655584 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655685 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655895 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.655982 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656197 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656284 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656499 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656586 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656799 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.656891 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657091 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657178 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657334 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657428 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657629 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657725 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.657929 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658016 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658260 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658361 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658534 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658633 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658829 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.658924 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659127 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659224 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659438 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659543 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659735 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.659821 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660029 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660116 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660328 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660424 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660628 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660724 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.660924 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661046 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661218 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661340 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661623 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661808 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.661928 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662103 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662232 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662396 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662703 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.662801 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.663028 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.663295 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.663418 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.663549 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.663797 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664121 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664261 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664406 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664518 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664633 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664726 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.664821 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665000 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665102 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665265 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665468 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665577 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665794 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.665932 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666115 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666227 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666416 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666709 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.666829 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667006 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667116 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667296 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667434 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667622 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667747 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.667921 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668039 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668216 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668332 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668508 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668619 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668798 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.668908 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669092 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669305 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669433 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669547 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669651 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669754 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.669945 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670034 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670237 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670331 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670526 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670621 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.670831 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.670926 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.671144 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.671247 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.671467 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.671571 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.671767 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.671863 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.672062 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.672171 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.672369 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:38:19.672493 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.672701 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.672798 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673026 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673112 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673358 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673444 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673666 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673764 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.673990 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674085 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674298 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674603 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674747 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.674908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675001 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675217 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675311 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675552 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675640 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675853 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.675940 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676156 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676258 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676458 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676553 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676767 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.676861 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677079 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677166 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677393 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677479 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677698 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.677792 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678001 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678088 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678310 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678398 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678612 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.678709 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679010 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679127 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679465 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679557 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679779 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.679902 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680080 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680182 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680384 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680478 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680705 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.680792 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681023 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681119 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681330 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681416 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681642 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681737 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.681948 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682044 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682251 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682337 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682553 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682646 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682860 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.682955 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683170 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683257 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683499 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683587 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683813 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.683908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684115 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684201 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684431 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684518 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684736 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.684835 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685038 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685125 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685344 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685429 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685646 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685732 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.685950 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686043 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686254 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686340 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686562 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686649 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686863 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.686949 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687164 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687257 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687488 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687588 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687795 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.687881 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688092 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688188 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688479 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688697 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688791 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.688993 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689090 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689291 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689378 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689588 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689681 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.689889 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690067 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690187 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690274 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690489 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690575 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690791 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.690887 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691090 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691181 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691421 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691523 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691726 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.691825 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692028 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692112 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692329 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692415 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692631 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692724 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.692926 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693010 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693230 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693317 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693529 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693622 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693822 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.693908 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.694136 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.694221 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.694599 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.694702 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.694912 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695006 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695220 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695306 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695546 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695633 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695847 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.695934 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696154 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696258 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696459 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696553 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696766 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.696853 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697072 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697167 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697377 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697464 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697692 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697787 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.697999 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698099 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698296 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698381 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698608 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698701 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.698913 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699001 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699214 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699306 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699540 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699636 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699847 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.699936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700150 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700237 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700444 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700530 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700742 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.700828 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701039 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701126 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701335 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701427 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701629 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701722 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.701932 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702018 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702227 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702312 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702522 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702608 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702817 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.702903 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703111 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703206 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703443 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703534 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703760 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.703847 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704060 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704160 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704357 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704444 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704655 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704742 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.704950 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705046 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705291 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705379 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705591 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705678 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705898 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.705995 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706207 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706295 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706609 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706829 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.706922 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707136 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707221 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707476 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707563 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707782 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.707878 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708086 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708179 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708389 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708487 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708692 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708780 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.708992 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709084 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709293 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709378 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709605 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709692 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.709936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710096 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710248 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710387 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710613 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710708 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.710915 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711001 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711219 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711314 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711549 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711649 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711857 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.711943 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712161 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712261 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712467 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712554 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712786 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.712872 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713089 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713192 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713393 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713479 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713697 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713782 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.713999 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714094 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714301 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714388 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714605 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714703 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714902 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.714988 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715208 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715294 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715548 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715684 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715854 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.715943 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716162 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716248 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716459 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716544 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716769 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.716857 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717067 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717152 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717368 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717452 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717676 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717769 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.717978 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718107 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718279 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718400 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718588 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718702 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718883 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.718993 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.719182 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.719301 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.719508 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.719618 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720120 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720231 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720417 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720516 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720714 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.720808 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721010 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721104 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721310 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721407 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721606 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721691 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721907 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.721994 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722203 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722307 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722509 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722596 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722810 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.722950 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723106 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723192 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723433 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723564 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723759 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.723865 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724072 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724160 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724374 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724469 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724673 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724758 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.724972 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.725059 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.725273 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.725401 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.725711 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.725810 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726020 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726200 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726333 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726430 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726630 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726725 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.726930 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727017 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727310 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727493 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727637 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727745 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.727939 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728110 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728238 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728326 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728547 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728714 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728853 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.728940 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729152 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729238 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729460 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729547 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729759 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.729845 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730062 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730147 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730376 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730478 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730679 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730767 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.730979 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731072 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731283 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731403 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731608 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731702 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731909 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.731994 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.732214 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.732300 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.732528 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.732792 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.732879 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733116 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733202 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733418 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733505 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733714 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.733800 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734015 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734103 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734322 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734408 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734685 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.734885 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735008 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735217 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735304 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735557 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735653 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735872 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.735960 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736281 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736500 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736585 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736810 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.736906 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737113 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737209 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737416 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737502 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737712 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.737799 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738013 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738112 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738308 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738392 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738604 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738690 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738899 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.738994 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739195 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739281 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739523 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739611 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739822 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.739923 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740119 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740213 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740414 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740706 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.740793 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741001 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741088 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741383 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741478 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741643 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741777 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.741940 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742091 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742279 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742399 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742577 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742695 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.742913 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743000 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743239 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743641 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743732 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743888 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.743981 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744186 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744282 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744500 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744620 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744800 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.744886 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745103 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745201 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745403 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745489 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745710 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.745797 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746014 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746114 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746311 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746617 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746704 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746911 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.746997 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747206 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747291 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747528 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747615 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747824 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.747911 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748120 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748213 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748416 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748508 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748715 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.748805 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749015 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749102 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749312 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749608 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749694 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749901 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.749988 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750200 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750297 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750495 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750581 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750796 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.750881 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751090 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751184 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751403 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751492 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751700 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751785 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.751994 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752156 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752289 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752375 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752584 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752688 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752882 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.752981 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753173 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753274 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753483 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753584 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753777 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.753865 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754071 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754158 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754364 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754458 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754665 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754751 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.754961 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755046 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755255 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755588 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755676 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755906 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.755992 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.756219 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.756312 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.756512 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.756598 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.756899 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757006 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757196 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757294 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757583 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757670 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757885 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.757971 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758191 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758290 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758491 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758580 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758783 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.758868 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759080 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759183 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759394 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759484 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759697 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759784 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.759995 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760095 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760295 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760425 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760590 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760702 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.760920 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761040 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761174 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761284 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761467 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761576 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761763 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.761854 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762079 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762166 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762379 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762464 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762673 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762760 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.762969 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763054 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763262 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763374 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763615 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763702 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763908 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.763993 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764212 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764306 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764523 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764617 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764828 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.764918 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765137 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765237 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765434 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765520 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765730 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.765817 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766031 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766125 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766328 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766415 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766631 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766716 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.766931 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767026 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767235 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767322 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767557 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767645 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767854 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.767957 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768156 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768250 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768457 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768542 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768757 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.768843 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769063 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769150 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769370 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769455 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769677 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769764 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.769969 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770053 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770270 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770357 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770571 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770657 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770868 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.770969 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771169 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771266 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771489 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771578 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771791 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.771890 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772091 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772185 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772425 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772732 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.772818 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773030 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773124 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773337 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773483 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773637 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773725 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.773947 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774043 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774247 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774341 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774582 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774676 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774884 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.774984 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775271 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775523 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775625 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775822 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.775909 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776125 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776211 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776422 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776510 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776775 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.776862 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777079 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777174 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777421 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777507 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777718 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.777813 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778020 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778114 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778324 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778410 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778635 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778730 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.778935 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779065 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779228 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779322 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779573 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779660 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779874 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.779962 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780174 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780339 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780475 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780562 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780791 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.780878 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781091 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781202 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781393 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781489 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781710 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.781806 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782005 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782105 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782301 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782388 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782599 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782776 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.782911 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783084 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783210 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783417 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783544 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783738 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.783938 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784060 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784242 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784379 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784539 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784680 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.784946 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785044 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785255 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785342 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785560 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785647 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785873 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.785960 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786178 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786265 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786488 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786573 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786783 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.786869 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787086 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787172 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787408 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787511 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787725 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.787821 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788100 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788203 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788408 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788569 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788715 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.788891 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789013 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789199 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789330 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789515 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789646 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789835 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.789951 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790136 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790263 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790435 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790667 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790831 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.790981 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791112 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791282 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791397 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791623 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791721 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.791927 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792013 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792220 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792307 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792516 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792604 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792819 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.792904 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793111 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793198 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793407 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793718 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.793803 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794015 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794101 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794319 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794407 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794624 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794718 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.794924 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795019 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795225 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795312 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795548 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795637 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795865 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.795960 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796159 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796244 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796455 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796542 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796756 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.796853 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797055 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797142 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797363 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797456 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797662 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797764 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.797972 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798058 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798271 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798363 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798571 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798659 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798869 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.798964 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799166 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799297 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799627 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799834 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.799920 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800143 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800228 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800464 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800551 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800764 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.800857 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801062 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801185 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801368 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801464 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801674 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801789 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.801978 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802086 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802277 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802364 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802581 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802675 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802873 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.802968 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803169 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803254 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803493 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803581 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803861 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.803979 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804115 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804202 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804414 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804500 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804716 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.804812 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805017 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805103 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805311 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805407 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805608 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805702 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.805922 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806015 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806219 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806307 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806536 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806624 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806839 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.806933 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807135 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807227 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807459 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807564 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807757 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.807844 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808090 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808190 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808386 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808473 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808701 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.808786 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809003 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809098 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809313 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809407 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809618 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809705 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.809925 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810020 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810233 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810318 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810556 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810683 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.810853 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811054 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811164 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811405 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811515 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811724 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.811825 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812036 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812129 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812346 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812449 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812658 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812761 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.812968 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813169 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813260 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813493 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813592 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813800 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.813892 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814106 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814197 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814409 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814501 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814714 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.814812 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815029 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815119 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815333 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815466 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815659 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815750 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.815981 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816074 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816267 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816389 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816584 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816674 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816894 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.816989 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817214 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817310 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817514 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817600 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817826 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.817913 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818130 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818217 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818437 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818527 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818740 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.818826 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819042 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819139 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819463 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819561 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819767 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.819868 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820071 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820158 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820377 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820463 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820683 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820779 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.820987 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821074 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821291 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821439 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821598 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821687 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.821904 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822012 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822207 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822301 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822512 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822599 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822814 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.822900 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823121 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823328 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823449 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823660 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823782 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.823994 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824142 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824317 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824415 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824636 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824723 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.824953 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825048 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825266 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825472 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825589 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825780 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.825890 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826105 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826209 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826423 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826518 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826740 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.826827 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827054 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827149 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827376 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827463 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827686 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827771 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.827983 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828083 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828280 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828380 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828583 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828668 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.828882 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829113 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829200 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829460 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829592 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829765 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.829861 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830061 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830148 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830371 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830457 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830673 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830778 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.830972 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831195 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831290 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831559 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831666 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831870 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.831972 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832188 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832282 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832491 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832587 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832793 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.832888 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833089 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833193 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833394 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833496 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833692 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833778 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.833989 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834075 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834291 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834390 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834590 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834677 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.834911 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835000 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835211 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835311 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835544 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835635 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835846 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.835942 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836141 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836229 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836443 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836530 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836740 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.836834 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837059 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837146 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837358 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837443 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837653 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837738 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.837949 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838043 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838252 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838337 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838546 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838641 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838845 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.838931 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839141 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839227 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839463 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839570 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839773 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.839862 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840068 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840187 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840368 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840471 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840664 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840752 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.840967 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841053 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841262 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841358 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841566 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841660 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841878 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.841973 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842189 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842285 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842494 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842588 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842792 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.842887 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.843103 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.843377 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.843468 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.843703 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.843807 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.844027 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.844142 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.844331 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.844418 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.844986 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845077 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845299 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845396 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845605 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845822 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.845916 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846150 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846245 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846463 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846549 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846788 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.846874 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847092 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847191 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847421 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847512 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847725 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.847812 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848023 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848193 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848327 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848772 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848772 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848899 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.848966 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849043 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849206 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849337 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849508 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849595 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849808 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.849897 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850111 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850196 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850414 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850583 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850818 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.850983 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.851157 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.851502 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.851596 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.851821 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.851922 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852134 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852222 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852449 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852535 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852753 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.852840 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853057 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853144 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853362 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853444 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853682 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853774 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.853980 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854075 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854296 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854390 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854604 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854690 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854904 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.854990 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855212 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855313 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855544 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855643 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855848 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.855936 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856154 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856251 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856462 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856556 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856785 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.856880 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857089 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857186 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857387 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857474 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857753 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.857837 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858061 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858156 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858376 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858511 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858690 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858776 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.858993 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859080 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859307 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859467 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859639 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859724 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.859941 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860029 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860240 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860333 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860544 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860640 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860856 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.860942 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861164 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861250 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861468 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861564 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861769 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.861856 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862069 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862155 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862368 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862464 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862665 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862750 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.862963 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863049 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863260 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863374 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863590 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863677 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863888 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.863984 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864187 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864283 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864483 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864569 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864778 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.864870 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865076 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865162 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865372 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865457 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865670 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865764 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.865970 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.866132 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.866312 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.866400 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.866635 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.866719 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867002 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867096 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867305 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867442 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867629 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867733 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.867930 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868018 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868236 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868322 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868535 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868632 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868834 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.868920 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869131 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869218 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869427 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869522 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869722 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.869816 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870047 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870134 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870360 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870455 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870666 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870752 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.870978 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871065 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871286 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871392 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871623 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871711 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.871936 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872029 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872241 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872328 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872550 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872636 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872856 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.872942 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873161 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873249 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873486 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873572 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873790 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.873891 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874093 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874179 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874398 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874485 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874703 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.874805 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875015 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875113 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875319 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875442 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875663 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875808 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.875969 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876054 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876320 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876413 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876578 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876669 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876874 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.876961 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877184 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877281 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877491 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877578 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877795 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.877881 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878106 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878193 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878409 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878496 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878715 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.878801 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879021 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879122 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879326 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879440 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879664 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879762 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.879973 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880107 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880278 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880366 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880585 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880672 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880896 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.880993 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.881205 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.881296 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.881525 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.881612 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.881918 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.882018 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.882264 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.882488 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.882671 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.882793 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:38:19.882890 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.883117 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.883486 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.883800 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.884141 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.884469 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.884777 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.885091 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.885392 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:38:19.885631 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124028) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:38:19.948110 ncdv-master-1 devstack@n-api.service[124029]: INFO dbcounter [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Registered counter for database nova_api Aug 27 20:38:19.950173 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Registered counter for database nova_api Aug 27 20:38:19.970003 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_db.sqlalchemy.engines [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:19.971899 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:19.977294 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writer thread running {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:19.978688 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.031165 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.context [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=124029) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 20:38:20.033249 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.context [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=124028) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 20:38:20.035167 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:38:20.035670 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:38:20.037211 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:38:20.037347 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:38:20.037695 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:38:20.037926 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:38:20.038573 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:38:20.039333 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:38:20.040084 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:38:20.040517 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:38:20.040651 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:38:20.042501 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_concurrency.lockutils [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124028) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:38:20.042638 ncdv-master-1 devstack@n-api.service[124029]: INFO dbcounter [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Registered counter for database nova_cell0 Aug 27 20:38:20.044536 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Registered counter for database nova_cell0 Aug 27 20:38:20.046550 ncdv-master-1 devstack@n-api.service[124029]: INFO dbcounter [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Registered counter for database nova_cell1 Aug 27 20:38:20.048747 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Registered counter for database nova_cell1 Aug 27 20:38:20.054311 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_db.sqlalchemy.engines [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.057058 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_db.sqlalchemy.engines [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.058250 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.061979 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.063086 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writer thread running {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.063791 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.200139 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writer thread running {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.201842 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.210942 ncdv-master-1 devstack@n-api.service[124028]: INFO dbcounter [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Registered counter for database nova_cell0 Aug 27 20:38:20.211458 ncdv-master-1 devstack@n-api.service[124029]: INFO dbcounter [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Registered counter for database nova_cell0 Aug 27 20:38:20.218374 ncdv-master-1 devstack@n-api.service[124028]: DEBUG oslo_db.sqlalchemy.engines [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124028) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.222339 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_db.sqlalchemy.engines [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:38:20.224213 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writer thread running {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.227298 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writer thread running {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:38:20.681859 ncdv-master-1 devstack@n-api.service[124029]: WARNING keystonemiddleware.auth_token [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:38:20.689301 ncdv-master-1 devstack@n-api.service[124029]: WARNING keystonemiddleware.auth_token [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:38:20.689983 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:38:20.697425 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:38:20.909409 ncdv-master-1 devstack@n-api.service[124029]: WARNING keystonemiddleware.auth_token [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:38:20.915536 ncdv-master-1 devstack@n-api.service[124029]: WARNING keystonemiddleware.auth_token [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:38:20.919031 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:38:20.920630 ncdv-master-1 devstack@n-api.service[124029]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a180d89c0 pid: 124029 (default app) Aug 27 20:38:20.922941 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:38:20.924145 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001992 Aug 27 20:38:20.924551 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Sat Aug 27 20:38:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:38:20.925202 ncdv-master-1 devstack@n-api.service[124028]: WARNING keystonemiddleware.auth_token [None req-21272943-3118-4bf7-b34e-fa6ef06e7b3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:38:20.930614 ncdv-master-1 devstack@n-api.service[124028]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a180d89c0 pid: 124028 (default app) Aug 27 20:39:46.341827 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:39:46.342826 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 27 20:39:46.343198 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:39:46.360354 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:46.361611 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell0:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:46.362355 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell1:SELECT=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:46.363390 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:47.221792 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-218c9bb3-0e3f-4089-8bb2-d515938ec441 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:39:47.253222 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-218c9bb3-0e3f-4089-8bb2-d515938ec441 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901778 Aug 27 20:39:47.263756 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 20:39:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:39:49.978204 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:39:49.979208 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-b5dfe93e-eb12-4cab-94d3-686edb71a9f7 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 27 20:39:49.979893 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:39:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:39:50.459845 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-84e2b46a-ae04-4b8b-a256-a21dc8ec2dd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:50.511829 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-84e2b46a-ae04-4b8b-a256-a21dc8ec2dd5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525650 Aug 27 20:39:50.512714 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:39:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:39:50.528833 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_api:SELECT=3 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:50.529669 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_cell1:SELECT=3 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:50.530600 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_cell0:SELECT=3 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:50.531411 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:50.751246 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-a2904779-7557-49e7-9f35-7186e024b436 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:50.817210 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-a2904779-7557-49e7-9f35-7186e024b436 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294588 Aug 27 20:39:50.818585 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Sat Aug 27 20:39:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:39:53.495146 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-84e2b46a-ae04-4b8b-a256-a21dc8ec2dd5 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:39:53.496200 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-84e2b46a-ae04-4b8b-a256-a21dc8ec2dd5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 27 20:39:53.496564 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:39:54.320226 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-f3d3feaf-4078-426b-9df4-b976173039e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "ram": 512}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:54.385267 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-f3d3feaf-4078-426b-9df4-b976173039e8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.877202 Aug 27 20:39:54.395160 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:39:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:39:54.401549 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-511eb955-8542-43a9-b849-f355918e621c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:54.449252 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-511eb955-8542-43a9-b849-f355918e621c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052048 Aug 27 20:39:54.450083 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Sat Aug 27 20:39:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:39:57.388886 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-f3d3feaf-4078-426b-9df4-b976173039e8 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:39:57.390706 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-f3d3feaf-4078-426b-9df4-b976173039e8 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Aug 27 20:39:57.392198 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:39:57.947944 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-1db618fe-16f4-49c5-a360-f05be57b6c40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "swap": 0}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:57.984754 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-1db618fe-16f4-49c5-a360-f05be57b6c40 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.586408 Aug 27 20:39:57.986380 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:39:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:39:58.006790 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-939de4cd-9d28-41c3-9141-6856440d4754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:39:58.042745 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-939de4cd-9d28-41c3-9141-6856440d4754 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044365 Aug 27 20:39:58.052243 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Sat Aug 27 20:39:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:01.058563 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-1db618fe-16f4-49c5-a360-f05be57b6c40 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:01.059908 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-1db618fe-16f4-49c5-a360-f05be57b6c40 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001895 Aug 27 20:40:01.060451 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:01.483856 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-325756da-3e29-4124-a792-a3b24836a15f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:01.504536 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-325756da-3e29-4124-a792-a3b24836a15f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437472 Aug 27 20:40:01.505288 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:40:01.517404 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-34b0e372-7fbd-4184-b700-cfb8bf8663eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:01.545894 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-34b0e372-7fbd-4184-b700-cfb8bf8663eb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032163 Aug 27 20:40:01.546495 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Sat Aug 27 20:40:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:04.313111 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-325756da-3e29-4124-a792-a3b24836a15f admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:04.315702 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-325756da-3e29-4124-a792-a3b24836a15f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003129 Aug 27 20:40:04.316625 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:04.769733 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:04.790395 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467178 Aug 27 20:40:04.790962 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:04.803328 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-9ffa6f6a-58ba-4b2e-9286-5c52bfa8e830 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:04.829614 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-9ffa6f6a-58ba-4b2e-9286-5c52bfa8e830 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030013 Aug 27 20:40:04.830886 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Sat Aug 27 20:40:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:07.583487 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:07.584511 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Aug 27 20:40:07.584888 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:08.038926 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-13414e9f-f068-44cb-b589-f37b335059ac admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:08.065910 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-13414e9f-f068-44cb-b589-f37b335059ac admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474514 Aug 27 20:40:08.066627 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 20:40:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:10.869680 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:10.870916 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-425b91a9-e2c9-4532-be87-e56c4851e8dc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001894 Aug 27 20:40:10.871448 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:11.335986 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-6f459a29-d2ea-45e2-ba2a-936b46eacad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:11.356294 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-6f459a29-d2ea-45e2-ba2a-936b46eacad5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477867 Aug 27 20:40:11.356836 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:40:11.369400 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-c8380b66-9e97-405c-b5bc-8426c4a49464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:11.396143 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-c8380b66-9e97-405c-b5bc-8426c4a49464 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030286 Aug 27 20:40:11.396849 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Sat Aug 27 20:40:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:40:14.475779 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-6f459a29-d2ea-45e2-ba2a-936b46eacad5 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:14.477532 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-6f459a29-d2ea-45e2-ba2a-936b46eacad5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Aug 27 20:40:14.478155 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:14.895781 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-5b8d5700-0f71-46cd-8ee6-1616bd27ce6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "swap": 0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:14.916112 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-5b8d5700-0f71-46cd-8ee6-1616bd27ce6d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.431659 Aug 27 20:40:14.916581 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:14.929024 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-cd26622d-d2f3-4a40-abba-b5167b604a51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:14.954114 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-cd26622d-d2f3-4a40-abba-b5167b604a51 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029042 Aug 27 20:40:14.959419 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Sat Aug 27 20:40:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:17.665596 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-5b8d5700-0f71-46cd-8ee6-1616bd27ce6d admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:17.666607 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-5b8d5700-0f71-46cd-8ee6-1616bd27ce6d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 27 20:40:17.667038 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:18.063323 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-827ad4c2-70bc-4ec6-be2c-48043abdb511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:18.084375 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-827ad4c2-70bc-4ec6-be2c-48043abdb511 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.411134 Aug 27 20:40:18.084928 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:18.099667 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-bf558192-d806-4573-9be7-476c83eb1a35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:18.104468 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:40:18.130891 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-bf558192-d806-4573-9be7-476c83eb1a35 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035156 Aug 27 20:40:18.131495 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Sat Aug 27 20:40:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:20.967308 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-827ad4c2-70bc-4ec6-be2c-48043abdb511 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:20.969231 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-827ad4c2-70bc-4ec6-be2c-48043abdb511 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002387 Aug 27 20:40:20.970193 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:21.450379 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-a59e0c03-2a56-47c7-9269-926066dcfb78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 80, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:21.470190 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-a59e0c03-2a56-47c7-9269-926066dcfb78 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485481 Aug 27 20:40:21.471196 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:21.483668 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-9d7842e9-c863-4480-b60f-0a887aea4b79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:21.489888 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:40:21.513997 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-9d7842e9-c863-4480-b60f-0a887aea4b79 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034105 Aug 27 20:40:21.514916 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Sat Aug 27 20:40:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:24.272335 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-a59e0c03-2a56-47c7-9269-926066dcfb78 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:24.275585 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-a59e0c03-2a56-47c7-9269-926066dcfb78 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004398 Aug 27 20:40:24.277004 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:24.744133 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:24.765257 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.481828 Aug 27 20:40:24.766313 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Sat Aug 27 20:40:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:24.778281 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-08840afc-e5f4-4650-8085-341f6128f84d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:24.803844 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-08840afc-e5f4-4650-8085-341f6128f84d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029135 Aug 27 20:40:24.804859 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Sat Aug 27 20:40:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:40:46.126701 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:46.127779 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 27 20:40:46.128203 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:46.142344 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:40:46.557630 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-b7d03481-8e63-4f07-906a-6f67d4d5ef6d admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:46.575997 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-b7d03481-8e63-4f07-906a-6f67d4d5ef6d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.441000 Aug 27 20:40:46.576540 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 20:40:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:47.734425 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:47.735456 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-68823e87-a543-40fc-a9a8-b50beb6a7532 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 27 20:40:47.735847 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:48.389516 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-22fdf8c1-0394-418c-838a-ab0cafb8eeb4 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:48.395467 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-22fdf8c1-0394-418c-838a-ab0cafb8eeb4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-22fdf8c1-0394-418c-838a-ab0cafb8eeb4 admin admin] Request method failure captured: Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.40 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjCoFPt4ebCm0B7u6eVYl9vIR-gVzI6xGQEDDeVFI0CjTF-QLFYFMMftqTwql8LlJsI3ATUYi9-LndDX4GO_A1twpG_BGjRYE5aj6b47DQ3i20ReH3y7ORsoPwMWcHqSIUYHMnA9JzWbyXxCFy_ZvaCLixM5ivnyW7dy_WKE7h7ffJOro Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Role: reader,admin,member Aug 27 20:40:48.420889 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: reader,admin,member Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: method: > Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 42 could not be found. Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '42'} Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:48.422447 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:48.423398 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.424586 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-22fdf8c1-0394-418c-838a-ab0cafb8eeb4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:48.425646 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-22fdf8c1-0394-418c-838a-ab0cafb8eeb4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.459660 Aug 27 20:40:48.425646 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:40:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:40:48.435424 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-47ddd63a-2244-46af-948a-378c994cd2af admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:48.441358 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:40:48.461389 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-47ddd63a-2244-46af-948a-378c994cd2af admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031822 Aug 27 20:40:48.461949 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:48.478232 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-3cd54d5f-9028-440b-b2a8-9aa48406db81 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:48.503837 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-3cd54d5f-9028-440b-b2a8-9aa48406db81 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029735 Aug 27 20:40:48.504409 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:48.515093 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-4df47495-7293-413a-aafc-60f2051805c7 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:48.521890 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.wsgi [None req-4df47495-7293-413a-aafc-60f2051805c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-4df47495-7293-413a-aafc-60f2051805c7 admin admin] Request method failure captured: Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Accept: application/json Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Accept-Encoding: gzip, deflate Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Connection: keep-alive Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Content-Length: 0 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Host: 10.222.0.40 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: Openstack-System-Scope: None Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: User-Agent: python-novaclient Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Auth-Token: gAAAAABjCoFPt4ebCm0B7u6eVYl9vIR-gVzI6xGQEDDeVFI0CjTF-QLFYFMMftqTwql8LlJsI3ATUYi9-LndDX4GO_A1twpG_BGjRYE5aj6b47DQ3i20ReH3y7ORsoPwMWcHqSIUYHMnA9JzWbyXxCFy_ZvaCLixM5ivnyW7dy_WKE7h7ffJOro Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Id: None Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Name: None Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Identity-Status: Confirmed Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Is-Admin-Project: True Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Id: default Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Name: Default Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Name: admin Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Role: reader,admin,member Aug 27 20:40:48.525137 ncdv-master-1 devstack@n-api.service[124029]: X-Roles: reader,admin,member Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant: admin Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Name: admin Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-User: admin Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Id: default Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Name: Default Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: X-User-Name: admin Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: method: > Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: exception: Flavor 42 could not be found. Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: action_args: {'id': '42'} Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:48.526805 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:48.527926 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:48.529362 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-4df47495-7293-413a-aafc-60f2051805c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:48.530660 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-4df47495-7293-413a-aafc-60f2051805c7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015848 Aug 27 20:40:48.530660 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:40:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 20:40:49.545159 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-3cd54d5f-9028-440b-b2a8-9aa48406db81 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:49.546412 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-3cd54d5f-9028-440b-b2a8-9aa48406db81 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 27 20:40:49.546984 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:50.118168 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b4c303e2-c86a-4749-9265-ff9c8a826fbf admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:50.123947 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.wsgi [None req-b4c303e2-c86a-4749-9265-ff9c8a826fbf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b4c303e2-c86a-4749-9265-ff9c8a826fbf admin admin] Request method failure captured: Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Accept: application/json Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Accept-Encoding: gzip, deflate Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Connection: keep-alive Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Content-Length: 0 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Host: 10.222.0.40 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: Openstack-System-Scope: None Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: User-Agent: python-novaclient Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Auth-Token: gAAAAABjCoFR8R2arXX4N3NsQSWz1D_sKIkxkbrdsajZYJED7OhK56-wTebHCCS6z17HesyoDl7W98bpWh2y7XO1jrVXyt5SBCAWKq0_U7ZW7Jg9pMvDER1JIg7v132Ee7LKyGznYHMPjUiUoq016CoFaF1J39ZywTs7R9hmkYu_kFoKYOqSuus Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Id: None Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Name: None Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Identity-Status: Confirmed Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Is-Admin-Project: True Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Id: default Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Name: Default Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Name: admin Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Role: reader,admin,member Aug 27 20:40:50.125440 ncdv-master-1 devstack@n-api.service[124029]: X-Roles: reader,admin,member Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant: admin Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Name: admin Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-User: admin Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Id: default Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Name: Default Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: X-User-Name: admin Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: method: > Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: exception: Flavor 84 could not be found. Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: action_args: {'id': '84'} Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:50.126794 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:50.127612 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.129016 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b4c303e2-c86a-4749-9265-ff9c8a826fbf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:50.130336 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-b4c303e2-c86a-4749-9265-ff9c8a826fbf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.431325 Aug 27 20:40:50.130336 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:40:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:40:50.138072 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-2ced38cb-2498-46e8-aa7a-159d735d537c admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:50.153779 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-2ced38cb-2498-46e8-aa7a-159d735d537c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019332 Aug 27 20:40:50.154311 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:40:50.166948 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-2fd23ac7-88a7-4bc6-91a5-77476520895a admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:50.185287 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-2fd23ac7-88a7-4bc6-91a5-77476520895a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024141 Aug 27 20:40:50.185830 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:50.195433 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-6badd1ca-b99d-464f-96d6-50eb3229d793 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:50.201452 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-6badd1ca-b99d-464f-96d6-50eb3229d793 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-6badd1ca-b99d-464f-96d6-50eb3229d793 admin admin] Request method failure captured: Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.40 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjCoFR8R2arXX4N3NsQSWz1D_sKIkxkbrdsajZYJED7OhK56-wTebHCCS6z17HesyoDl7W98bpWh2y7XO1jrVXyt5SBCAWKq0_U7ZW7Jg9pMvDER1JIg7v132Ee7LKyGznYHMPjUiUoq016CoFaF1J39ZywTs7R9hmkYu_kFoKYOqSuus Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Role: reader,admin,member Aug 27 20:40:50.202969 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: reader,admin,member Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: method: > Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 84 could not be found. Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '84'} Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:50.204615 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:50.205400 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:50.206450 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-6badd1ca-b99d-464f-96d6-50eb3229d793 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:50.207601 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-6badd1ca-b99d-464f-96d6-50eb3229d793 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012565 Aug 27 20:40:50.207601 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:40:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:40:51.209942 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-2fd23ac7-88a7-4bc6-91a5-77476520895a admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:51.211040 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-2fd23ac7-88a7-4bc6-91a5-77476520895a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 27 20:40:51.211691 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:51.805137 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-80855d7a-8074-4c25-b9d9-a2d9351411e6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:51.811162 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.wsgi [None req-80855d7a-8074-4c25-b9d9-a2d9351411e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-80855d7a-8074-4c25-b9d9-a2d9351411e6 admin admin] Request method failure captured: Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Accept: application/json Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Accept-Encoding: gzip, deflate Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Connection: keep-alive Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Content-Length: 0 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Host: 10.222.0.40 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: Openstack-System-Scope: None Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: User-Agent: python-novaclient Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Auth-Token: gAAAAABjCoFTqkHOY7oJR6MFPBzhP68QAx4SreYLF3jSRIkqBAkyOk87VA1VbWVsSgBnhYaeg075Yv8XA0oTQoUT84BTsvxUI9oTGfYyHcv4O_cRL3zAckPZ8C2GUs2w_9FxZVpKL5ggryYzQK24v0OrgOJTmzbYOZhuRe6z0iUbVWQKT0aStSQ Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Id: None Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Domain-Name: None Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Identity-Status: Confirmed Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Is-Admin-Project: True Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Id: default Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Domain-Name: Default Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Project-Name: admin Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Role: reader,admin,member Aug 27 20:40:51.812710 ncdv-master-1 devstack@n-api.service[124028]: X-Roles: reader,admin,member Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant: admin Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-Tenant-Name: admin Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-User: admin Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Id: default Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-User-Domain-Name: Default Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: X-User-Name: admin Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: method: > Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: exception: Flavor 451 could not be found. Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: action_args: {'id': '451'} Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:51.814223 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:51.815265 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.816664 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-80855d7a-8074-4c25-b9d9-a2d9351411e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124028) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:51.818204 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-80855d7a-8074-4c25-b9d9-a2d9351411e6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.451459 Aug 27 20:40:51.818204 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:40:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 20:40:51.823776 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-6434f345-6d01-43aa-862f-a868a7ea6df6 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:51.839220 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-6434f345-6d01-43aa-862f-a868a7ea6df6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019039 Aug 27 20:40:51.839776 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:51.849835 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:51.866487 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020392 Aug 27 20:40:51.867036 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Sat Aug 27 20:40:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:40:51.876612 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-1aca794c-0729-4cce-a43a-23f1208b540b admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:51.882404 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.wsgi [None req-1aca794c-0729-4cce-a43a-23f1208b540b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-1aca794c-0729-4cce-a43a-23f1208b540b admin admin] Request method failure captured: Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Accept: application/json Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Accept-Encoding: gzip, deflate Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Connection: keep-alive Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Content-Length: 0 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Host: 10.222.0.40 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Openstack-Api-Version: compute 2.90 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: Openstack-System-Scope: None Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: User-Agent: python-novaclient Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Auth-Token: gAAAAABjCoFTqkHOY7oJR6MFPBzhP68QAx4SreYLF3jSRIkqBAkyOk87VA1VbWVsSgBnhYaeg075Yv8XA0oTQoUT84BTsvxUI9oTGfYyHcv4O_cRL3zAckPZ8C2GUs2w_9FxZVpKL5ggryYzQK24v0OrgOJTmzbYOZhuRe6z0iUbVWQKT0aStSQ Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Id: None Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Domain-Name: None Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Identity-Status: Confirmed Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Is-Admin-Project: True Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Id: default Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Domain-Name: Default Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Project-Name: admin Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Role: reader,admin,member Aug 27 20:40:51.884025 ncdv-master-1 devstack@n-api.service[124029]: X-Roles: reader,admin,member Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/76bf00f811264e51a20ddddb9a100e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_76bf00f811264e51a20ddddb9a100e36", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/76bf00f811264e51a20ddddb9a100e36"}]}] Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant: admin Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Id: 76bf00f811264e51a20ddddb9a100e36 Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-Tenant-Name: admin Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-User: admin Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Id: default Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-User-Domain-Name: Default Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-User-Id: 5873c1239ace40b5831ec529429e8512 Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: X-User-Name: admin Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: method: > Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: exception: Flavor 451 could not be found. Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: action_args: {'id': '451'} Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:40:51.885655 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:51.886614 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: ERROR nova.api.openstack.wsgi Aug 27 20:40:51.887951 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-1aca794c-0729-4cce-a43a-23f1208b540b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:40:51.889198 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-1aca794c-0729-4cce-a43a-23f1208b540b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012305 Aug 27 20:40:51.889198 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:40:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 20:40:52.890320 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:52.891370 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 27 20:40:52.891784 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:53.497524 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-4b2811e5-2066-4f7f-a1ad-60a320a7a38c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:53.521122 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-4b2811e5-2066-4f7f-a1ad-60a320a7a38c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.479646 Aug 27 20:40:53.521720 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Sat Aug 27 20:40:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:54.523592 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:54.525012 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 27 20:40:54.525756 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:55.086352 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-adc822ce-0022-4650-9977-112feebbc429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:55.107377 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-adc822ce-0022-4650-9977-112feebbc429 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436296 Aug 27 20:40:55.107940 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Sat Aug 27 20:40:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:56.105857 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:56.106887 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 27 20:40:56.107276 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:56.707502 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-6cde5239-2bde-4c65-a561-46989f4a3ec3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:56.730701 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-6cde5239-2bde-4c65-a561-46989f4a3ec3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.478373 Aug 27 20:40:56.731239 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Sat Aug 27 20:40:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:57.741564 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:57.742672 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 27 20:40:57.743042 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:40:58.322549 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-b54c9dc0-7b35-4583-9be3-cb57074b1134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:40:58.348731 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-b54c9dc0-7b35-4583-9be3-cb57074b1134 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.460014 Aug 27 20:40:58.349272 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Sat Aug 27 20:40:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:40:59.497980 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:40:59.498982 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 27 20:40:59.499392 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:41:00.088318 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-dcf2a09b-395a-439d-991f-4350d35c5284 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:41:00.109415 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-dcf2a09b-395a-439d-991f-4350d35c5284 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.456169 Aug 27 20:41:00.109930 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Sat Aug 27 20:40:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:42:03.930701 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:03.931810 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-367ae543-f24e-449a-96ec-c85bb35327a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 27 20:42:03.932222 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Sat Aug 27 20:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:42:03.941385 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:42:04.397217 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-4c69bfad-3c40-4212-ba5c-c0df35d82327 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:04.418417 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-4c69bfad-3c40-4212-ba5c-c0df35d82327 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.479598 Aug 27 20:42:04.419147 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 20:42:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:42:04.443745 ncdv-master-1 devstack@n-api.service[124028]: DEBUG dbcounter [-] [124028] Writing DB stats nova_api:SELECT=14 {{(pid=124028) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:42:04.448100 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-c756398e-d1cc-4dc6-80a8-69ba25e33c94 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:04.456842 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-c756398e-d1cc-4dc6-80a8-69ba25e33c94 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014554 Aug 27 20:42:04.457337 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Sat Aug 27 20:42:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:42:04.471059 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-01792ef9-7d3d-4a81-84ec-c29cc5e955cb admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:04.479857 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-01792ef9-7d3d-4a81-84ec-c29cc5e955cb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012815 Aug 27 20:42:04.480401 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Sat Aug 27 20:42:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:42:04.493726 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:04.501644 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012363 Aug 27 20:42:04.502163 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Sat Aug 27 20:42:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:42:04.518107 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-151137ff-f6d0-4b5f-bdad-6975b37e1593 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:42:04.529285 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-151137ff-f6d0-4b5f-bdad-6975b37e1593 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016597 Aug 27 20:42:04.529922 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Sat Aug 27 20:42:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:47:29.888609 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:47:29.890137 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Aug 27 20:47:29.890790 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:47:30.058219 ncdv-master-1 devstack@n-api.service[124029]: DEBUG dbcounter [-] [124029] Writing DB stats nova_api:SELECT=6 {{(pid=124029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:47:30.248598 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:47:30.252025 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:47:30.252978 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:47:30.253414 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:47:30.254122 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:47:30.254562 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:47:30.254973 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:47:30.298104 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-a6ed01bc-811d-4b79-bd3c-41ab89d07bb0 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.241376 Aug 27 20:47:30.298699 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:47:30 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:47:31.165306 ncdv-master-1 devstack@n-api.service[124028]: DEBUG nova.api.openstack.wsgi [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] Calling method '>' {{(pid=124028) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:47:31.166362 ncdv-master-1 devstack@n-api.service[124028]: INFO nova.api.openstack.requestlog [None req-bbe638c0-46d9-4754-984c-f189b5840419 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 27 20:47:31.166775 ncdv-master-1 devstack@n-api.service[124028]: [pid: 124028|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Sat Aug 27 20:47:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:47:31.372302 ncdv-master-1 devstack@n-api.service[124029]: DEBUG nova.api.openstack.wsgi [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Calling method '>' {{(pid=124029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:47:31.375956 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:47:31.376427 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:47:31.376878 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:47:31.377564 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:47:31.378003 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:47:31.378413 ncdv-master-1 devstack@n-api.service[124029]: DEBUG oslo_concurrency.lockutils [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:47:31.400907 ncdv-master-1 devstack@n-api.service[124029]: INFO nova.api.openstack.requestlog [None req-f6f3940b-2b71-48ba-9a7d-0daa002c2556 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.088105 Aug 27 20:47:31.401459 ncdv-master-1 devstack@n-api.service[124029]: [pid: 124029|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:47:31 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:48:16.900122 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 20:48:16.900776 ncdv-master-1 devstack@n-api.service[124027]: Sat Aug 27 20:48:16 2022 - graceful shutdown triggered... Aug 27 20:48:16.901248 ncdv-master-1 devstack@n-api.service[124028]: Gracefully killing worker 1 (pid: 124028)... Aug 27 20:48:16.901761 ncdv-master-1 devstack@n-api.service[124029]: Gracefully killing worker 2 (pid: 124029)... Aug 27 20:48:17.901936 ncdv-master-1 devstack@n-api.service[124027]: worker 1 buried after 1 seconds Aug 27 20:48:17.901936 ncdv-master-1 devstack@n-api.service[124027]: worker 2 buried after 1 seconds Aug 27 20:48:17.901936 ncdv-master-1 devstack@n-api.service[124027]: goodbye to uWSGI. Aug 27 20:48:17.903790 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 20:48:17.904426 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 20:48:17.907371 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 20:48:17.950166 ncdv-master-1 devstack@n-api.service[140425]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 20:48:17 2022] *** Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: nodename: ncdv-master-1 Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: machine: x86_64 Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: clock source: unix Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: pcre jit disabled Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: detected number of CPU cores: 4 Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: current working directory: / Aug 27 20:48:17.953468 ncdv-master-1 devstack@n-api.service[140425]: detected binary path: /usr/bin/uwsgi-core Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: your processes number limit is 47680 Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: your memory page size is 4096 bytes Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: detected max file descriptor number: 2048 Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: lock engine: pthread robust mutexes Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: thunder lock: enabled Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 20:48:17.954281 ncdv-master-1 devstack@n-api.service[140425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 20:48:18.021684 ncdv-master-1 devstack@n-api.service[140425]: Python main interpreter initialized at 0x5597ab6639c0 Aug 27 20:48:18.021684 ncdv-master-1 devstack@n-api.service[140425]: python threads support enabled Aug 27 20:48:18.021684 ncdv-master-1 devstack@n-api.service[140425]: your server socket listen backlog is limited to 100 connections Aug 27 20:48:18.021684 ncdv-master-1 devstack@n-api.service[140425]: your mercy for graceful operations on workers is 90 seconds Aug 27 20:48:18.022357 ncdv-master-1 devstack@n-api.service[140425]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 20:48:18.022357 ncdv-master-1 devstack@n-api.service[140425]: *** Operational MODE: preforking *** Aug 27 20:48:18.022519 ncdv-master-1 devstack@n-api.service[140425]: *** uWSGI is running in multiple interpreter mode *** Aug 27 20:48:18.022519 ncdv-master-1 devstack@n-api.service[140425]: spawned uWSGI master process (pid: 140425) Aug 27 20:48:18.022862 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 20:48:18.025644 ncdv-master-1 devstack@n-api.service[140425]: spawned uWSGI worker 1 (pid: 140433, cores: 1) Aug 27 20:48:18.025644 ncdv-master-1 devstack@n-api.service[140425]: spawned uWSGI worker 2 (pid: 140434, cores: 1) Aug 27 20:48:18.025644 ncdv-master-1 devstack@n-api.service[140425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 20:48:19.351627 ncdv-master-1 devstack@n-api.service[140434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 20:48:19.402401 ncdv-master-1 devstack@n-api.service[140433]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 20:48:20.102147 ncdv-master-1 devstack@n-api.service[140434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:48:20.102147 ncdv-master-1 devstack@n-api.service[140434]: from cryptography.utils import int_from_bytes Aug 27 20:48:20.102495 ncdv-master-1 devstack@n-api.service[140434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:48:20.102495 ncdv-master-1 devstack@n-api.service[140434]: from cryptography.utils import int_from_bytes Aug 27 20:48:20.164992 ncdv-master-1 devstack@n-api.service[140433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:48:20.164992 ncdv-master-1 devstack@n-api.service[140433]: from cryptography.utils import int_from_bytes Aug 27 20:48:20.165354 ncdv-master-1 devstack@n-api.service[140433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:48:20.165354 ncdv-master-1 devstack@n-api.service[140433]: from cryptography.utils import int_from_bytes Aug 27 20:48:22.549898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:48:22.550456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:48:22.550670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:48:22.551062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:48:22.551307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:48:22.551718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.552047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.552372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.552708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.553036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.553485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.554135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.554380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.554722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.554986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.555306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.555663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.555988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.556300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.556609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.556934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.557231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.557565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.557877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.558378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.559993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.559993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.559993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.559993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.560376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.560723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.561041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.561407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.561728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.562044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.562459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.562782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.563103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.563466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.563883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.564196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.564498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.564818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.565130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.565452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.565788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.566111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.566448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.566768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.567073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.567404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.567732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.568052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.568359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.568663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.568951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.569257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.569581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.569903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.570253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.570522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.570773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.571109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.571478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.571797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.572100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.572412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.572762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.573072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.573381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.573701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.574009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.574352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.574669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.574995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.575304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.575649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.576054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.576304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.576613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.576952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.577275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.577581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.577905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.578230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.578520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.578830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.579141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.579485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.579811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.580116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.580365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.580678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.580974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.581292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.581600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.581907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.582214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.582572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.582883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.583188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.583525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.583835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.584140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.584560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.584839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.585152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.585456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.585777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.586101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.586411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.586718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.587026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.587332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.587681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.587990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.588299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.588621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.588929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.589235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.589557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.589864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.590172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.590489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.590790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.591098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.591440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.592121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.592426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.592732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.593038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.593340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.593650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.593955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.594259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.594559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.594881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.595205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.595540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.595848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.596154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.596472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.596810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.597141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.597484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.597821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.598156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.598492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.598814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.599126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.599488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.599813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.600156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.600473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.600965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.601288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.601611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.601951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.602266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.602587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.603120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.603492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.603991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.604177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.604950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.604950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.605440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.605440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.605712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.605988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.606316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.606631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.606943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.607251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.607604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.607932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.608243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.608565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.608881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.609204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.609500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.609813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.610123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.610434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.610750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.611082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.611417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.611747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.612065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.612365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.612688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.613009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.613321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.613634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.613939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.614100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:48:22.614518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.614604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:48:22.614697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.614840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.614939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:48:22.615149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.615264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:48:22.615496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.615600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:48:22.616073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.616189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.616392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.616498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.616729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.616819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.617036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.617135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.617351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.617450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.617661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.617752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.617979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.618084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.618287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.618385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.618602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.618693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.618902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.618993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.619208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.619304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.619566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.619659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.619880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.619971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.620189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.620280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.620506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.620605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.620810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.620907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.621118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.621208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.621431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.621521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.621746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.621838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.622059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.622257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.622372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.622576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.622678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.622894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.622999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.623214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.623325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.623586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.623688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.623908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.624008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.624225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.624325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.624542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.624639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.624859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.624957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.625233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.625344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.625495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.625599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.625800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.625898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.626113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.626212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.626420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.626519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.626728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.626827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.627032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.627288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.629970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.630163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.630332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.630560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.630724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.630881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.630881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.631980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.631980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.632149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.632284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.632477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.632599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.639677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.639837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.639937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.640034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.640130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.640228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.640327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.640423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.640594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.640694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.640790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.640875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.640962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.641054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.641316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.641490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.641677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.641854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.641939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.642914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.642999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.643090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.643189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.643275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.647422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.647552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.647636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.647748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.647837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.647923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.648888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.648969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.649911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.649992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.650887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.650959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.651889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.651971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.652848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.652931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.653920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.654091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.654238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.654401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.654550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.654714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.654867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.655011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.655174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.655331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.655540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.655694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.655847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.656000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.656144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.656287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.656431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.656573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.656725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.656885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.657038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.657182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.657344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.657489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.657641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.657793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.657953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.658105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.658254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.658402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.658560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.658719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.658875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.659036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.659754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.659931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.660097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.660248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.660406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.660566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.660716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.660872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.661033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.661182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.661331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.661495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.661647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.661804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.661977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.662136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.662296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.662447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.662599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.662775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.662941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.663147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.663312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.663528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.663685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.663842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.664012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.664185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.664344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.664494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.664653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.664814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.664971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.665121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.665278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:48:22.665278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.665572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.665737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.665898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.666855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.667959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.668891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.669050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.669199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.670597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.670773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.670929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.671909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.672881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.673888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.674995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.675147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.675305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.675527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.675689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.675853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.676937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.677885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.678850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.679152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.679309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.679499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.679965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.680120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.680279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.680751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.680919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.681881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.682039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.682198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.682371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.682529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.682698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.683459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.683640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.683802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.683961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.684898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.685904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.686836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.687125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.687291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.687932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.687932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.688254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.688415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.688574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.688724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.688890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.689048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.689336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.689525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.690185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.690367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.690680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.690943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.691100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.691250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.691437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.691687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.691852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.692977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.693990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.694143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.694386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.694548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.694708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.694858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.695842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.696000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.696150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.696310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.696473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.696473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.697517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.697679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.697853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.698962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.699127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.699286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.699497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.699649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.699852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.700036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.700816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.701989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.702147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.702410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.702569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.702720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.702899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.703908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.704841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.705991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.706928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.707909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.708999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.709168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.709329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.709479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.709713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.709865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.710023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.710174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.710635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.710943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.711122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.711387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.711548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.711700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.711882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.712935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.713911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.714861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.715018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.715177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.715328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.715571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.715910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.716104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.716283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.716444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.716602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.717901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.718857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.719159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.719159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.720100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.720258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.720429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.720901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.721176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.721368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.721645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.721811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.721976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.722144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.722303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.722455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.722623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.722871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.723905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.724867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.725029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.725181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.725543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.725731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.725893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.726851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.727967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.728902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.729897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.730058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.730209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.730360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.730524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.730693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.731486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.731679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.731949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.732904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.733169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.733347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.733652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.733885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.734989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.735823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.736907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.737075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.737765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.737943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.738967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.739944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.740095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.740247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.740410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.740561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.740725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.741286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.741595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.741595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.741885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.742961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.743114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.743477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.743642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.743795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.744804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.745978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.746930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.747089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.747252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.747516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.747687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.747849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.748931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.749866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.750946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.751631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.751799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.751979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.752151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.752405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.752563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.752713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.752864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.753908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.754922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.755872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.756880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.757832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.758941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.759973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.760924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.761232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.761871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.762949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.763130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.763292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.763478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.763742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.763907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.764177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.764372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.764536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.764697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.764849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.765962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.766902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.767872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.768973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.769986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.770936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.771094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.771246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.771878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.772102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.772102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.772462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.772641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.772892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.773061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.773212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.773374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.773532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.773683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.774915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.775916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.776864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.777975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.778908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.779212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.779395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.779668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.779837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.779996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.780948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.781099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.781257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.781409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.781665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.782181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.782344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.782496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.782648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.782798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.783915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.784096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.784387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.784546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.784698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.784858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.785875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.786960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.787956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.788901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.789996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.790934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.791084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.791234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.791470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.791696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.791938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.792437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.792592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.792752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.792903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.793739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.793907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.794078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.794233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.794518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.794686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.794861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.795818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.796749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.797050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.797208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.797385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.798938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.799961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.800899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.801061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.801214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.801372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.801561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.802891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.803071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.803309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.803619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.803619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.837348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.838348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.839035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.839678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.840222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.840222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.840995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.841591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.842545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.842545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.843900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.844515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.845424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.845573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.845817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.846898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.847606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.848905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.849972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.850965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.851739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.851889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.852901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.853969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.854119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.854713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.854856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.854989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.855142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.855277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.855463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.855642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.856126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.856631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.857269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.857584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.857777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.857980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.858194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.858359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.859953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.860963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.861985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.862951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.863965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.864946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.865925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.866985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.867970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.868793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.869844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.870887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.871793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.872651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.873956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.874387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.875647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.876662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.877812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.878656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.879587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.880570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.881025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.881106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.881399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.881742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.882102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.882432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.882789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.883132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.883533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.883861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.884232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:48:22.884486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:48:22.890547 ncdv-master-1 devstack@n-api.service[140434]: INFO dbcounter [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Registered counter for database nova_api Aug 27 20:48:22.912486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_db.sqlalchemy.engines [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:22.919762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writer thread running {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:22.952511 ncdv-master-1 devstack@n-api.service[140433]: INFO dbcounter [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Registered counter for database nova_api Aug 27 20:48:22.974268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_db.sqlalchemy.engines [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:22.978902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.context [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140434) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 20:48:22.981644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writer thread running {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:22.983020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:48:22.983553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:48:22.985123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:48:22.985872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:48:22.986326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:48:22.988404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:48:22.990488 ncdv-master-1 devstack@n-api.service[140434]: INFO dbcounter [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Registered counter for database nova_cell0 Aug 27 20:48:22.994730 ncdv-master-1 devstack@n-api.service[140434]: INFO dbcounter [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Registered counter for database nova_cell1 Aug 27 20:48:23.001871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_db.sqlalchemy.engines [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.007301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writer thread running {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.007994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_db.sqlalchemy.engines [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.040014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.context [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140433) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 20:48:23.044113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:48:23.044689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:48:23.046181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:48:23.046942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:48:23.047401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:48:23.049484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:48:23.051709 ncdv-master-1 devstack@n-api.service[140433]: INFO dbcounter [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Registered counter for database nova_cell0 Aug 27 20:48:23.056115 ncdv-master-1 devstack@n-api.service[140433]: INFO dbcounter [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Registered counter for database nova_cell1 Aug 27 20:48:23.063974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_db.sqlalchemy.engines [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.069405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writer thread running {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.070068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_db.sqlalchemy.engines [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.162163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writer thread running {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.171565 ncdv-master-1 devstack@n-api.service[140434]: INFO dbcounter [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Registered counter for database nova_cell0 Aug 27 20:48:23.179132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_db.sqlalchemy.engines [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.184553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writer thread running {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.215716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writer thread running {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.228513 ncdv-master-1 devstack@n-api.service[140433]: INFO dbcounter [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Registered counter for database nova_cell0 Aug 27 20:48:23.235191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_db.sqlalchemy.engines [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:48:23.240084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writer thread running {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:48:23.632990 ncdv-master-1 devstack@n-api.service[140434]: WARNING keystonemiddleware.auth_token [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:48:23.640679 ncdv-master-1 devstack@n-api.service[140434]: WARNING keystonemiddleware.auth_token [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:48:23.685158 ncdv-master-1 devstack@n-api.service[140433]: WARNING keystonemiddleware.auth_token [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:48:23.693088 ncdv-master-1 devstack@n-api.service[140433]: WARNING keystonemiddleware.auth_token [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:48:23.864779 ncdv-master-1 devstack@n-api.service[140434]: WARNING keystonemiddleware.auth_token [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:48:23.871327 ncdv-master-1 devstack@n-api.service[140434]: WARNING keystonemiddleware.auth_token [None req-14cfa94f-e86d-4734-9173-6d5e3c3e4073 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:48:23.876877 ncdv-master-1 devstack@n-api.service[140434]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597ab6639c0 pid: 140434 (default app) Aug 27 20:48:23.919416 ncdv-master-1 devstack@n-api.service[140433]: WARNING keystonemiddleware.auth_token [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 20:48:23.925607 ncdv-master-1 devstack@n-api.service[140433]: WARNING keystonemiddleware.auth_token [None req-21d244fa-5e9e-4818-a370-2e3c5e97dc70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 20:48:23.931068 ncdv-master-1 devstack@n-api.service[140433]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597ab6639c0 pid: 140433 (default app) Aug 27 20:49:06.655435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:06.656854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:06.658074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:06.659191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:07.684842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:07.687953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:07.690264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:07.694139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:07.951665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3ec092d-6e82-4148-a9db-a58003eb369d tempest-AZAdminNegativeTestJSON-1126176347 tempest-AZAdminNegativeTestJSON-1126176347-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:07.954429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3ec092d-6e82-4148-a9db-a58003eb369d tempest-AZAdminNegativeTestJSON-1126176347 tempest-AZAdminNegativeTestJSON-1126176347-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '7d27a465682640308c61e4ccbbe1a2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc163122a0bc4903bd6f16e3eaf643e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3ec092d-6e82-4148-a9db-a58003eb369d tempest-AZAdminNegativeTestJSON-1126176347 tempest-AZAdminNegativeTestJSON-1126176347-project] Request method failure captured: Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNAYei-SF3Nsl7pXRWk1TmnjonCxW-nCSTiDlmdEOCGKrPpRWhtLSkqddOck_wqBtgg4VjL7_yMrAbvIffprhEhTkpTuSIoAsDTIieN610V3vA8LQJHk9HcfQAftI5NGIAg6e24PAmTrS_UKXdEkKr9-10p0to77BYxyKiICHPpBqE Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: dc163122a0bc4903bd6f16e3eaf643e4 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1126176347 Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:07.963243 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc163122a0bc4903bd6f16e3eaf643e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dc163122a0bc4903bd6f16e3eaf643e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dc163122a0bc4903bd6f16e3eaf643e4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dc163122a0bc4903bd6f16e3eaf643e4"}]}] Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AZAdminNegativeTestJSON-1126176347 Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: dc163122a0bc4903bd6f16e3eaf643e4 Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1126176347 Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AZAdminNegativeTestJSON-1126176347-project Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7d27a465682640308c61e4ccbbe1a2d1 Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AZAdminNegativeTestJSON-1126176347-project Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 20:49:07.964349 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:07.964970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 20:49:07.965881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:07.969896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3ec092d-6e82-4148-a9db-a58003eb369d tempest-AZAdminNegativeTestJSON-1126176347 tempest-AZAdminNegativeTestJSON-1126176347-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:07.971768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e3ec092d-6e82-4148-a9db-a58003eb369d tempest-AZAdminNegativeTestJSON-1126176347 tempest-AZAdminNegativeTestJSON-1126176347-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.328187 Aug 27 20:49:07.972720 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1/1] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:49:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1330 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:08.939097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '.version_select at 0x7ff854c141f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:08.955898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140434) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 20:49:08.966745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:08.973034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:08.973653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.070743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.071574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.072194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.100936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.104002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.104459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.126090 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab1f3565-bfa3-458a-bc77-362cddba4aa2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.829002 Aug 27 20:49:09.131993 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2/2] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 20:49:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:09.233111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86774b60-ae23-4876-b1a7-1979f76d3c84 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-3425338", "ram": 512, "vcpus": 1, "disk": 10, "id": 1802863814, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:09.294589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86774b60-ae23-4876-b1a7-1979f76d3c84 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.627651 Aug 27 20:49:09.297429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:07 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:09.422511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:09.425372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.426163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.426851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.428018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.428660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.430231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.538992 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24bd5bbf-f696-40f3-b6fe-cac9a88adc0a tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.405584 Aug 27 20:49:09.542979 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1164 bytes} [Sat Aug 27 20:49:09 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:09.568185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Calling method '.version_select at 0x7ff854cb4b80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:09.588644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140433) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 20:49:09.593465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.594204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.596175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.661998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.662510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.662958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.703016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.703657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.704260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.713199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-793364e9-7f65-4e73-a041-83cab3bc8435 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-330977577", "id": 1634411898, "os-flavor-access:is_public": "False"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:09.713346 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be7153b8-d2b1-4a4b-9146-eef641cbb7b0 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.414470 Aug 27 20:49:09.713947 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2/5] 10.222.0.40 () {60 vars in 1208 bytes} [Sat Aug 27 20:49:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:49:09.720540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a489b1b1-3973-41b2-a1d3-76c7b0ac4bfd tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1843495163", "name": "tempest-test_aggregate-1206220489"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:09.744434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-a489b1b1-3973-41b2-a1d3-76c7b0ac4bfd tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid cefb5fee-c5c5-40dc-b15d-79c1f87fd405 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:49:09.832038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-793364e9-7f65-4e73-a041-83cab3bc8435 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.287682 Aug 27 20:49:09.845708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 4/6] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:09.851147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-88df1c6c-e3a7-4783-a965-1f44e857f3f8 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:09.924087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a489b1b1-3973-41b2-a1d3-76c7b0ac4bfd tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.208795 Aug 27 20:49:09.932118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3/7] 10.222.0.40 () {60 vars in 1165 bytes} [Sat Aug 27 20:49:09 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:09.942277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:09.947086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.964768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.965381 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-88df1c6c-e3a7-4783-a965-1f44e857f3f8 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118167 Aug 27 20:49:09.966847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 5/8] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:09 2022] POST /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:09.972608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.978240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:09.978976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:09.979646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:09.980264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7368bd95-f4fd-4956-8ebf-034cd6ca3c52 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c15b62ad0f0848178518c1e468fc0532"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:10.070097 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-458177f0-97c5-4d3f-bc7f-4838490f6b47 tempest-AZAdminV2TestJSON-141324310 tempest-AZAdminV2TestJSON-141324310-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.136714 Aug 27 20:49:10.073296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 4/9] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:49:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:10.085687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b7b0332-3ebb-4528-8800-e82a5cb9e0fe tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:10.136552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b7b0332-3ebb-4528-8800-e82a5cb9e0fe tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.062094 Aug 27 20:49:10.143435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:49:10 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:10.473232 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7368bd95-f4fd-4956-8ebf-034cd6ca3c52 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1634411898/action" status: 200 len: 97 microversion: 2.1 time: 0.500586 Aug 27 20:49:10.479701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 6/11] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:09 2022] POST /compute/v2.1/flavors/1634411898/action => generated 97 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:10.713498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-28bc8751-03eb-4ccd-bddc-681bc1785f1d tempest-FlavorsExtraSpecsTestJSON-702042565 tempest-FlavorsExtraSpecsTestJSON-702042565-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:10.760119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-28bc8751-03eb-4ccd-bddc-681bc1785f1d tempest-FlavorsExtraSpecsTestJSON-702042565 tempest-FlavorsExtraSpecsTestJSON-702042565-project] 10.222.0.40 "GET /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.614336 Aug 27 20:49:10.761266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1203 bytes} [Sat Aug 27 20:49:10 2022] GET /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:10.768238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d218a43d-5494-48aa-a75d-3fc3ab07e389 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:10.781579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d218a43d-5494-48aa-a75d-3fc3ab07e389 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:10.782298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d218a43d-5494-48aa-a75d-3fc3ab07e389 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:10.783083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d218a43d-5494-48aa-a75d-3fc3ab07e389 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:10.880460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39faefc4-d208-4691-84e9-97f7c9024dae tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1340015053", "id": 1198128760, "os-flavor-access:is_public": "False"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:10.904055 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39faefc4-d208-4691-84e9-97f7c9024dae tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.423188 Aug 27 20:49:10.905408 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 7/13] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:11.274249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d31677f9-849b-4e20-a8ad-e6391d3c3718 tempest-FlavorsAccessTestJSON-940958392 tempest-FlavorsAccessTestJSON-940958392-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:11.405344 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d31677f9-849b-4e20-a8ad-e6391d3c3718 tempest-FlavorsAccessTestJSON-940958392 tempest-FlavorsAccessTestJSON-940958392-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.493162 Aug 27 20:49:11.406177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 8/14] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:10 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:11.424819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa33c14e-a3e4-4650-b37e-d3697e4cc350 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:11.480014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa33c14e-a3e4-4650-b37e-d3697e4cc350 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071121 Aug 27 20:49:11.491211 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 9/15] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:11 2022] POST /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:11.496109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5676f500-52f2-49ea-9616-f10e09c792c1 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:11.834670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d218a43d-5494-48aa-a75d-3fc3ab07e389 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.071768 Aug 27 20:49:11.835775 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 7/16] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:49:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:11.841730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9422f03-db10-413f-aacf-3cd95bb804d1 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c15b62ad0f0848178518c1e468fc0532"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:11.927023 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5676f500-52f2-49ea-9616-f10e09c792c1 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1198128760/action" status: 200 len: 97 microversion: 2.1 time: 0.434535 Aug 27 20:49:11.934244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 10/17] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:11 2022] POST /compute/v2.1/flavors/1198128760/action => generated 97 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:11.947002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70f7b281-b926-473b-a1e5-3834cee5277e tempest-FlavorsExtraSpecsTestJSON-702042565 tempest-FlavorsExtraSpecsTestJSON-702042565-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:12.031331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70f7b281-b926-473b-a1e5-3834cee5277e tempest-FlavorsExtraSpecsTestJSON-702042565 tempest-FlavorsExtraSpecsTestJSON-702042565-project] 10.222.0.40 "GET /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.094525 Aug 27 20:49:12.033210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 11/18] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 20:49:11 2022] GET /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes => generated 22 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:12.052503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec012f62-555e-42c4-88fd-a061e0558963 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:12.543454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9422f03-db10-413f-aacf-3cd95bb804d1 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1634411898/action" status: 200 len: 21 microversion: 2.1 time: 0.705986 Aug 27 20:49:12.548280 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 8/19] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:11 2022] POST /compute/v2.1/flavors/1634411898/action => generated 21 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:12.580834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46495592-2e25-41ba-aa84-55a3a323c1e6 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:12.628680 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46495592-2e25-41ba-aa84-55a3a323c1e6 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079169 Aug 27 20:49:12.630619 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 9/20] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:12 2022] POST /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:12.933326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-ec012f62-555e-42c4-88fd-a061e0558963 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec012f62-555e-42c4-88fd-a061e0558963 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Request method failure captured: Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/flavors/1198128760/action HTTP/1.1 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 67 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEFn9pQnY7RoPlqzaXYzgSOUa60SA5MrKQHsT7Q1AgETQrVLY1a1VggNIQKKkNG__3W7hd-EKpx8q8ukwvHyIhWqfpiwAi6IY5EkITAT8efZ9DSid3jnhUZRv4maIZaU5EA7R8_eo8GHMMENsLx2s68WXLVhIllTYVLAigP7mZM18 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:49:13.017736 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ccf45be3fe4f43dcbeb82d13042390cb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}] Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4ded510011a9454f9d28e943fa87e84e Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} Aug 27 20:49:13.018995 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: exception: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1198128760', 'body': {'addTenantAccess': {'tenant': '89399f03e58a44e3baf907de88be8f34'}}} Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result.read() Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:49:13.019634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-89399f03e58a44e3baf907de88be8f34' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 20:49:13.020482 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 20:49:13.021637 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:49:13.022489 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result.read() Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-89399f03e58a44e3baf907de88be8f34' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 20, 49, 12, 916323), 'updated_at': None, 'flavor_id': 17, 'project_id': '89399f03e58a44e3baf907de88be8f34'}] Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:13.023465 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:13.026417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:13.028359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec012f62-555e-42c4-88fd-a061e0558963 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 89399f03e58a44e3baf907de88be8f34 combination. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec012f62-555e-42c4-88fd-a061e0558963 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1198128760/action" status: 409 len: 152 microversion: 2.1 time: 0.985407 Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 12/21] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:12 2022] POST /compute/v2.1/flavors/1198128760/action => generated 152 bytes in 990 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:49:13.030392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0a1f7ac5-fa95-425d-8f0f-1137ae9e1930 tempest-FlavorsAccessTestJSON-940958392 tempest-FlavorsAccessTestJSON-940958392-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.058577 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0a1f7ac5-fa95-425d-8f0f-1137ae9e1930 tempest-FlavorsAccessTestJSON-940958392 tempest-FlavorsAccessTestJSON-940958392-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.033072 Aug 27 20:49:13.063407 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 13/22] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:13.068291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-282f5ea6-2112-4a87-9f8a-70b809a35037 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.078475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-282f5ea6-2112-4a87-9f8a-70b809a35037 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018007 Aug 27 20:49:13.079964 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 14/23] 10.222.0.40 () {58 vars in 1203 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:13.088332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9414501-bec9-4bf6-b572-3e8ab0b6bab6 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:13.284318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1743742301", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "availability_zone": "tempest-test_az-1843495163"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:13.297230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:13.297786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:13.298462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:13.299413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:13.299971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:13.300780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:13.599451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9414501-bec9-4bf6-b572-3e8ab0b6bab6 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1198128760/action" status: 200 len: 21 microversion: 2.1 time: 0.518190 Aug 27 20:49:13.600458 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 15/24] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:13 2022] POST /compute/v2.1/flavors/1198128760/action => generated 21 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:13.606015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39111a6f-774a-4755-a0b3-fa20c0d862b2 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.639286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39111a6f-774a-4755-a0b3-fa20c0d862b2 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1634411898" status: 202 len: 0 microversion: 2.1 time: 0.037287 Aug 27 20:49:13.640079 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 16/25] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:13 2022] DELETE /compute/v2.1/flavors/1634411898 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:13.646149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c97d406-38e7-4e03-b94d-0b127b4ebbf0 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:13.684291 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c97d406-38e7-4e03-b94d-0b127b4ebbf0 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042624 Aug 27 20:49:13.685212 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 17/26] 10.222.0.40 () {60 vars in 1265 bytes} [Sat Aug 27 20:49:13 2022] PUT /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes => generated 22 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:13.689919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57f3c308-0d4a-498d-80b0-01d214613432 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.713749 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-57f3c308-0d4a-498d-80b0-01d214613432 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1198128760" status: 202 len: 0 microversion: 2.1 time: 0.027220 Aug 27 20:49:13.714369 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 18/27] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:13 2022] DELETE /compute/v2.1/flavors/1198128760 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:13.722015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02b244a8-6130-49cb-9586-0eb6533ca9c5 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.754350 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02b244a8-6130-49cb-9586-0eb6533ca9c5 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.036021 Aug 27 20:49:13.765895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 19/28] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:13.765895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b3fef05-0897-4b0a-a2e6-6c526ed99dab tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.769178 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b3fef05-0897-4b0a-a2e6-6c526ed99dab tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012304 Aug 27 20:49:13.769968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 20/29] 10.222.0.40 () {58 vars in 1203 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/1802863814/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:13.775060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-988cd8e1-ee6f-4839-810f-3ba17ab88246 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.780466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:13.797712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-988cd8e1-ee6f-4839-810f-3ba17ab88246 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.026684 Aug 27 20:49:13.798287 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 21/30] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:13.803052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f1304ac-e769-49c5-b72d-bdf262d73b83 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1385003076", "id": 1028549749, "os-flavor-access:is_public": "False"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:13.825650 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f1304ac-e769-49c5-b72d-bdf262d73b83 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.026213 Aug 27 20:49:13.826489 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 22/31] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:13 2022] POST /compute/v2.1/flavors => generated 431 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:13.831287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3af83040-330f-4372-a452-92911f6c18f8 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.869828 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3af83040-330f-4372-a452-92911f6c18f8 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.041978 Aug 27 20:49:13.870510 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 23/32] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:49:13 2022] DELETE /compute/v2.1/flavors/1802863814/os-extra_specs/hw:numa_nodes => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:49:13.876428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c181d7a-f529-486f-aec5-fc2c15fbe4a8 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-47900904", "id": 420802182, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:13.900493 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c181d7a-f529-486f-aec5-fc2c15fbe4a8 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.028576 Aug 27 20:49:13.901313 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 24/33] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:13 2022] POST /compute/v2.1/flavors => generated 433 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:13.914455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-166748c8-8124-4560-ab39-d7f5230855ef tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.937448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-166748c8-8124-4560-ab39-d7f5230855ef tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1028549749/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.026948 Aug 27 20:49:13.942701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 25/34] 10.222.0.40 () {58 vars in 1209 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/1028549749/os-flavor-access => generated 21 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:13.949124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f676bcbf-135d-405d-996c-e541eef74bcd tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.977236 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f676bcbf-135d-405d-996c-e541eef74bcd tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1802863814/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.031712 Aug 27 20:49:13.981877 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 26/35] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:49:13 2022] DELETE /compute/v2.1/flavors/1802863814/os-extra_specs/hw:cpu_policy => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:49:13.987302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-241fd8ea-6c3a-477b-b8c8-88237b974722 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:13.997083 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-241fd8ea-6c3a-477b-b8c8-88237b974722 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-241fd8ea-6c3a-477b-b8c8-88237b974722 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Request method failure captured: Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/flavors/420802182/os-flavor-access HTTP/1.1 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEFn9pQnY7RoPlqzaXYzgSOUa60SA5MrKQHsT7Q1AgETQrVLY1a1VggNIQKKkNG__3W7hd-EKpx8q8ukwvHyIhWqfpiwAi6IY5EkITAT8efZ9DSid3jnhUZRv4maIZaU5EA7R8_eo8GHMMENsLx2s68WXLVhIllTYVLAigP7mZM18 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:49:14.001589 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ccf45be3fe4f43dcbeb82d13042390cb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}] Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4ded510011a9454f9d28e943fa87e84e Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: exception: Access list not available for public flavors. Aug 27 20:49:14.002624 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'flavor_id': '420802182'} Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 20:49:14.003213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:14.004279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-241fd8ea-6c3a-477b-b8c8-88237b974722 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:14.004279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-241fd8ea-6c3a-477b-b8c8-88237b974722 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/420802182/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020052 Aug 27 20:49:14.007713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 27/36] 10.222.0.40 () {58 vars in 1206 bytes} [Sat Aug 27 20:49:13 2022] GET /compute/v2.1/flavors/420802182/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:49:14.013169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41db458b-ddba-46a2-b65a-122f4ea7795b tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.040497 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41db458b-ddba-46a2-b65a-122f4ea7795b tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1028549749" status: 202 len: 0 microversion: 2.1 time: 0.031695 Aug 27 20:49:14.041821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 28/37] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:14 2022] DELETE /compute/v2.1/flavors/1028549749 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:14.046642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b07858d6-84a1-4e7f-8a02-2653058dcb4b tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.056069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b07858d6-84a1-4e7f-8a02-2653058dcb4b tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/1802863814/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012831 Aug 27 20:49:14.062341 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 29/38] 10.222.0.40 () {58 vars in 1203 bytes} [Sat Aug 27 20:49:14 2022] GET /compute/v2.1/flavors/1802863814/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:14.069304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34b5325b-0305-4765-b9c5-45615091bb5b tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.102029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34b5325b-0305-4765-b9c5-45615091bb5b tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/420802182" status: 202 len: 0 microversion: 2.1 time: 0.038136 Aug 27 20:49:14.102581 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 30/39] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:49:14 2022] DELETE /compute/v2.1/flavors/420802182 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:14.113204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5a814db-7ae2-4c7b-90d0-3a69639cafd4 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.172470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:14.181896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5a814db-7ae2-4c7b-90d0-3a69639cafd4 tempest-FlavorsAccessTestJSON-174457681 tempest-FlavorsAccessTestJSON-174457681-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.070070 Aug 27 20:49:14.184179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 31/40] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:14.199962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7489da2b-27dd-418e-b9df-b1c1797047b1 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.236273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7489da2b-27dd-418e-b9df-b1c1797047b1 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1802863814" status: 202 len: 0 microversion: 2.1 time: 0.050961 Aug 27 20:49:14.241238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 32/41] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:14 2022] DELETE /compute/v2.1/flavors/1802863814 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:14.257838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b79a8848-014d-4bfa-a804-9790a46c5ec5 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.306101 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b79a8848-014d-4bfa-a804-9790a46c5ec5 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061665 Aug 27 20:49:14.320855 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 33/42] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:14.335535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3883c1cf-f533-4fe2-9d6d-663c0d37a733 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:14.375069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3883c1cf-f533-4fe2-9d6d-663c0d37a733 tempest-FlavorsExtraSpecsTestJSON-622846006 tempest-FlavorsExtraSpecsTestJSON-622846006-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052878 Aug 27 20:49:14.391652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 34/43] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:14.401704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20e75002-331b-427b-91ed-13341be23405 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-962030004", "id": 2095529668, "os-flavor-access:is_public": "False"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:14.439757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20e75002-331b-427b-91ed-13341be23405 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.046543 Aug 27 20:49:14.449433 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 35/44] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:14 2022] POST /compute/v2.1/flavors => generated 438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:14.805565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:14.806052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:14.806598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:14.807031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:14.807587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:14.839114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:14.842714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:14.843826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:14.844919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:14.845539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:14.846297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:14.901495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Getting quotas for project ee1b1163e1504c45a46c7587660a92ee. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:14.918362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Getting quotas for user c41583fc2a824031a57658dabfa561f6 and project ee1b1163e1504c45a46c7587660a92ee. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:14.948187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:49:14.952135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:49:14.997151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c44a187-dbcb-47b7-a1ea-837352a6e788 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:15.004304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c44a187-dbcb-47b7-a1ea-837352a6e788 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '01b6f6d2b145413fbdee4d5ee543904c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89399f03e58a44e3baf907de88be8f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c44a187-dbcb-47b7-a1ea-837352a6e788 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Request method failure captured: Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/flavors/2095529668/action HTTP/1.1 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 67 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNBzixmA5fVWJ7WI49C19WRT4kAW2bQU4V4oz8D6wiUrvwg2katc-eQ8g-ohuNhZLYnEQRk0v2SOvd7PVfi6Pz9ghxqnK0SlRAetflSDyt8JoUxtmSwCYJEkTmliqWIikkc9uMjoTkM5d9xXzHE_MURgldNK9Qb-YP2aNtweIjNFDY Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 89399f03e58a44e3baf907de88be8f34 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:15.008666 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89399f03e58a44e3baf907de88be8f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89399f03e58a44e3baf907de88be8f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89399f03e58a44e3baf907de88be8f34", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89399f03e58a44e3baf907de88be8f34"}]}] Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 89399f03e58a44e3baf907de88be8f34 Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536450607-project Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 01b6f6d2b145413fbdee4d5ee543904c Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607-project Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} Aug 27 20:49:15.009903 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '2095529668', 'body': {'addTenantAccess': {'tenant': '89399f03e58a44e3baf907de88be8f34'}}} Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:15.010492 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 20:49:15.011541 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:15.016856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c44a187-dbcb-47b7-a1ea-837352a6e788 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:15.018414 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c44a187-dbcb-47b7-a1ea-837352a6e788 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] 10.222.0.40 "POST /compute/v2.1/flavors/2095529668/action" status: 403 len: 130 microversion: 2.1 time: 0.567192 Aug 27 20:49:15.022730 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 36/45] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:14 2022] POST /compute/v2.1/flavors/2095529668/action => generated 130 bytes in 572 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:15.031771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a4b5222-6c4d-4b37-a64b-1cf663ce6367 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:15.039258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-855bd789-4e97-48fd-b7b6-c1d02fdd6a40 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407094 Aug 27 20:49:15.046321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 10/46] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:49:15.052635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73dc8155-23ba-438c-ba94-003d360dd2d4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:15.053278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-73dc8155-23ba-438c-ba94-003d360dd2d4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:15.103496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a4b5222-6c4d-4b37-a64b-1cf663ce6367 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2095529668" status: 202 len: 0 microversion: 2.1 time: 0.074509 Aug 27 20:49:15.104461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 37/47] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:15 2022] DELETE /compute/v2.1/flavors/2095529668 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:15.116327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1d6f30d8-38a0-40d0-94fc-3698794ecd71 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:15.159454 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1d6f30d8-38a0-40d0-94fc-3698794ecd71 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047396 Aug 27 20:49:15.178119 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 38/48] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:15.197261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd783c83-cb6f-41fa-ae9b-1731dd11f86b tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-254978389", "id": 2044806389, "os-flavor-access:is_public": "False"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:15.201313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-73dc8155-23ba-438c-ba94-003d360dd2d4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:15.236047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73dc8155-23ba-438c-ba94-003d360dd2d4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1243 microversion: 2.1 time: 0.188246 Aug 27 20:49:15.242908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 11/49] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:15 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1243 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:15.248852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd783c83-cb6f-41fa-ae9b-1731dd11f86b tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.055261 Aug 27 20:49:15.251006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 39/50] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:15 2022] POST /compute/v2.1/flavors => generated 438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:15.271230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de20430c-6c28-4d2f-9cce-d68d69cd2575 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:16.273116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83577b76-f917-4db6-9ea2-c54f5ae45b13 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:16.274350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83577b76-f917-4db6-9ea2-c54f5ae45b13 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:16.352252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de20430c-6c28-4d2f-9cce-d68d69cd2575 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/2044806389/action" status: 200 len: 97 microversion: 2.1 time: 1.091831 Aug 27 20:49:16.363133 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 12/51] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:15 2022] POST /compute/v2.1/flavors/2044806389/action => generated 97 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:49:16.373773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad7bcc9c-94bc-44bf-8ed9-4e302f7ff974 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:16.382417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad7bcc9c-94bc-44bf-8ed9-4e302f7ff974 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '01b6f6d2b145413fbdee4d5ee543904c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89399f03e58a44e3baf907de88be8f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad7bcc9c-94bc-44bf-8ed9-4e302f7ff974 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Request method failure captured: Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/flavors/2044806389/action HTTP/1.1 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 70 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNBzixmA5fVWJ7WI49C19WRT4kAW2bQU4V4oz8D6wiUrvwg2katc-eQ8g-ohuNhZLYnEQRk0v2SOvd7PVfi6Pz9ghxqnK0SlRAetflSDyt8JoUxtmSwCYJEkTmliqWIikkc9uMjoTkM5d9xXzHE_MURgldNK9Qb-YP2aNtweIjNFDY Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 89399f03e58a44e3baf907de88be8f34 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:16.399274 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89399f03e58a44e3baf907de88be8f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/89399f03e58a44e3baf907de88be8f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_89399f03e58a44e3baf907de88be8f34", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/89399f03e58a44e3baf907de88be8f34"}]}] Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 89399f03e58a44e3baf907de88be8f34 Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607 Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536450607-project Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 01b6f6d2b145413fbdee4d5ee543904c Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536450607-project Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: {"removeTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} Aug 27 20:49:16.400644 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '2044806389', 'body': {'removeTenantAccess': {'tenant': '89399f03e58a44e3baf907de88be8f34'}}} Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can( Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:16.401262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 20:49:16.402185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:16.407062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad7bcc9c-94bc-44bf-8ed9-4e302f7ff974 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:16.410909 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad7bcc9c-94bc-44bf-8ed9-4e302f7ff974 tempest-FlavorsAccessNegativeTestJSON-1536450607 tempest-FlavorsAccessNegativeTestJSON-1536450607-project] 10.222.0.40 "POST /compute/v2.1/flavors/2044806389/action" status: 403 len: 133 microversion: 2.1 time: 0.042875 Aug 27 20:49:16.416466 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 13/52] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:16 2022] POST /compute/v2.1/flavors/2044806389/action => generated 133 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:16.425689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e225fd7a-6710-43bc-876a-e4701a80adda tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "89399f03e58a44e3baf907de88be8f34"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:17.316378 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e225fd7a-6710-43bc-876a-e4701a80adda tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/2044806389/action" status: 200 len: 21 microversion: 2.1 time: 0.897192 Aug 27 20:49:17.319354 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 14/53] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:16 2022] POST /compute/v2.1/flavors/2044806389/action => generated 21 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:17.329179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4851c9fe-d824-46a1-86f1-5b560efc3902 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:17.379900 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4851c9fe-d824-46a1-86f1-5b560efc3902 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2044806389" status: 202 len: 0 microversion: 2.1 time: 0.054885 Aug 27 20:49:17.382725 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 15/54] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:17 2022] DELETE /compute/v2.1/flavors/2044806389 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:17.391668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef1bc562-29d0-4665-9d89-2238abe1a048 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:17.435708 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef1bc562-29d0-4665-9d89-2238abe1a048 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048778 Aug 27 20:49:17.437867 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 16/55] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:17.460958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd395962-5990-4a90-ae9b-19b68863cc27 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1437608792", "id": 1521859257, "os-flavor-access:is_public": "False"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:17.499431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:17.570234 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd395962-5990-4a90-ae9b-19b68863cc27 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.115196 Aug 27 20:49:17.570893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 17/56] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:17 2022] POST /compute/v2.1/flavors => generated 439 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:17.599952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f24105a-594c-4ca5-9a5d-6a9ffc9a4b6c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "684d4da667cc4ed38aaaa9770525bac6"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:18.368362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83577b76-f917-4db6-9ea2-c54f5ae45b13 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:18.412129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83577b76-f917-4db6-9ea2-c54f5ae45b13 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1243 microversion: 2.1 time: 2.143291 Aug 27 20:49:18.427469 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 40/57] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:16 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1243 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:19.009264 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2f24105a-594c-4ca5-9a5d-6a9ffc9a4b6c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] HTTP exception thrown: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f24105a-594c-4ca5-9a5d-6a9ffc9a4b6c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Request method failure captured: Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/flavors/1521859257/action HTTP/1.1 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 70 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNEFn9pQnY7RoPlqzaXYzgSOUa60SA5MrKQHsT7Q1AgETQrVLY1a1VggNIQKKkNG__3W7hd-EKpx8q8ukwvHyIhWqfpiwAi6IY5EkITAT8efZ9DSid3jnhUZRv4maIZaU5EA7R8_eo8GHMMENsLx2s68WXLVhIllTYVLAigP7mZM18 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:49:19.015390 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ccf45be3fe4f43dcbeb82d13042390cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ccf45be3fe4f43dcbeb82d13042390cb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ccf45be3fe4f43dcbeb82d13042390cb"}]}] Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: ccf45be3fe4f43dcbeb82d13042390cb Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812 Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4ded510011a9454f9d28e943fa87e84e Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: {"removeTenantAccess": {"tenant": "684d4da667cc4ed38aaaa9770525bac6"}} Aug 27 20:49:19.016530 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: exception: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1521859257', 'body': {'removeTenantAccess': {'tenant': '684d4da667cc4ed38aaaa9770525bac6'}}} Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 20:49:19.017221 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:19.018201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. Aug 27 20:49:19.019148 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:19.023946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f24105a-594c-4ca5-9a5d-6a9ffc9a4b6c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Returning 404 to user: Flavor access not found for 22 / 684d4da667cc4ed38aaaa9770525bac6 combination. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:19.035935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f24105a-594c-4ca5-9a5d-6a9ffc9a4b6c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/1521859257/action" status: 404 len: 124 microversion: 2.1 time: 1.455998 Aug 27 20:49:19.038270 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 18/58] 10.222.0.40 () {60 vars in 1200 bytes} [Sat Aug 27 20:49:17 2022] POST /compute/v2.1/flavors/1521859257/action => generated 124 bytes in 1460 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:19.045865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18ff71e1-4a14-4b3b-aff2-5249909b0a2c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:19.098525 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18ff71e1-4a14-4b3b-aff2-5249909b0a2c tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1521859257" status: 202 len: 0 microversion: 2.1 time: 0.056244 Aug 27 20:49:19.100010 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 41/59] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:19 2022] DELETE /compute/v2.1/flavors/1521859257 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:19.110660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7994e395-4ec2-4841-9c16-b6b9b150dcf0 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:19.146304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7994e395-4ec2-4841-9c16-b6b9b150dcf0 tempest-FlavorsAccessNegativeTestJSON-1167107812 tempest-FlavorsAccessNegativeTestJSON-1167107812-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042380 Aug 27 20:49:19.148624 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 19/60] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:19.444026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:19.444859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:19.463001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:19.463622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:19.465130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:19.473957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:19.476422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:19.478085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:19.481774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:19.484497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.324369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:20.347673 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9cc52470-2968-47fd-bff5-cf8a70197926 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1297 microversion: 2.1 time: 0.915503 Aug 27 20:49:20.363698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 20/61] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:19 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1297 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:20.459315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548bd700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:20.461488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.462196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.462818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.513130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.516735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.517194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.546137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.546535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.549100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.563119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a65a4a1-afbd-47dc-83c0-ccd546233efe tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.290319 Aug 27 20:49:20.568243 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 42/62] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:20.587394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548bd040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:20.593609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.594482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.595060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.632935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.638593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.640082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.673399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.676198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.678434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.690936 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2742bcf6-1642-412e-904e-2fc78f9b318a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.113014 Aug 27 20:49:20.696254 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 43/63] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 20:49:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:20.713727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff854893f70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:20.719415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.722413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.725947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.765927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.767303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.767861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.793857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=17 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:20.798240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.799667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.800856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.822441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10d1ead8-fa30-4e99-a735-559333156726 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.112201 Aug 27 20:49:20.823643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 44/64] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:20.839857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548bf0d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:20.846646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.851384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.851933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.897165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5fa1263-dca5-412a-8efb-80a5b5758ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-236447475", "ram": 512, "vcpus": 1, "disk": 10, "id": 2137910733, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:20.914098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.914603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.916088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:20.932205 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5fa1263-dca5-412a-8efb-80a5b5758ed5 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.579682 Aug 27 20:49:20.936676 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 21/65] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:20 2022] POST /compute/v2.1/flavors => generated 415 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:20.946619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-53933756-7e60-4352-9ff3-8df379b2208d tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.102981 Aug 27 20:49:20.949265 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 45/66] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:49:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:20.967558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2b91ff1-5484-44c7-8494-7b109a701adb tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548e5d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:20.973259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2b91ff1-5484-44c7-8494-7b109a701adb tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:20.973948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2b91ff1-5484-44c7-8494-7b109a701adb tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:20.978782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2b91ff1-5484-44c7-8494-7b109a701adb tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.023518 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2b91ff1-5484-44c7-8494-7b109a701adb tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.062987 Aug 27 20:49:21.024481 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 46/67] 10.222.0.40 () {58 vars in 1179 bytes} [Sat Aug 27 20:49:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:21.046319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff854893e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:21.048481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.048945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.049393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.085684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.086277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.086889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.112448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.113148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.113984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.127325 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18932c5b-7a25-45d5-a20c-c073eece1b46 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093336 Aug 27 20:49:21.130761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 47/68] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:21.141701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548a3d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:21.144880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.147677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.151539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.180347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.181074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.183755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.198083 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1581741-09a1-4472-a186-2a55352a987a tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.061508 Aug 27 20:49:21.202896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 48/69] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:49:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:21.215247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff8548a3dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:21.217964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.219252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.221007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.253073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.256153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.256996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.274484 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01d04923-45f1-415e-832e-a64359f37cca tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.060643 Aug 27 20:49:21.276555 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 49/70] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:49:21 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:21.292270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Calling method '.version_select at 0x7ff854858040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:21.294436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.295145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.296464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.355808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.367532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.369088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.402239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.403883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.404870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.420541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:49:21.423120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8db27fa-3df7-4edb-8b29-ba3af0f7e114 tempest-HypervisorAdminTestJSON-206612825 tempest-HypervisorAdminTestJSON-206612825-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:49:21.428601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.429289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.429865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.430758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.431203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.435665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.451819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.rpcapi [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 20:49:21.452677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] Releasing lock "compute-rpcapi-router" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:49:21.524476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97d11191-ac7b-4f9f-8d66-1a54921ecfdf None None] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.236752 Aug 27 20:49:21.533966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 50/71] 10.222.0.40 () {58 vars in 1173 bytes} [Sat Aug 27 20:49:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:21.540454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:21.541257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:21.574618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.580208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.582502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:21.584520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:21.587661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:21.590974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:22.189489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73838d64-8d8a-464f-9698-4422e47edc58 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:22.223735 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-73838d64-8d8a-464f-9698-4422e47edc58 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] HTTP exception thrown: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73838d64-8d8a-464f-9698-4422e47edc58 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Request method failure captured: Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNLj4RJF3owkPnKjGyiAqbwf03Vr5hG1Pds56u6NDm31Sgum9iaL8gMboU187Xp_JllFydWlYpd1ptjlKsHoM-IT-9lI_sRCFX_ayGAw9-_ZxXzzuj6NH2ljwLT6LLqC8kAMUVXZcCN0Q924NckqHJl2PnWCzPZ6_7ZJozjVU3ryCs Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:22.226056 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19f89578a122466d94971f966fe4b1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}] Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e90bc47de8e243f9832d90e1b608e2bd Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.227209 ncdv-master-1 devstack@n-api.service[140433]: exception: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'id': 'hw:cpu_thread_policy'} Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.227842 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73838d64-8d8a-464f-9698-4422e47edc58 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Returning 404 to user: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.228891 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73838d64-8d8a-464f-9698-4422e47edc58 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] 10.222.0.40 "GET /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 1.283216 Aug 27 20:49:22.239217 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 22/72] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 20:49:20 2022] GET /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 1296 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:49:22.277332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fcb3b42-51ab-4425-a173-65c539933e55 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.292417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9fcb3b42-51ab-4425-a173-65c539933e55 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e90bc47de8e243f9832d90e1b608e2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f89578a122466d94971f966fe4b1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fcb3b42-51ab-4425-a173-65c539933e55 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Request method failure captured: Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/flavors/2137910733/os-extra_specs HTTP/1.1 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 66 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNLj4RJF3owkPnKjGyiAqbwf03Vr5hG1Pds56u6NDm31Sgum9iaL8gMboU187Xp_JllFydWlYpd1ptjlKsHoM-IT-9lI_sRCFX_ayGAw9-_ZxXzzuj6NH2ljwLT6LLqC8kAMUVXZcCN0Q924NckqHJl2PnWCzPZ6_7ZJozjVU3ryCs Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:22.301413 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19f89578a122466d94971f966fe4b1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}] Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e90bc47de8e243f9832d90e1b608e2bd Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 20:49:22.302852 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:22.303519 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 20:49:22.304456 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.309966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fcb3b42-51ab-4425-a173-65c539933e55 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.312260 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9fcb3b42-51ab-4425-a173-65c539933e55 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] 10.222.0.40 "POST /compute/v2.1/flavors/2137910733/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.069175 Aug 27 20:49:22.317850 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 23/73] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:22 2022] POST /compute/v2.1/flavors/2137910733/os-extra_specs => generated 124 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:22.342043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46272e87-9af9-4d65-8f02-5578852d76f5 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.477794 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46272e87-9af9-4d65-8f02-5578852d76f5 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/2137910733/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.152805 Aug 27 20:49:22.478429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 24/74] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:22 2022] POST /compute/v2.1/flavors/2137910733/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:49:22.494313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-493b7055-8e5c-422d-84c7-04404618a3e1 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:22.506020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-493b7055-8e5c-422d-84c7-04404618a3e1 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e90bc47de8e243f9832d90e1b608e2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f89578a122466d94971f966fe4b1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-493b7055-8e5c-422d-84c7-04404618a3e1 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Request method failure captured: Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNLj4RJF3owkPnKjGyiAqbwf03Vr5hG1Pds56u6NDm31Sgum9iaL8gMboU187Xp_JllFydWlYpd1ptjlKsHoM-IT-9lI_sRCFX_ayGAw9-_ZxXzzuj6NH2ljwLT6LLqC8kAMUVXZcCN0Q924NckqHJl2PnWCzPZ6_7ZJozjVU3ryCs Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:22.510400 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19f89578a122466d94971f966fe4b1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}] Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e90bc47de8e243f9832d90e1b608e2bd Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.511842 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'id': 'hw:numa_nodes'} Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:22.512425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 20:49:22.513537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.515661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-493b7055-8e5c-422d-84c7-04404618a3e1 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.528633 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-493b7055-8e5c-422d-84c7-04404618a3e1 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] 10.222.0.40 "DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.038476 Aug 27 20:49:22.535406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 25/75] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:49:22 2022] DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes => generated 124 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:22.553260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a8e296e-5a8e-4351-bb1f-f3e4e020f853 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.653236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a8e296e-5a8e-4351-bb1f-f3e4e020f853 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/2137910733/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.111411 Aug 27 20:49:22.657099 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 26/76] 10.222.0.40 () {60 vars in 1224 bytes} [Sat Aug 27 20:49:22 2022] POST /compute/v2.1/flavors/2137910733/os-extra_specs => generated 66 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:49:22.666795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8fd55817-5958-4a6b-9f5a-43638d395f1f tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.683030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8fd55817-5958-4a6b-9f5a-43638d395f1f tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e90bc47de8e243f9832d90e1b608e2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f89578a122466d94971f966fe4b1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8fd55817-5958-4a6b-9f5a-43638d395f1f tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Request method failure captured: Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 22 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNLj4RJF3owkPnKjGyiAqbwf03Vr5hG1Pds56u6NDm31Sgum9iaL8gMboU187Xp_JllFydWlYpd1ptjlKsHoM-IT-9lI_sRCFX_ayGAw9-_ZxXzzuj6NH2ljwLT6LLqC8kAMUVXZcCN0Q924NckqHJl2PnWCzPZ6_7ZJozjVU3ryCs Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:22.702302 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/19f89578a122466d94971f966fe4b1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_19f89578a122466d94971f966fe4b1e6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/19f89578a122466d94971f966fe4b1e6"}]}] Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 19f89578a122466d94971f966fe4b1e6 Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e90bc47de8e243f9832d90e1b608e2bd Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: {"hw:numa_nodes": "1"} Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.703436 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:22.704204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 20:49:22.705187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.709506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8fd55817-5958-4a6b-9f5a-43638d395f1f tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.710666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8fd55817-5958-4a6b-9f5a-43638d395f1f tempest-FlavorsExtraSpecsNegativeTestJSON-987022597 tempest-FlavorsExtraSpecsNegativeTestJSON-987022597-project] 10.222.0.40 "PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.047978 Aug 27 20:49:22.713398 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 27/77] 10.222.0.40 () {60 vars in 1265 bytes} [Sat Aug 27 20:49:22 2022] PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes => generated 124 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:22.729227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75e19565-1d7a-4508-891c-66fd9d80d91e tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:22.758227 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-75e19565-1d7a-4508-891c-66fd9d80d91e tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] HTTP exception thrown: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75e19565-1d7a-4508-891c-66fd9d80d91e tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Request method failure captured: Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNP9Z0Yw1YCUaCue3r_OjJaCXbcfMiAlUs7NdEZixX9JfS9xw_HEYZ_NH008vfa2OWPzeKyoLKNEfTnp4g524T6aPaFaNNS-znNfZKWR6Bjatd_kPR9qOyiGBP36IJQwm7T3Cx3mp1XoLrngbLWZrWacIkH6W9vmMwtJqvabgaZs-A Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:49:22.768123 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77d5cf2ea1746bf8f9bd8635cdee10b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}] Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5fbfa1543e9e4dbbb3cbe6d10b962ecc Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.769838 ncdv-master-1 devstack@n-api.service[140433]: exception: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'id': 'hw:cpu_thread_policy'} Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.770711 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75e19565-1d7a-4508-891c-66fd9d80d91e tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Returning 404 to user: Flavor 2137910733 has no extra specs with key hw:cpu_thread_policy. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.772294 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75e19565-1d7a-4508-891c-66fd9d80d91e tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.052446 Aug 27 20:49:22.781417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 28/78] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 20:49:22 2022] DELETE /compute/v2.1/flavors/2137910733/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:49:22.794177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:22.812944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-001f6771-2532-4c85-b1e1-2b33260b57a1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.829334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e79c99d0-a007-4d74-adde-f1fc3d98409b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 1.292588 Aug 27 20:49:22.831391 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 51/79] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:21 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:22.843707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-001f6771-2532-4c85-b1e1-2b33260b57a1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-001f6771-2532-4c85-b1e1-2b33260b57a1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Request method failure captured: Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 27 Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNP9Z0Yw1YCUaCue3r_OjJaCXbcfMiAlUs7NdEZixX9JfS9xw_HEYZ_NH008vfa2OWPzeKyoLKNEfTnp4g524T6aPaFaNNS-znNfZKWR6Bjatd_kPR9qOyiGBP36IJQwm7T3Cx3mp1XoLrngbLWZrWacIkH6W9vmMwtJqvabgaZs-A Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:49:22.859090 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77d5cf2ea1746bf8f9bd8635cdee10b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}] Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5fbfa1543e9e4dbbb3cbe6d10b962ecc Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: {"hw:cpu_policy": "shared"} Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:22.860441 ncdv-master-1 devstack@n-api.service[140433]: exception: Request body and URI mismatch Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'flavor_id': '2137910733', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.861099 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.862204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:22.862204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:22.862204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 20:49:22.862204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.864387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-001f6771-2532-4c85-b1e1-2b33260b57a1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.866320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-001f6771-2532-4c85-b1e1-2b33260b57a1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.082860 Aug 27 20:49:22.873692 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 29/80] 10.222.0.40 () {60 vars in 1265 bytes} [Sat Aug 27 20:49:22 2022] PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes => generated 73 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:22.879599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58e14627-fbeb-41f6-b219-eb957ed8dd74 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58e14627-fbeb-41f6-b219-eb957ed8dd74 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Request method failure captured: Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 49 Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNP9Z0Yw1YCUaCue3r_OjJaCXbcfMiAlUs7NdEZixX9JfS9xw_HEYZ_NH008vfa2OWPzeKyoLKNEfTnp4g524T6aPaFaNNS-znNfZKWR6Bjatd_kPR9qOyiGBP36IJQwm7T3Cx3mp1XoLrngbLWZrWacIkH6W9vmMwtJqvabgaZs-A Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:49:22.899129 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f77d5cf2ea1746bf8f9bd8635cdee10b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f77d5cf2ea1746bf8f9bd8635cdee10b"}]}] Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f77d5cf2ea1746bf8f9bd8635cdee10b Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5fbfa1543e9e4dbbb3cbe6d10b962ecc Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 20:49:22.900462 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'flavor_id': '2137910733', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance: Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 20:49:22.901198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.906723 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58e14627-fbeb-41f6-b219-eb957ed8dd74 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58e14627-fbeb-41f6-b219-eb957ed8dd74 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026529 Aug 27 20:49:22.908064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 52/81] 10.222.0.40 () {60 vars in 1265 bytes} [Sat Aug 27 20:49:22 2022] PUT /compute/v2.1/flavors/2137910733/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 20:49:22.914651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-682be656-e4f1-49b8-b0bf-0c0bc71bc7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:22.957671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-682be656-e4f1-49b8-b0bf-0c0bc71bc7e8 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2137910733" status: 202 len: 0 microversion: 2.1 time: 0.050269 Aug 27 20:49:22.969878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d81e15c-a59c-4886-be07-97a7f10627e1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:22.979211 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 30/82] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:49:22 2022] DELETE /compute/v2.1/flavors/2137910733 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:49:23.034706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d81e15c-a59c-4886-be07-97a7f10627e1 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406 tempest-FlavorsExtraSpecsNegativeTestJSON-168172406-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070148 Aug 27 20:49:23.036620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 53/83] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:23.852350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:23.854296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:23.868516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:23.883464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:23.885405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:23.894017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:23.900270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:23.902986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:24.814867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:24.829942 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b231a91-1038-4085-b958-7023c62d334b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.978072 Aug 27 20:49:24.831148 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 31/84] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:23 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:25.848613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:25.849655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:25.856503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:25.857769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:25.890463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:25.890990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:25.891457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:25.895637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:25.897991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:25.902508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:26.273598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:26.286348 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec79e63b-677f-4eed-85c4-5244d06140fb tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.438337 Aug 27 20:49:26.293617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 32/85] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:25 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:26.342269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a3f8088-2e66-4111-b9cc-ea20c988f382 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:26.363332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a3f8088-2e66-4111-b9cc-ea20c988f382 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.976540 Aug 27 20:49:26.371900 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 54/86] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:49:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:27.317495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:27.318650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:27.332218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:27.332920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:27.340604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:27.347052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:27.350027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:27.365161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:27.665341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0cb7fd8-daab-4e59-b408-9a2d2272ff9c tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-166992164", "id": 415741767, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:27.731613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:27.745473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54153a88-35a0-47fb-afb1-b1f7d8852c04 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.433882 Aug 27 20:49:27.748271 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 55/87] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:27 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:27.749963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0cb7fd8-daab-4e59-b408-9a2d2272ff9c tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 1.373191 Aug 27 20:49:27.754428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 33/88] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:26 2022] POST /compute/v2.1/flavors => generated 421 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:27.766868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04c152d3-6abf-474c-a190-f5e06db23972 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:27.789680 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04c152d3-6abf-474c-a190-f5e06db23972 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028099 Aug 27 20:49:27.792024 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 56/89] 10.222.0.40 () {58 vars in 1182 bytes} [Sat Aug 27 20:49:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:49:27.804468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51b9262f-2ef8-40dd-9788-30733430759d tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1644797605", "id": 584875103, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:27.854634 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51b9262f-2ef8-40dd-9788-30733430759d tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.054884 Aug 27 20:49:27.857089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 34/90] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:27 2022] POST /compute/v2.1/flavors => generated 422 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:27.869928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0bfaf87f-5ea8-4048-8d86-d541640f18d1 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:27.893757 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0bfaf87f-5ea8-4048-8d86-d541640f18d1 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026034 Aug 27 20:49:27.896012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 35/91] 10.222.0.40 () {58 vars in 1182 bytes} [Sat Aug 27 20:49:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:49:27.920428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d2646c9-2e38-47c2-a574-9da2766b637a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Action: 'create', calling method: .version_select at 0x7ff854064040>, body: {"keypair": {"name": "tempest-keypair-730360253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6Wwdp4d1u2QTcHuWyH2Afy+bf7SyYctsFm5z64tKcFFKlgVZFNYel2DmjdNH2U5nKhhX/a+rYtxd0DxCabigOXhLuBGMdHA///dWDM3wm5YTKSiCoi3upebmrHjAkmQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:27.995209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-8d2646c9-2e38-47c2-a574-9da2766b637a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for project c61874976b164c9581dc6e4287f77389. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:28.004104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-8d2646c9-2e38-47c2-a574-9da2766b637a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for user 2fd3010448cc4d0c8b6da2dd09a55055 and project c61874976b164c9581dc6e4287f77389. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:28.064595 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d2646c9-2e38-47c2-a574-9da2766b637a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159547 Aug 27 20:49:28.065926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 36/92] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:49:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:28.410600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:28.915090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000ccbb0-4cae-4f2d-9e8c-a25d079e37f9", "tag": "1e17d780-355d-41f9-b233-eee460f08d01"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:28.960468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:28.961790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:28.963234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.013063 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Creating event network-changed:1e17d780-355d-41f9-b233-eee460f08d01 for instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 on nch1-master-1 Aug 27 20:49:29.016707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:49:29.017774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Calling method '.version_select at 0x7ff84ff1f9d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:29.018755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-19e7ae6c-dd74-4b14-b165-701ba2ab2e31 req-ab234a2b-dd0b-4fa2-8e4a-54a89c0d8e45 service nova] Acquired lock "compute-rpcapi-router" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:49:29.019761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.020520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.021120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.021770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.022763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.024339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.026122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.027510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.028150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.042868 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.compute.rpcapi [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 20:49:29.045545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] Releasing lock "compute-rpcapi-router" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:49:29.076349 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d75ab265-165b-412e-8f8d-44f9e74b8c19 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.989857 Aug 27 20:49:29.077145 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 37/93] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:29.140339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:29.144778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:29.191786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.201278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.202038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.209212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.209760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.210310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.662216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.662812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.663172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.703711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.707258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.709935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.729734 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d7053e16-3213-47db-95f0-e4408c87c917 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.920652 Aug 27 20:49:29.731375 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 57/94] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:49:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:29.753165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Calling method '.version_select at 0x7ff84ff1f0d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:29.764807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.766125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.768979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.815519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:29.818866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:29.819811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:29.839078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.098083 Aug 27 20:49:29.844200 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 58/95] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:49:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:29.846736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:29.848080 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ba0ae5b-f9d9-4bd8-bcb6-55b00a7aeae4 tempest-HypervisorAdminV228Test-588055692 tempest-HypervisorAdminV228Test-588055692-project-admin] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001827 Aug 27 20:49:29.849374 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 59/96] 10.222.0.40 () {56 vars in 886 bytes} [Sat Aug 27 20:49:29 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 20:49:29.944589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:29.955305 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1050f5be-0ca5-46e8-8684-1a4bd55a1f94 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.851434 Aug 27 20:49:29.972189 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 38/97] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:29 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:30.981634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:30.982184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:31.004825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:31.004825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:31.004825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:31.008354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:31.008906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:31.009408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:31.451715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:32.269764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:32.285568 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7896ae8-6d06-4fe1-a806-2fd35cfde80e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 1.309886 Aug 27 20:49:32.309240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 60/98] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:30 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:33.311233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:33.311914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:33.327837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:33.328640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:33.329217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:33.330205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:33.330771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:33.331500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:33.578853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:33.592938 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ee750d5-4d71-4b55-8fff-dce91102c536 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.286333 Aug 27 20:49:33.593638 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 39/99] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:33 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:33.675436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-446060052", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "584875103", "adminPass": "***", "networks": [{"uuid": "49a5ad17-518d-4486-b42f-7fe3235e4c3c"}], "security_groups": [{"name": "tempest-securitygroup--385503260"}], "key_name": "tempest-keypair-730360253", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:33.815838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] validate_networks() for [('49a5ad17-518d-4486-b42f-7fe3235e4c3c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:34.615982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:34.617288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:34.623696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:34.624189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:34.624643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:34.625310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:34.625754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:34.626169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:34.848035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:34.863367 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf923702-c9fe-4f3d-97bf-0384b05fa97b tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.251630 Aug 27 20:49:34.866926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 40/100] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:34 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:35.012829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:35.013324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:35.013712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:35.014446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:35.014861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:35.030141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.030926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.031856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.032996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.033861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.034752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.068270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for project c61874976b164c9581dc6e4287f77389. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:35.075257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for user 2fd3010448cc4d0c8b6da2dd09a55055 and project c61874976b164c9581dc6e4287f77389. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:35.088572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:49:35.092316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:49:35.160593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-338b5a45-607a-40d2-9293-b46d5d9d06a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.491547 Aug 27 20:49:35.162588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 61/101] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:49:35.184919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a43d6b3e-b154-4f9c-a256-1736c3523b08 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.186162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a43d6b3e-b154-4f9c-a256-1736c3523b08 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:35.262718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a43d6b3e-b154-4f9c-a256-1736c3523b08 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:35.274686 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a43d6b3e-b154-4f9c-a256-1736c3523b08 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1261 microversion: 2.1 time: 0.095823 Aug 27 20:49:35.275977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 62/102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:35.475548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Calling method '.version_select at 0x7ff854064e50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.477362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.477914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.478329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.497990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.498707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.499439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.513252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.514049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.514776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.522445 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-394c44e1-e851-42e0-809e-1411b6884e85 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.393490 Aug 27 20:49:35.528557 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 41/103] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:35.533774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Calling method '.version_select at 0x7ff84fe34b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.535591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.537257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.537885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.559153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.559740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.560213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.614010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.614517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.614980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.625137 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ceb6294e-3f66-4518-b07e-20406c23f3f8 tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.095358 Aug 27 20:49:35.627503 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 63/104] 10.222.0.40 () {58 vars in 1212 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 196 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:35.643922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Calling method '.version_select at 0x7ff84ff0a1f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.647196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.647758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.648467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.664609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.665416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.665863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.676848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.677706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.678922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.687391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbedb686-d207-403d-a3bf-bb62e27cb96c tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052354 Aug 27 20:49:35.688387 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 64/105] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:35.700411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Calling method '.version_select at 0x7ff84feda430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.702541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.703037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.703521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.722032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.723128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.723822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.732941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-276c8853-9a44-462c-8f7d-4bdf5502ad0d tempest-HypervisorAdminUnderV252Test-1752529970 tempest-HypervisorAdminUnderV252Test-1752529970-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.037039 Aug 27 20:49:35.740753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 65/106] 10.222.0.40 () {58 vars in 1209 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:35.837808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2137645723", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:35.891048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:35.891702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:35.900200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:35.901443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.902855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.903678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:35.905106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:35.905787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:35.906495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:36.184841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:36.188387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:36.194340 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3cb79a6e-db9c-4405-a8b1-863b14292219 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.308830 Aug 27 20:49:36.196043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 66/107] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:35 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:36.261598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:36.262523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:36.263199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:36.263812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:36.264737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:36.280082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:36.280759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:36.281265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:36.282151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:36.282688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:36.286625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:36.299572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:36.300201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:36.309093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:36.310983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:36.311639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:36.318192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:36.318844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:36.319970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:36.320612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:36.325447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for user 7a345ebf9ea846089ee8e5d8eac1b47d and project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:36.340355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:49:36.343994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:49:36.381233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=4,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:36.401980 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9504112-4e18-4ef5-b9a1-b19a7140db2f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809774 Aug 27 20:49:36.403621 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 42/108] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:49:36.417267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:36.426797 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1aa2cf5f-4a78-49b2-a6e4-044a6e5bedd6 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1265 microversion: 2.1 time: 0.131652 Aug 27 20:49:36.427428 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 67/109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:36 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:36.627261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-506492397", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:36.728924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:37.048320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:37.048916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:37.049211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:37.049629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:37.050096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:37.080112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.082174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.083446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.085163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.085867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.086367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.121556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:37.129353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for user 7a345ebf9ea846089ee8e5d8eac1b47d and project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:37.148133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:49:37.152989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:49:37.221370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:37.222008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:37.227004 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05cb8bae-8e83-4b68-b645-0c21b3c7badf tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604089 Aug 27 20:49:37.234253 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 43/110] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:49:37.234432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.234797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.235249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.244413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.244413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.244413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.247559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15019465-471f-4986-b788-6c6f630291bb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:37.249769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15019465-471f-4986-b788-6c6f630291bb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:37.472889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15019465-471f-4986-b788-6c6f630291bb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:37.481277 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15019465-471f-4986-b788-6c6f630291bb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1213 microversion: 2.1 time: 0.244728 Aug 27 20:49:37.482714 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 44/111] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:37 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:37.612942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:37.622258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a82780b0-a6e9-4cc2-96b0-ee6bafc119a4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.406768 Aug 27 20:49:37.631486 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 68/112] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:37 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:37.631486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:37.631486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:37.636492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.648039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.648505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.649256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:37.649720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:37.650143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:37.779848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:37.793437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d13e923a-2871-4984-b55f-9f339dcab728 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.169041 Aug 27 20:49:37.795386 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 69/113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:37 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:38.020099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8bb686ca-6b44-458f-871d-68de4e7bbfe5 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Calling method '.version_select at 0x7ff854039ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.022263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8bb686ca-6b44-458f-871d-68de4e7bbfe5 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8fd99211934b4d86b3b80bd6a2b29e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be51672fa494c499ed13fdcfa2a9b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8bb686ca-6b44-458f-871d-68de4e7bbfe5 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Request method failure captured: Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNfXEXxOWNqQR0Xx89YVJ2_kE9CEMtgzHjUfCfYQ1aAj23hMfBgU-htz9CkZaxON7iL3P-9nHZs9CfT211B2QDm27Ep06KIRSyeolFTv_9m3aikkSkreag8qlBEnz5CAbZfllMr_JimhruMuL8Ti2WpcmMRmac72vdYV83OqrjZnvo Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:38.029651 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8be51672fa494c499ed13fdcfa2a9b98", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}] Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8fd99211934b4d86b3b80bd6a2b29e92 Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: action_args: {} Aug 27 20:49:38.031120 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:38.033021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 20:49:38.034072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.035106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8bb686ca-6b44-458f-871d-68de4e7bbfe5 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.035106 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8bb686ca-6b44-458f-871d-68de4e7bbfe5 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.546596 Aug 27 20:49:38.039559 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 45/114] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 20:49:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 556 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:38.042207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3033189-8093-4aca-9639-c77b67b50e31 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Calling method '.version_select at 0x7ff84fde4670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.044075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a3033189-8093-4aca-9639-c77b67b50e31 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8fd99211934b4d86b3b80bd6a2b29e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be51672fa494c499ed13fdcfa2a9b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3033189-8093-4aca-9639-c77b67b50e31 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Request method failure captured: Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNfXEXxOWNqQR0Xx89YVJ2_kE9CEMtgzHjUfCfYQ1aAj23hMfBgU-htz9CkZaxON7iL3P-9nHZs9CfT211B2QDm27Ep06KIRSyeolFTv_9m3aikkSkreag8qlBEnz5CAbZfllMr_JimhruMuL8Ti2WpcmMRmac72vdYV83OqrjZnvo Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:38.046187 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8be51672fa494c499ed13fdcfa2a9b98", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}] Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8fd99211934b4d86b3b80bd6a2b29e92 Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:49:38.047444 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:38.048251 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 20:49:38.049279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.050252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3033189-8093-4aca-9639-c77b67b50e31 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.050252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a3033189-8093-4aca-9639-c77b67b50e31 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009794 Aug 27 20:49:38.059920 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 70/115] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:49:38.063756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0371c8-3c26-4fa6-aab6-8fd34a8430ec tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Calling method '.version_select at 0x7ff854080670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.067583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e0371c8-3c26-4fa6-aab6-8fd34a8430ec tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8fd99211934b4d86b3b80bd6a2b29e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be51672fa494c499ed13fdcfa2a9b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0371c8-3c26-4fa6-aab6-8fd34a8430ec tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Request method failure captured: Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNfXEXxOWNqQR0Xx89YVJ2_kE9CEMtgzHjUfCfYQ1aAj23hMfBgU-htz9CkZaxON7iL3P-9nHZs9CfT211B2QDm27Ep06KIRSyeolFTv_9m3aikkSkreag8qlBEnz5CAbZfllMr_JimhruMuL8Ti2WpcmMRmac72vdYV83OqrjZnvo Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:38.070036 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8be51672fa494c499ed13fdcfa2a9b98", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}] Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8fd99211934b4d86b3b80bd6a2b29e92 Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: action_args: {} Aug 27 20:49:38.071166 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:38.072024 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 20:49:38.073169 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.075641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0371c8-3c26-4fa6-aab6-8fd34a8430ec tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.076773 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e0371c8-3c26-4fa6-aab6-8fd34a8430ec tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020624 Aug 27 20:49:38.077971 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 46/116] 10.222.0.40 () {58 vars in 1179 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:49:38.267710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Calling method '.version_select at 0x7ff84fde3c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.271094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.272111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.272764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.292033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.292818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.293491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.310472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.311374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.312057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.322022 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7358d123-23e8-4dff-bbc2-b96bc46ce6f6 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.235840 Aug 27 20:49:38.323396 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 71/117] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:38.337872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb4718c0-9a52-46f1-9cd8-cf8af1fea8cc tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Calling method '.version_select at 0x7ff854039ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.340002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb4718c0-9a52-46f1-9cd8-cf8af1fea8cc tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8fd99211934b4d86b3b80bd6a2b29e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be51672fa494c499ed13fdcfa2a9b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb4718c0-9a52-46f1-9cd8-cf8af1fea8cc tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Request method failure captured: Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNfXEXxOWNqQR0Xx89YVJ2_kE9CEMtgzHjUfCfYQ1aAj23hMfBgU-htz9CkZaxON7iL3P-9nHZs9CfT211B2QDm27Ep06KIRSyeolFTv_9m3aikkSkreag8qlBEnz5CAbZfllMr_JimhruMuL8Ti2WpcmMRmac72vdYV83OqrjZnvo Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:38.341964 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8be51672fa494c499ed13fdcfa2a9b98", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}] Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8fd99211934b4d86b3b80bd6a2b29e92 Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1'} Aug 27 20:49:38.343101 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:38.343797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 20:49:38.344761 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.345650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb4718c0-9a52-46f1-9cd8-cf8af1fea8cc tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.345650 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb4718c0-9a52-46f1-9cd8-cf8af1fea8cc tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013170 Aug 27 20:49:38.345650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 47/118] 10.222.0.40 () {58 vars in 1173 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:38.357037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-35b11003-1fd1-4f6f-8116-b31ca9c3b9f9 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Calling method '.version_select at 0x7ff84ff1fa60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.358974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-35b11003-1fd1-4f6f-8116-b31ca9c3b9f9 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] HTTP exception thrown: Hypervisor with ID 'e86319a7-1124-4f72-b610-323f631384d7' could not be found. Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-35b11003-1fd1-4f6f-8116-b31ca9c3b9f9 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Request method failure captured: Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hypervisors/e86319a7-1124-4f72-b610-323f631384d7/uptime HTTP/1.1 Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNh6RIldAfVBR7V9P4qyr5eEd0VESSmJewHQF_FIE9SHO0cARVglq7fmGYM9hF8frtkcGxwlqHZSMHXdBAa3cT23iB_P0F0zaPeuumH91qYJ1UuBrvmBL_TMbTA9g9hlroSnUp9MhiHVCWNPiSGcQOJDPOrtKWCLH8LT89VhDU18Mo Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f4c3add4b1f84f74bbb08ff2557857cc Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:49:38.376012 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4c3add4b1f84f74bbb08ff2557857cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4c3add4b1f84f74bbb08ff2557857cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4c3add4b1f84f74bbb08ff2557857cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4c3add4b1f84f74bbb08ff2557857cc"}]}] Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f4c3add4b1f84f74bbb08ff2557857cc Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d672a884d6cc4a1f8d3834efc66904f5 Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: exception: Hypervisor with ID 'e86319a7-1124-4f72-b610-323f631384d7' could not be found. Aug 27 20:49:38.377542 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'e86319a7-1124-4f72-b610-323f631384d7'} Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e86319a7-1124-4f72-b610-323f631384d7' Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 20:49:38.378340 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e86319a7-1124-4f72-b610-323f631384d7' could not be found. Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.380457 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e86319a7-1124-4f72-b610-323f631384d7' could not be found. Aug 27 20:49:38.383082 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.386188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-35b11003-1fd1-4f6f-8116-b31ca9c3b9f9 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Returning 404 to user: Hypervisor with ID 'e86319a7-1124-4f72-b610-323f631384d7' could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.387478 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-35b11003-1fd1-4f6f-8116-b31ca9c3b9f9 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/e86319a7-1124-4f72-b610-323f631384d7/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035984 Aug 27 20:49:38.395272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 72/119] 10.222.0.40 () {58 vars in 1278 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors/e86319a7-1124-4f72-b610-323f631384d7/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:38.405078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Calling method '.version_select at 0x7ff854080af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.407261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.407723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.408171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.413173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=67 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:38.433065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.433863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.434049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.448193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.448917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.449544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.457754 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7886a574-bfb0-4563-b4b3-f940791bd4f8 tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063697 Aug 27 20:49:38.459037 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 48/120] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:38.470175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa32675f-c780-4371-be92-c66cc8a4d707 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Calling method '.version_select at 0x7ff84fde4700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.472073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa32675f-c780-4371-be92-c66cc8a4d707 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8fd99211934b4d86b3b80bd6a2b29e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be51672fa494c499ed13fdcfa2a9b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa32675f-c780-4371-be92-c66cc8a4d707 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Request method failure captured: Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNfXEXxOWNqQR0Xx89YVJ2_kE9CEMtgzHjUfCfYQ1aAj23hMfBgU-htz9CkZaxON7iL3P-9nHZs9CfT211B2QDm27Ep06KIRSyeolFTv_9m3aikkSkreag8qlBEnz5CAbZfllMr_JimhruMuL8Ti2WpcmMRmac72vdYV83OqrjZnvo Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:38.473714 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8be51672fa494c499ed13fdcfa2a9b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8be51672fa494c499ed13fdcfa2a9b98", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8be51672fa494c499ed13fdcfa2a9b98"}]}] Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8be51672fa494c499ed13fdcfa2a9b98 Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040 Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8fd99211934b4d86b3b80bd6a2b29e92 Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1228679040-project Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1'} Aug 27 20:49:38.475060 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:38.475928 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 20:49:38.476887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.477861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa32675f-c780-4371-be92-c66cc8a4d707 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.477861 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa32675f-c780-4371-be92-c66cc8a4d707 tempest-HypervisorAdminNegativeTestJSON-1228679040 tempest-HypervisorAdminNegativeTestJSON-1228679040-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009153 Aug 27 20:49:38.485640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01080dd4-e133-40ee-8876-4929003203eb tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Calling method '.version_select at 0x7ff854080550>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.487242 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-01080dd4-e133-40ee-8876-4929003203eb tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] HTTP exception thrown: Hypervisor with ID '6abc32f0-daba-4b94-bfb6-58c3281bdb81' could not be found. Aug 27 20:49:38.487681 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 73/121] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01080dd4-e133-40ee-8876-4929003203eb tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Request method failure captured: Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/6abc32f0-daba-4b94-bfb6-58c3281bdb81 HTTP/1.1 Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNh6RIldAfVBR7V9P4qyr5eEd0VESSmJewHQF_FIE9SHO0cARVglq7fmGYM9hF8frtkcGxwlqHZSMHXdBAa3cT23iB_P0F0zaPeuumH91qYJ1UuBrvmBL_TMbTA9g9hlroSnUp9MhiHVCWNPiSGcQOJDPOrtKWCLH8LT89VhDU18Mo Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f4c3add4b1f84f74bbb08ff2557857cc Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:49:38.490833 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4c3add4b1f84f74bbb08ff2557857cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4c3add4b1f84f74bbb08ff2557857cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4c3add4b1f84f74bbb08ff2557857cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4c3add4b1f84f74bbb08ff2557857cc"}]}] Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f4c3add4b1f84f74bbb08ff2557857cc Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008 Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: d672a884d6cc4a1f8d3834efc66904f5 Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: exception: Hypervisor with ID '6abc32f0-daba-4b94-bfb6-58c3281bdb81' could not be found. Aug 27 20:49:38.492340 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '6abc32f0-daba-4b94-bfb6-58c3281bdb81'} Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6abc32f0-daba-4b94-bfb6-58c3281bdb81' Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 20:49:38.493222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:38.494382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6abc32f0-daba-4b94-bfb6-58c3281bdb81' could not be found. Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6abc32f0-daba-4b94-bfb6-58c3281bdb81' could not be found. Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01080dd4-e133-40ee-8876-4929003203eb tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] Returning 404 to user: Hypervisor with ID '6abc32f0-daba-4b94-bfb6-58c3281bdb81' could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:38.496119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-01080dd4-e133-40ee-8876-4929003203eb tempest-HypervisorAdminNegativeTestJSON-1107299008 tempest-HypervisorAdminNegativeTestJSON-1107299008-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/6abc32f0-daba-4b94-bfb6-58c3281bdb81" status: 404 len: 123 microversion: 2.1 time: 0.010480 Aug 27 20:49:38.499828 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 49/122] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/os-hypervisors/6abc32f0-daba-4b94-bfb6-58c3281bdb81 => generated 123 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:38.514610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.516490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:38.542040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.544024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.545054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.545840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.546311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.546743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.650901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.650901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:38.664114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.664835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.666355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.667377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.668048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.668666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.777983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:38.794222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b5f3efa-ac48-4b4b-bdbd-9260b306add8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1239 microversion: 2.1 time: 0.291551 Aug 27 20:49:38.795419 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 74/123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1239 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:38.822266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:38.823127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:38.833641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.835312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.835777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:38.836597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:38.837051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:38.837535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:39.029171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:39.038276 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b83bd15-3ca1-43dd-ad54-4a43c7842eb4 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.398020 Aug 27 20:49:39.042016 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 50/124] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:39.061845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:39.084124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca04b48d-365d-438b-861c-fd7a10552bc8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.262894 Aug 27 20:49:39.085175 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 75/125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:38 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:39.817829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:39.818498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:39.831527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:39.832062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:39.832545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:39.836517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:39.838886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:39.840558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.040827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:40.041269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Action: 'update', calling method: .version_select at 0x7ff854080b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:40.050200 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fda1ab33-c0e0-40ac-aedc-be9e1ac9cf4d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1305 microversion: 2.1 time: 0.237231 Aug 27 20:49:40.066064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 76/126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:39 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1305 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:40.086945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:40.089200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:40.106217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.108661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.109840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.111387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.114184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.115422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.164082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.164573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.168807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.169007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.176045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.176795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.371947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b56a5d0c-def7-4029-9e9c-cabb39c32b06 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47" status: 200 len: 148 microversion: 2.57 time: 0.899836 Aug 27 20:49:40.372611 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 51/127] 10.222.0.40 () {62 vars in 1303 bytes} [Sat Aug 27 20:49:39 2022] PUT /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47 => generated 148 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:40.391979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:40.392653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:40.403064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.410157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.413696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.416217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:40.421270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:40.421783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:40.655031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:40.677380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a14e212-c8b3-4beb-a7fb-8d6588dd92e5 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.299353 Aug 27 20:49:40.700656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:40.709904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 52/128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:40 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:40.717814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Calling method '.version_select at 0x7ff854271af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:40.763506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d918bbcc-cfea-494f-8264-b0b12943fb20 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.698111 Aug 27 20:49:40.787275 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 77/129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:40 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:41.078652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:41.079508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:41.090422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.092302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.092731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.093458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.093911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.094329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.256427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:41.258670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.260104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.260788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.261811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.262564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.263220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.277228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7cb5f99b-df87-4147-9983-a6267f00319d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1293 microversion: 2.1 time: 0.201654 Aug 27 20:49:41.279278 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 78/130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:41 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:41.298252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f96d7bf3-3361-4a12-95ea-505eab5cb434 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47/detail" status: 200 len: 463 microversion: 2.57 time: 0.586664 Aug 27 20:49:41.304615 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 53/131] 10.222.0.40 () {60 vars in 1304 bytes} [Sat Aug 27 20:49:40 2022] GET /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47/detail => generated 463 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:41.742596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:41.748016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:41.756925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.757692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.758276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.759119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.759724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.760283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.790268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:41.790979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:41.806570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.807232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.807949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.817717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:41.818785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:41.819401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:41.971997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:41.986184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f04787ba-f137-4c89-a4e6-22c57e510ad1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.253924 Aug 27 20:49:41.986926 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 79/132] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:41 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:42.273978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fe34ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:42.660079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:42.672254 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ab704c5-4ac8-432c-8ee2-091c8ba76592 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.887139 Aug 27 20:49:42.697851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 54/133] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:41 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:42.710563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:42.711592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:42.734742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.736595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.738561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.743993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.744742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.747788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.772976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.773480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.773916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.775678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.777947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.780106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.892772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.893690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.894275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.895606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:42.900055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:42.900748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:42.955161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:43.056820 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe7ee031-e16b-4995-bdc9-14c03154e002 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47?user_id=9c4f919c4521454d98e2ae3c0ea1af17" status: 200 len: 148 microversion: 2.57 time: 0.785030 Aug 27 20:49:43.058774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 80/134] 10.222.0.40 () {62 vars in 1384 bytes} [Sat Aug 27 20:49:42 2022] PUT /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47?user_id=9c4f919c4521454d98e2ae3c0ea1af17 => generated 148 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:49:43.075533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:43.101721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b3d13db-160e-4ca4-b985-72987b31c348 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.402246 Aug 27 20:49:43.123615 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 55/135] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:42 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:43.136696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:43.138177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:43.145874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.146369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.146803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.150432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.150897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.153666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.342259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:43.356759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f610032f-9bce-4ec9-96ff-717d5f01da27 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.231298 Aug 27 20:49:43.357596 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 56/136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:43 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:43.369808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-295403c9-b361-45f6-8ee1-2648618b2ca1 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] Calling method '.version_select at 0x7ff854039f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:43.442502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Calling method '.version_select at 0x7ff84fde4d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:43.447107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.447633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.448072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.485994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.486497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.486937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.538739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.539245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.539722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.568580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.571986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.573537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.611877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.612381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.612832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.620410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9745c60e-1fc4-4c94-a411-b2c331512128 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.560344 Aug 27 20:49:43.621316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 81/137] 10.222.0.40 () {60 vars in 1243 bytes} [Sat Aug 27 20:49:43 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:49:43.639269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272b2dad-d15e-4482-a9aa-23ee074f95b6", "tag": "76a3278b-aa64-4f20-a838-ccc4fd0437e4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:43.657330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.658073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.658820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.683020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] Creating event network-changed:76a3278b-aa64-4f20-a838-ccc4fd0437e4 for instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 on nch1-master-1 Aug 27 20:49:43.693789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2a1fb450-8a08-49cc-a2a6-8ab33f987492 req-cbb9e86f-50b6-4a6d-b5b1-7a0b4a1fb77e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070058 Aug 27 20:49:43.698838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 82/138] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:43.713002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Calling method '.version_select at 0x7ff84feda700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:43.724037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.726293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.726752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.780589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-295403c9-b361-45f6-8ee1-2648618b2ca1 tempest-QuotasAdminTestV257-2006721671 tempest-QuotasAdminTestV257-2006721671-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47?user_id=9c4f919c4521454d98e2ae3c0ea1af17" status: 200 len: 190 microversion: 2.57 time: 0.417727 Aug 27 20:49:43.782766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.783261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.791715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.792510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 57/139] 10.222.0.40 () {60 vars in 1364 bytes} [Sat Aug 27 20:49:43 2022] GET /compute/v2.1/os-quota-sets/0e8e060e66b14f7eb5d18d62d3ccda47?user_id=9c4f919c4521454d98e2ae3c0ea1af17 => generated 190 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:43.797626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:43.798710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:43.807018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.807910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.808542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.809474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.810247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.810882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.872378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.872871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.873307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.912068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:43.913666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:43.917329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:43.979119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:43.991019 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a6f7720-6a1d-4a2a-b394-18c327c8784e tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.197129 Aug 27 20:49:43.992433 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 58/140] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:43 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:44.015996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.018605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.019079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.036945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64989823-1cf8-41f2-8abd-15c9cd644af0 tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.336406 Aug 27 20:49:44.037997 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 83/141] 10.222.0.40 () {60 vars in 1222 bytes} [Sat Aug 27 20:49:43 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:44.055703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Calling method '.version_select at 0x7ff84fde4430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:44.065046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.065918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.068737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.113776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000ccbb0-4cae-4f2d-9e8c-a25d079e37f9", "name": "network-vif-plugged", "status": "completed", "tag": "1e17d780-355d-41f9-b233-eee460f08d01"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:44.116449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.118694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.120022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.141328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-030be5c5-cf0e-48e3-ac86-7594fe977ecb tempest-HypervisorAdminV253TestBase-1965833270 tempest-HypervisorAdminV253TestBase-1965833270-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/c7979e24-437a-4d07-b5d4-35a015bf73bc" status: 200 len: 792 microversion: 2.53 time: 0.093754 Aug 27 20:49:44.149910 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 84/142] 10.222.0.40 () {60 vars in 1298 bytes} [Sat Aug 27 20:49:44 2022] GET /compute/v2.1/os-hypervisors/c7979e24-437a-4d07-b5d4-35a015bf73bc => generated 792 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:49:44.152449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.152668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.153268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.166543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:44.167408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:44.183204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.183744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.184183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.187845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] Creating event network-vif-plugged:1e17d780-355d-41f9-b233-eee460f08d01 for instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 on nch1-master-1 Aug 27 20:49:44.190241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.190773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.191714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.203889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6ce7b1fd-75b0-40e7-9a11-37a8894a425e req-9d507856-8039-4f09-9eb4-e12d7abadc9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209032 Aug 27 20:49:44.203889 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 59/143] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:44.206244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:44.380516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:44.381230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:44.387596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.388101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.399964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.404433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:44.404704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:44.405248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:44.525412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:44.531178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:44.539730 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-367c6d97-b3dc-419f-9965-dc9647e93f9b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.163936 Aug 27 20:49:44.549950 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-321486de-c832-4e9c-b4b6-2713418f64d7 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.393651 Aug 27 20:49:44.549950 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 85/144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:44 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:44.560008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 60/145] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:44 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:45.012949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:45.014162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:45.030540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.035402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.036702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.038228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.040270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.041040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.369106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:45.388098 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-474a8b7d-6323-472d-a14b-9f92460f6c63 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.379642 Aug 27 20:49:45.395410 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 86/146] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:45 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:45.575878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:45.576682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:45.579800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:45.582627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:45.587511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.588182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.588633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.589358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.592921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.593538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.598667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.599420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.599970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.603517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:45.604006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:45.604438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:45.779033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:45.792196 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1d694f7-e557-438d-87cf-e420565e6a5f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.218463 Aug 27 20:49:45.794342 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 87/147] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:45 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:46.187445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:46.201656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ed1f6e0-70f7-4f15-b081-29351361bab5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.631239 Aug 27 20:49:46.203218 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 61/148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:45 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:46.410233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:46.412519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:46.453920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:46.460082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:46.471724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:46.473971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:46.480157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:46.480718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:46.823052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:46.825123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:46.843473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:46.845290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:46.849048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:46.850348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:46.851045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:46.851806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:46.996267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:47.022398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70592433-2c1f-4a40-870d-f362d3edbdd1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1319 microversion: 2.1 time: 0.210110 Aug 27 20:49:47.024260 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 62/149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:46 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:47.070182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:47.079773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95bbbf16-74fa-4e83-ab01-4dfc72ac3715 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.674087 Aug 27 20:49:47.084152 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 88/150] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:46 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:47.224653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:47.225258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:47.241304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:47.241804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:47.242305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:47.246181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:47.250227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:47.250869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:47.332102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d02ae8d-0293-457f-a4d5-517d04b93c7e tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Calling method '.version_select at 0x7ff854039dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:47.451457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d02ae8d-0293-457f-a4d5-517d04b93c7e tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 371 microversion: 2.1 time: 0.419691 Aug 27 20:49:47.452123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 63/151] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 20:49:47 2022] GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:47.465915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ffd6ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:47.544521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:47.553601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:47.554257 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d8ee0811-477f-4981-b68a-04230cad389f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.333451 Aug 27 20:49:47.554606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:47.555364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:47.556326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:47.560120 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 89/152] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:47 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:47.561159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:47.561876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:47.654235 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c934892-8ca5-4a12-967a-698061885703 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 328 microversion: 2.1 time: 0.192533 Aug 27 20:49:47.655430 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 64/153] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:47 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:47.905235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1158670092", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:48.014273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:48.049923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:48.050647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:48.074588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.075137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.078961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.083585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.084334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.086387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.728682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:48.744211 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02cc811d-e7f3-41a2-86b6-37b0d46dd2b7 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.701450 Aug 27 20:49:48.745668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 65/154] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:48 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:48.766385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:48.769141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:48.797431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.803431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.810509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.811627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.812191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.812705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.916133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:48.916712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:48.917005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:48.917415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:48.917950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:48.942772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.943279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.943756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.944513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:48.944966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:48.945407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:48.997342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:49.006573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for user 14a2d6a7135a4ae08b53ea07817bf105 and project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:49.038168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.utils [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] cores quota exceeded for 6af86632babd4587b7bda2cf9a26bb08, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140434) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 20:49:49.039013 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Request method failure captured: Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 145 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNp0Kk5xYXtIOfIGBJybZjyIWVTtR6i3gw4Nl8aFkjcEeUGs270aVMs-nDRaclACGmDzYfR0egAreQyHhF1rO8Lg9LH20qPU4wdpWlk1eDru70wJRa7vSzoHO9wCsUb1eOIxlp_Jkql1c6xHwsO-yKy0UaXcRIVrsJs67EqalUBZHg Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:49.053435 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6af86632babd4587b7bda2cf9a26bb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}] Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 14a2d6a7135a4ae08b53ea07817bf105 Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1158670092", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} Aug 27 20:49:49.054834 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1158670092', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452'}}} Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 20:49:49.055537 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:49.056555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.057604 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:49.058671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8272bc77-0647-4b4f-a754-cd06e503667e tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.243582 Aug 27 20:49:49.060761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 90/155] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:47 2022] POST /compute/v2.1/servers => generated 111 bytes in 1250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:49.076980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:49.077428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:49.085786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:49.086302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:49.086743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:49.092003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:49.092596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:49.093049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:49.381363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:49.399879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2639a07-7d80-4c6c-8f3f-fd3f46f13912 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1339 microversion: 2.1 time: 0.645635 Aug 27 20:49:49.400172 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 66/156] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:48 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1339 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:49.420321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ff08c10>, body: {"quota_set": {"cores": 20}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:49.624415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:49.633523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9949159d-5378-4ddb-af27-ce13abbc62bd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.571589 Aug 27 20:49:49.643945 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 91/157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:49 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:49.766448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:49.767066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:49.778705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:49.779753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:49.780189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:49.780969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:49.781427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:49.781851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.117868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:50.129792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-40518317-b55e-4a19-884e-5f76e0265795 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.367129 Aug 27 20:49:50.133044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 92/158] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:49 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:50.154559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.154559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.154559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.154861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.155213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.162923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.200023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:50.247604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46504f90-7410-4ef1-9aaa-4ad1c1f7e6b4 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 329 microversion: 2.1 time: 0.839509 Aug 27 20:49:50.248919 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 67/159] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:49 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 329 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:50.261096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-154b5c3c-222b-4111-a2aa-f7e1a46d5b6b tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Calling method '.version_select at 0x7ff8548bd700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:50.275949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:50.316403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.319942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.322978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.365391 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] Creating event network-changed:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:49:50.377170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4f2ad5cb-ba50-4f04-9513-f25f3b584698 req-5a97ad4a-66af-452c-b4a5-3a901276956e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112241 Aug 27 20:49:50.382103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 68/160] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:50.422746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:50.423449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:50.435747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.437918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.438866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.443597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.444294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.444879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.718403 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-154b5c3c-222b-4111-a2aa-f7e1a46d5b6b tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 371 microversion: 2.1 time: 0.460995 Aug 27 20:49:50.728360 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 93/161] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 20:49:50 2022] GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:50.746041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:50.746674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:50.762357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.764199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.765478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:50.766233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:50.768507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:50.771201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:51.327801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:51.339598 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-307c7bb8-4823-4967-bd60-ea9a5b4fa409 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1489 microversion: 2.1 time: 0.921190 Aug 27 20:49:51.351729 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 69/162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:50 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1489 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:51.351729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ffd68b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:51.540648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:51.554331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c90e74b-cd43-47e3-abc7-0ae22f897210 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.819068 Aug 27 20:49:51.558442 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 94/163] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:50 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:51.828075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:51.829277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:51.829867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:51.830948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:51.831881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:51.832527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:51.905481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cea8157-78ac-4d07-b1ad-854a77b0f394 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 328 microversion: 2.1 time: 0.562578 Aug 27 20:49:51.907124 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 70/164] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:51 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:51.917923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:51.918556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:51.933788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:51.934498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:51.935254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:51.936145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:51.937308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:51.938299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.004965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696e2116-4af3-4fa5-8e68-37bdf89f1a7f", "tag": "353ee501-5b6c-4545-aa2c-f5c566028c7e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:52.028512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:52.029364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:52.029980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.042740 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] Creating event network-changed:353ee501-5b6c-4545-aa2c-f5c566028c7e for instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f on nch2-master-1 Aug 27 20:49:52.050144 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a95fb051-93bb-444f-a6f8-4be4606ccdaa req-d3f4e60e-249d-4751-8652-57577047f443 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485705 Aug 27 20:49:52.050743 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 95/165] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:52.068692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:52.069729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:52.107294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:52.108166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:52.108762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.111001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:52.113297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:52.114160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.299060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:52.318916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8f19cad-e663-4e58-af2d-87a0fbb3b449 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.410418 Aug 27 20:49:52.320333 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 71/166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:51 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:52.340896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b2dad-d15e-4482-a9aa-23ee074f95b6", "name": "network-vif-plugged", "status": "completed", "tag": "76a3278b-aa64-4f20-a838-ccc4fd0437e4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:52.376224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:52.380057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:52.380639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.427305 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] Creating event network-vif-plugged:76a3278b-aa64-4f20-a838-ccc4fd0437e4 for instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 on nch1-master-1 Aug 27 20:49:52.442055 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a3d9230f-d0c6-45f9-981c-ca54cf963ff4 req-8ec0c69c-30bb-46d4-a433-856e2646dafa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116499 Aug 27 20:49:52.442892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 72/167] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:52.458336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1919548558", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:52.563390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:52.925740 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-caa2534f-5b1e-4daa-b956-6c98e7d2a4a2 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1640 microversion: 2.1 time: 0.871662 Aug 27 20:49:52.929330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 96/168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:52 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1640 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:52.972268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:52.972896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:52.973408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:52.974334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:52.974776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:52.994007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:52.994414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:52.994845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:52.998697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.000947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.001589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.014183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:53.053186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:53.059496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for user 14a2d6a7135a4ae08b53ea07817bf105 and project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:53.073947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.utils [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] instances quota exceeded for 6af86632babd4587b7bda2cf9a26bb08, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140433) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 20:49:53.075148 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Request method failure captured: Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 145 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNp0Kk5xYXtIOfIGBJybZjyIWVTtR6i3gw4Nl8aFkjcEeUGs270aVMs-nDRaclACGmDzYfR0egAreQyHhF1rO8Lg9LH20qPU4wdpWlk1eDru70wJRa7vSzoHO9wCsUb1eOIxlp_Jkql1c6xHwsO-yKy0UaXcRIVrsJs67EqalUBZHg Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:53.083636 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6af86632babd4587b7bda2cf9a26bb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}] Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 14a2d6a7135a4ae08b53ea07817bf105 Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1919548558", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} Aug 27 20:49:53.085090 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1919548558', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452'}}} Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 20:49:53.085892 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:53.087060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.088425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 20:49:53.089878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:53.096245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:53.097437 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-367480cf-c93e-44a1-938e-0b939379707f tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.653260 Aug 27 20:49:53.098573 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 73/169] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:52 2022] POST /compute/v2.1/servers => generated 119 bytes in 655 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:53.104523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:53.106039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:53.114170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.115113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.115775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.116718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.117703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.118352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.258463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Calling method '.version_select at 0x7ff84fb9e790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:53.261000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.261681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.262127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.283849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.285616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.286266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.301158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.301768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.302763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.313823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b1e03d7-fb54-4ace-aa1b-a3826382c602 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.383047 Aug 27 20:49:53.314551 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 97/170] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:53.326894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:53.328524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:53.345158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.346252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.347489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.349767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.350725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.351745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.406123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:49:53.407011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:53.416310 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b20f329b-0c02-44da-b059-df010de374ee tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.316230 Aug 27 20:49:53.416899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 74/171] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:53 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:53.424210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fdc5c10>, body: {"quota_set": {"instances": 10}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:53.725826 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09922018-6bb6-47e4-922b-8547a8d99dae tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 204 len: 0 microversion: 2.1 time: 0.408795 Aug 27 20:49:53.727191 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 98/172] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:49:53 2022] DELETE /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:49:53.923127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.923705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.924186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:53.925273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:53.925986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:53.926845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.009825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aca79026-3c0c-46e2-a141-617629fb7c61 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 329 microversion: 2.1 time: 0.589210 Aug 27 20:49:54.017777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 75/173] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:53 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 329 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:54.032425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.033259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:54.054210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.055314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.055873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.056775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.057254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.058530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.163292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5545bdd-6385-4795-abea-20f7e353dc76 tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Calling method '.version_select at 0x7ff84fedad30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.165810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f5545bdd-6385-4795-abea-20f7e353dc76 tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2e701210058e47918c036df791bf8c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b74f484a33490db36bcd5b57401be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5545bdd-6385-4795-abea-20f7e353dc76 tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Request method failure captured: Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNuJslygXTTuDUwtSYllsVhvIL-3idtsQAX-tkSRfO2x4JGOcDEM8JKJw5ev5v3kZI3cXOF2wTOb1d36VpjAMg3kcYzM36DBO425m8ppHJsaTcpzkYRwuwtoHhgUkbLj1Z7VLOywbMgA5c5c-fj3uKQngi9KZgfja2e5ItuYvKBlAU Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 79b74f484a33490db36bcd5b57401be8 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:49:54.167913 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79b74f484a33490db36bcd5b57401be8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79b74f484a33490db36bcd5b57401be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79b74f484a33490db36bcd5b57401be8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79b74f484a33490db36bcd5b57401be8"}]}] Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 79b74f484a33490db36bcd5b57401be8 Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-567236844-project Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2e701210058e47918c036df791bf8c42 Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844-project Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 20:49:54.169216 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nch1-master-1'} Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:54.169880 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 20:49:54.170886 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.174549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5545bdd-6385-4795-abea-20f7e353dc76 tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:54.178295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5545bdd-6385-4795-abea-20f7e353dc76 tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.446577 Aug 27 20:49:54.178295 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 99/174] 10.222.0.40 () {58 vars in 1209 bytes} [Sat Aug 27 20:49:53 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 449 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:54.183181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.184287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:54.196604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.197110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.197551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.198279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.198737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.199167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.396950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:54.408564 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1b39134f-eea0-488d-ba27-d64fb497be5c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.389129 Aug 27 20:49:54.409418 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 76/175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:54 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:54.438228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:54.449194 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03d9752b-705b-4981-9255-8088bc6824c0 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1495 microversion: 2.1 time: 0.271623 Aug 27 20:49:54.449784 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 100/176] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:54 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1495 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:54.458622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4623eb24-ef91-4105-961a-535bb4184d30 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Calling method '.version_select at 0x7ff84fb899d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.546104 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4623eb24-ef91-4105-961a-535bb4184d30 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 371 microversion: 2.1 time: 0.092871 Aug 27 20:49:54.546772 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 101/177] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 20:49:54 2022] GET /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:54.552258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Calling method '.version_select at 0x7ff84fd70280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.555257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.556033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.556520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.565328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Request method failure captured: Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNw32iQ211GAtKxxEtzKaSgMzm4j2K2nB_wSAIADENSiM2-mPuhxJkdJ7PfPA5xIHli9_vyWVdQT5C_cO5venkTNbH1z5xXyJhiKZZy2Pj-qdTTbCzNoBl0ulRLOtqnkBe3MgA1lifiTbJq2iqMXyCNPVKJHwWg1GoshdkqNTgw288 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e27c32105f8145d6a470a42f842dd88b Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:49:54.567301 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e27c32105f8145d6a470a42f842dd88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e27c32105f8145d6a470a42f842dd88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e27c32105f8145d6a470a42f842dd88b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e27c32105f8145d6a470a42f842dd88b"}]}] Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e27c32105f8145d6a470a42f842dd88b Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 465cc8e8412c4a308b9ef4c9e0ac0959 Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 20:49:54.568539 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:54.569191 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86a90573-74e5-4444-8867-c757c91e8b04 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.020666 Aug 27 20:49:54.570865 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 102/178] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 20:49:54 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:54.577298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:54.577994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:54.585218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.585720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.586161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.587523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.587987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.588424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.597820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a4457eb-841f-49c0-84c1-3eb331ae69ec tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] Action: 'create', calling method: .version_select at 0x7ff84fddc310>, body: {"security_group": {"name": "tempest-securitygroup-1494966512", "description": "tempest-description-1635448872"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:54.782145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:54.797082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d746a5e-d321-4e1e-a6d8-9efef7fdef6c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1335 microversion: 2.1 time: 0.225454 Aug 27 20:49:54.798999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 103/179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:54 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:54.810143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fbb3700>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:54.922554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.923105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.924042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.924925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:54.925592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:54.926542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:54.994768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:54.998187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c52a7b91-b8cd-4902-930d-50ad2f49569c tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 325 microversion: 2.1 time: 0.197883 Aug 27 20:49:55.002008 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a4457eb-841f-49c0-84c1-3eb331ae69ec tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.591058 Aug 27 20:49:55.003205 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 77/180] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 20:49:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:55.018123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Calling method '.version_select at 0x7ff84fddc3a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:55.022069 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 104/181] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:54 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:55.022537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.023229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.024947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.029827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e66b04d-bc6d-447e-961a-c7ce6bd39e89 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] Action: 'create', calling method: .version_select at 0x7ff84fb899d0>, body: {"security_group": {"name": "tempest-securitygroup-1466012617", "description": "tempest-description-1123108659"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:55.044896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.045400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.045894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.059401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.060351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.060805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.070830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbf3d06b-2ee0-42de-bc66-5a536888e28d tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065657 Aug 27 20:49:55.072005 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 78/182] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:49:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:55.092492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c14c491-f922-4a41-b6b2-08e3ef1942bb tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Calling method '.version_select at 0x7ff84fddc670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:55.097336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c14c491-f922-4a41-b6b2-08e3ef1942bb tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2e701210058e47918c036df791bf8c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b74f484a33490db36bcd5b57401be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c14c491-f922-4a41-b6b2-08e3ef1942bb tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Request method failure captured: Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNuJslygXTTuDUwtSYllsVhvIL-3idtsQAX-tkSRfO2x4JGOcDEM8JKJw5ev5v3kZI3cXOF2wTOb1d36VpjAMg3kcYzM36DBO425m8ppHJsaTcpzkYRwuwtoHhgUkbLj1Z7VLOywbMgA5c5c-fj3uKQngi9KZgfja2e5ItuYvKBlAU Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 79b74f484a33490db36bcd5b57401be8 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:55.100197 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79b74f484a33490db36bcd5b57401be8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/79b74f484a33490db36bcd5b57401be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_79b74f484a33490db36bcd5b57401be8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/79b74f484a33490db36bcd5b57401be8"}]}] Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 79b74f484a33490db36bcd5b57401be8 Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844 Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-567236844-project Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2e701210058e47918c036df791bf8c42 Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-567236844-project Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 20:49:55.101385 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1'} Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:55.102094 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 20:49:55.103155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.104533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c14c491-f922-4a41-b6b2-08e3ef1942bb tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:55.104533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c14c491-f922-4a41-b6b2-08e3ef1942bb tempest-HypervisorAdminNegativeUnderV252Test-567236844 tempest-HypervisorAdminNegativeUnderV252Test-567236844-project] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020996 Aug 27 20:49:55.104533 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 79/183] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:49:55 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:55.115251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Calling method '.version_select at 0x7ff854271af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:55.118122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.118785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.119383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.136172 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] HTTP exception thrown: No hypervisor matching 'd7908a09-027e-4f00-8649-9a8ed7637134' could be found. Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Request method failure captured: Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hypervisors/d7908a09-027e-4f00-8649-9a8ed7637134/servers HTTP/1.1 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNw32iQ211GAtKxxEtzKaSgMzm4j2K2nB_wSAIADENSiM2-mPuhxJkdJ7PfPA5xIHli9_vyWVdQT5C_cO5venkTNbH1z5xXyJhiKZZy2Pj-qdTTbCzNoBl0ulRLOtqnkBe3MgA1lifiTbJq2iqMXyCNPVKJHwWg1GoshdkqNTgw288 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e27c32105f8145d6a470a42f842dd88b Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:49:55.137917 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e27c32105f8145d6a470a42f842dd88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e27c32105f8145d6a470a42f842dd88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e27c32105f8145d6a470a42f842dd88b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e27c32105f8145d6a470a42f842dd88b"}]}] Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e27c32105f8145d6a470a42f842dd88b Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995 Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 465cc8e8412c4a308b9ef4c9e0ac0959 Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: exception: No hypervisor matching 'd7908a09-027e-4f00-8649-9a8ed7637134' could be found. Aug 27 20:49:55.139123 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'd7908a09-027e-4f00-8649-9a8ed7637134'} Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'd7908a09-027e-4f00-8649-9a8ed7637134' could be found. Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.139890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'd7908a09-027e-4f00-8649-9a8ed7637134' could be found. Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] Returning 404 to user: No hypervisor matching 'd7908a09-027e-4f00-8649-9a8ed7637134' could be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-668ff3b1-17b8-45d2-8e4e-2a64fea59649 tempest-HypervisorAdminNegativeUnderV252Test-188729995 tempest-HypervisorAdminNegativeUnderV252Test-188729995-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors/d7908a09-027e-4f00-8649-9a8ed7637134/servers" status: 404 len: 123 microversion: 2.1 time: 0.030419 Aug 27 20:49:55.140883 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 80/184] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 20:49:55 2022] GET /compute/v2.1/os-hypervisors/d7908a09-027e-4f00-8649-9a8ed7637134/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:49:55.182782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1155622993", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:55.255991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:49:55.483099 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e66b04d-bc6d-447e-961a-c7ce6bd39e89 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.458500 Aug 27 20:49:55.484055 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 105/185] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 20:49:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:55.489352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:55.489973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:55.510052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.510476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.519033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.525988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:55.526494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:55.526937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:55.941849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:55.944248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:55.959124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68002991-044e-4b13-a173-5fcc0d01695b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.473791 Aug 27 20:49:55.983908 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 106/186] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:55 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:55.990871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:55.991552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:56.013609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.014300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.014900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.015786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.016418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.016989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.070266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:49:56.071324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:49:56.072031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:49:56.072631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:49:56.073222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:49:56.088868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=73 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:56.096523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.102578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.105174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.106234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.108923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.114306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.134051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=21 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:56.189665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:49:56.214925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Getting quotas for user 14a2d6a7135a4ae08b53ea07817bf105 and project 6af86632babd4587b7bda2cf9a26bb08. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:49:56.232824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.utils [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] ram quota exceeded for 6af86632babd4587b7bda2cf9a26bb08, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140433) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 20:49:56.233785 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Request method failure captured: Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 145 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNp0Kk5xYXtIOfIGBJybZjyIWVTtR6i3gw4Nl8aFkjcEeUGs270aVMs-nDRaclACGmDzYfR0egAreQyHhF1rO8Lg9LH20qPU4wdpWlk1eDru70wJRa7vSzoHO9wCsUb1eOIxlp_Jkql1c6xHwsO-yKy0UaXcRIVrsJs67EqalUBZHg Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:56.236749 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6af86632babd4587b7bda2cf9a26bb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}] Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 14a2d6a7135a4ae08b53ea07817bf105 Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1155622993", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} Aug 27 20:49:56.238374 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1155622993', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452'}}} Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 20:49:56.239205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:56.240725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.242277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 20:49:56.243969 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:56.246872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:56.248046 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a472639c-68d5-4a8e-85a5-d1197d1dd3c5 tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.069762 Aug 27 20:49:56.249136 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 81/187] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:49:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 1071 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:56.437879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:56.449508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6f7ef34d-4473-47af-b7cd-b8d8f705ec9c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1495 microversion: 2.1 time: 0.464263 Aug 27 20:49:56.450772 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 107/188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:55 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1495 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:56.456751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:56.458160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:56.465389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.466318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.466861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.467832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:56.468398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:56.468948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:56.625029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b8b6d78-1cd9-478c-9848-eddf392ed53a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] Action: 'create', calling method: .version_select at 0x7ff84fdec1f0>, body: {"security_group": {"name": "tempest-securitygroup-382142621", "description": "tempest-description-1381277817"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:56.957123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:56.973500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4858fb3-26b3-421b-813d-8927db792f9b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1484 microversion: 2.1 time: 0.521120 Aug 27 20:49:56.974843 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 108/189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:56 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1484 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:56.993431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fafa5e0>, body: {"quota_set": {"ram": 51200}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:57.204967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.213403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.214169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:57.224127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.226989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.228237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:57.355142 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dcc9cac5-1b74-4ca3-9875-2a851fb75ae2 tempest-QuotasAdminNegativeTest-897190700 tempest-QuotasAdminNegativeTest-897190700-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 200 len: 329 microversion: 2.1 time: 0.378787 Aug 27 20:49:57.363917 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 109/190] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:56 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 329 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:57.363917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:57.363917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:57.380179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.380920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.381508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:57.383791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.384425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.385319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:57.899667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:57.923231 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e3b2a360-6c02-4db7-ad2c-efcf41b14299 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.565622 Aug 27 20:49:57.924597 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 110/191] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:57 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:57.931184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:57.932308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:57.944573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.945981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.952605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:57.953518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:57.954043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:57.954513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.012681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b8b6d78-1cd9-478c-9848-eddf392ed53a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.762224 Aug 27 20:49:58.020390 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 82/192] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 20:49:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:58.024085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000ccbb0-4cae-4f2d-9e8c-a25d079e37f9", "name": "network-vif-deleted", "tag": "1e17d780-355d-41f9-b233-eee460f08d01"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:58.048446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.048934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.049368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.078669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] Creating event network-vif-deleted:1e17d780-355d-41f9-b233-eee460f08d01 for instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 on nch1-master-1 Aug 27 20:49:58.090350 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ce21d275-5d3e-48fb-8d88-8fa952e5c385 req-f0f711b6-f78a-46d2-ba16-a1ac67accd6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073941 Aug 27 20:49:58.091275 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 83/193] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:58.111175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7020459f-db75-44d1-81e4-e387aa9889de tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Action: 'update', calling method: .version_select at 0x7ff84fdece50>, body: {"quota_set": {"ram": 0}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:58.119128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7020459f-db75-44d1-81e4-e387aa9889de tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '14a2d6a7135a4ae08b53ea07817bf105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af86632babd4587b7bda2cf9a26bb08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7020459f-db75-44d1-81e4-e387aa9889de tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Request method failure captured: Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 HTTP/1.1 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 25 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNp0Kk5xYXtIOfIGBJybZjyIWVTtR6i3gw4Nl8aFkjcEeUGs270aVMs-nDRaclACGmDzYfR0egAreQyHhF1rO8Lg9LH20qPU4wdpWlk1eDru70wJRa7vSzoHO9wCsUb1eOIxlp_Jkql1c6xHwsO-yKy0UaXcRIVrsJs67EqalUBZHg Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:58.125784 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6af86632babd4587b7bda2cf9a26bb08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6af86632babd4587b7bda2cf9a26bb08", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6af86632babd4587b7bda2cf9a26bb08"}]}] Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 6af86632babd4587b7bda2cf9a26bb08 Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2065075559 Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 14a2d6a7135a4ae08b53ea07817bf105 Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-QuotasAdminNegativeTest-2065075559-project Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: {"quota_set": {"ram": 0}} Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 20:49:58.127630 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '6af86632babd4587b7bda2cf9a26bb08', 'body': {'quota_set': {'ram': 0}}} Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:49:58.132803 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:58.134060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 20:49:58.135326 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:58.140218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7020459f-db75-44d1-81e4-e387aa9889de tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:58.141335 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7020459f-db75-44d1-81e4-e387aa9889de tempest-QuotasAdminNegativeTest-2065075559 tempest-QuotasAdminNegativeTest-2065075559-project] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08" status: 403 len: 116 microversion: 2.1 time: 0.044564 Aug 27 20:49:58.142427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 84/194] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:49:58 2022] PUT /compute/v2.1/os-quota-sets/6af86632babd4587b7bda2cf9a26bb08 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:58.150781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:58.156391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:58.168739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.174518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.175154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.176226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.177146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.177751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.272237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.273414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.275947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.276695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lazy-loading 'fault' on Instance uuid 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:49:58.368312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c41583fc2a824031a57658dabfa561f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1b1163e1504c45a46c7587660a92ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:58.381912 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36ad7ce5-1988-496d-843e-1dfc4eb56819 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 200 len: 1329 microversion: 2.1 time: 0.237567 Aug 27 20:49:58.387502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:58.393744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 85/195] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:58 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 1329 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:58.397860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f9eada4-e151-4d8e-8f44-c763a6a659a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1314 microversion: 2.1 time: 0.471861 Aug 27 20:49:58.398677 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 111/196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:57 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:58.401039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1c89d7b-ca6c-445d-ae03-e16fadf18bf6 tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] Action: 'create', calling method: .version_select at 0x7ff84fdf2dc0>, body: {"security_group": {"name": "tempest-securitygroup-1123670635", "description": "tempest-description-2000966692"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:58.654935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1c89d7b-ca6c-445d-ae03-e16fadf18bf6 tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.258867 Aug 27 20:49:58.655879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 86/197] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 20:49:58 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:49:58.670456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59ff3422-1dd1-4de4-a445-7faa1b5343bb tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] Calling method '.version_select at 0x7ff84fcc49d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:58.746727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696e2116-4af3-4fa5-8e68-37bdf89f1a7f", "name": "network-vif-plugged", "status": "completed", "tag": "353ee501-5b6c-4545-aa2c-f5c566028c7e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:58.772394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.773301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.774664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.808364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] Creating event network-vif-plugged:353ee501-5b6c-4545-aa2c-f5c566028c7e for instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f on nch2-master-1 Aug 27 20:49:58.819762 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c76d9e16-0e6c-46db-8e44-ddb393cbdd2b req-48375cb4-fa22-40ee-8dc4-d7a88f877176 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077796 Aug 27 20:49:58.820385 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 87/198] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:49:58.950397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:58.952668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:58.964819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.965764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.966857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:58.968050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:58.971483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:58.971957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:59.378209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:59.387136 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1fe06504-1227-4c05-88ec-2450a5f816ba tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.446110 Aug 27 20:49:59.387949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 88/199] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:58 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:49:59.408392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:59.409256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:59.429444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:59.430271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:59.430920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:59.431860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:59.432593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:59.433086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:59.449568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] HTTP exception thrown: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Request method failure captured: Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 HTTP/1.1 Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNBb7h27wyHjAbtYm7mksIAIMj7BAUixvHtbGFH3LErvDliacIxU7-pFxMpASL-uiPnaQtmQ9emi6d1WSOLMbmOmOl_MtNxI3f9nkvQ2OB7cFyAKXLXQDxnExD2Ar1x2csR88qF9S9msPls8-18-psSjQZdvYQd0OBbfqtezh684eo Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:49:59.451667 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee1b1163e1504c45a46c7587660a92ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}] Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c41583fc2a824031a57658dabfa561f6 Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:49:59.453091 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '000ccbb0-4cae-4f2d-9e8c-a25d079e37f9'} Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:49:59.453912 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:49:59.455197 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:49:59.457688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Returning 404 to user: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:49:59.457688 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6e97eca-e893-409d-8872-5bf889f4d89c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 404 len: 111 microversion: 2.1 time: 0.052531 Aug 27 20:49:59.457688 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 89/200] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:59 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:49:59.462632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:49:59.463552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:49:59.472705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:59.473301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:59.473871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:59.475286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:59.476055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:59.477405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:49:59.822822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:49:59.839453 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-43a5db94-4321-4b1d-9200-bab542fcfe83 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1314 microversion: 2.1 time: 0.381376 Aug 27 20:49:59.840758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 90/201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:49:59 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:49:59.850485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96e3f074-dee1-4fc0-9fcf-0bdfd451baef tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:49:59.876553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96e3f074-dee1-4fc0-9fcf-0bdfd451baef tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:49:59.877057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96e3f074-dee1-4fc0-9fcf-0bdfd451baef tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:49:59.881236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96e3f074-dee1-4fc0-9fcf-0bdfd451baef tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:00.026828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:00.058344 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96e3f074-dee1-4fc0-9fcf-0bdfd451baef tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.216044 Aug 27 20:50:00.058963 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 91/202] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:49:59 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:00.071282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97674d56-c1a4-418b-a08c-5a30752b96ad tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:00.146501 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97674d56-c1a4-418b-a08c-5a30752b96ad tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.079628 Aug 27 20:50:00.148718 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 92/203] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:00 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 20:50:00.161728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0358311-2073-4ce2-8aa2-dd17a612b98a tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-299011225"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:00.166737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-a0358311-2073-4ce2-8aa2-dd17a612b98a tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid 482cdeac-32b9-49fb-9d46-2008b04e64e1 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:00.197784 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0358311-2073-4ce2-8aa2-dd17a612b98a tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041195 Aug 27 20:50:00.207400 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 93/204] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:00.213436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32113763-8fbc-41dc-b1fa-f9bba40473b4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:00.229429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32113763-8fbc-41dc-b1fa-f9bba40473b4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:00.230565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32113763-8fbc-41dc-b1fa-f9bba40473b4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:00.232724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32113763-8fbc-41dc-b1fa-f9bba40473b4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:00.460863 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32113763-8fbc-41dc-b1fa-f9bba40473b4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.251181 Aug 27 20:50:00.461787 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 94/205] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:00.472051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:00.472977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:00.483131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:00.485973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:00.487896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:00.492321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:00.492979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:00.493579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:00.856809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:00.867790 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11fe1060-8a24-4d4c-a683-2a54a71f6b14 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1386 microversion: 2.1 time: 0.404901 Aug 27 20:50:00.874194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 95/206] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:00 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1386 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:00.881675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a478870-0d4f-4298-b5a1-7c70c37cb277 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:00.903254 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a478870-0d4f-4298-b5a1-7c70c37cb277 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.025490 Aug 27 20:50:00.904059 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 96/207] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:50:00 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:01.269714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-587190853", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "50ac8041-95db-40cf-b7b5-1165467e4b65"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:01.362772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] validate_networks() for [('50ac8041-95db-40cf-b7b5-1165467e4b65', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:01.505017 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59ff3422-1dd1-4de4-a445-7faa1b5343bb tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9685 microversion: 2.1 time: 2.838575 Aug 27 20:50:01.519985 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 112/208] 10.222.0.40 () {58 vars in 1191 bytes} [Sat Aug 27 20:49:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9685 bytes in 2841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:01.519985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:01.519985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:01.522578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:01.523642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:01.524089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:01.524798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:01.525254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:01.525676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:01.787211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:01.797060 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5aeb8771-0938-4da7-98d0-1895bc7b7c47 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1314 microversion: 2.1 time: 0.290064 Aug 27 20:50:01.798066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 113/209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:01 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:01.803032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "name": "network-vif-plugged", "status": "completed", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:01.812808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:01.813423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:01.813957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:01.825901 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] Creating event network-vif-plugged:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:50:01.832564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-5d465409-fc13-44ed-989d-440ee8408d9c req-1ccb24e0-238d-41f5-a222-2124937e4771 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 Aug 27 20:50:01.833644 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 114/210] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:01.839968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b63cac77-9bf4-4130-9e4e-fe8d427235cb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:01.870596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b63cac77-9bf4-4130-9e4e-fe8d427235cb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:01.871231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b63cac77-9bf4-4130-9e4e-fe8d427235cb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:01.872338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b63cac77-9bf4-4130-9e4e-fe8d427235cb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:02.423116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:02.423901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:02.424393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:02.424807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:02.425224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:02.441481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:02.443479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:02.444439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:02.446285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:02.446935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:02.447581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:02.488867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:02.498994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for user c75d7c2bf734450886113fe48be6c44e and project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:02.514263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:02.516874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:02.652756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b711eb5-c723-4038-ad9a-58b76d288822 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.747370 Aug 27 20:50:02.654144 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 97/211] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:50:02.668562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1de91d49-82fe-4a51-b762-c27c42c0cb68 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] Calling method '.version_select at 0x7ff84fdec9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:02.687672 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b63cac77-9bf4-4130-9e4e-fe8d427235cb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.852179 Aug 27 20:50:02.690456 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 115/212] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:02.701086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:02.704625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:02.725741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:02.726347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:02.727594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:02.729797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:02.731396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:02.732040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:03.061086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:03.074754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-45480742-9545-4d5a-9e9f-c5f8431bad7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1585 microversion: 2.1 time: 0.382109 Aug 27 20:50:03.076758 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 116/213] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:02 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1585 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:03.085873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:03.086465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:03.093686 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1de91d49-82fe-4a51-b762-c27c42c0cb68 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.437705 Aug 27 20:50:03.094471 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 98/214] 10.222.0.40 () {58 vars in 1191 bytes} [Sat Aug 27 20:50:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:03.100009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68de1964-e7e3-4ed0-b684-403b847ffeab tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:03.129065 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68de1964-e7e3-4ed0-b684-403b847ffeab tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032972 Aug 27 20:50:03.130961 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 99/215] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:03 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:03.142835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:03.143481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:03.182245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:03.182805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:03.183292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:03.184152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:03.184856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:03.185558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:03.204473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:03.212510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=47 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:03.226701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:03.228537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:03.230020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e79f103-511d-40ac-967b-ba554d399b24 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1261 microversion: 2.25 time: 0.152305 Aug 27 20:50:03.230588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 117/216] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:03 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:03.237094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:03.242726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:03.249972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:03.250732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:03.251431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:03.252328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:03.252932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:03.253512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:03.373272 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66b93f87-3d1f-461e-8aed-d640ecc989cf tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141240 Aug 27 20:50:03.374035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 118/217] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:50:03 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:03.379181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b62bf4e2-c402-4b21-a259-99ae66fa453a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] Calling method '.version_select at 0x7ff84fb461f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:03.579063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:03.589729 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5bf780f4-1b26-4218-b182-7d5072d02349 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1314 microversion: 2.1 time: 0.457321 Aug 27 20:50:03.590683 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 100/218] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:03 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:03.610989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40682fba-f409-47c2-bc83-8913f39f1438 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122110518"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:03.615123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-40682fba-f409-47c2-bc83-8913f39f1438 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid a3dd2a39-3537-41a1-8c22-7db108cbd696 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:03.665747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40682fba-f409-47c2-bc83-8913f39f1438 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073431 Aug 27 20:50:03.669935 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 101/219] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:03.786683 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b62bf4e2-c402-4b21-a259-99ae66fa453a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a54dd23b-51d2-475f-8cb4-2444badb3bfe" status: 202 len: 0 microversion: 2.1 time: 0.411229 Aug 27 20:50:03.787588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 119/220] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:50:03 2022] DELETE /compute/v2.1/os-security-groups/a54dd23b-51d2-475f-8cb4-2444badb3bfe => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:04.072136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fbb3160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.076461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.078799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.079237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.102652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:04.114066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.117302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.117769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.125574 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] HTTP exception thrown: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Request method failure captured: Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd HTTP/1.1 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 56 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoN7FUeUpVrd1KUdWsRbQyABmV6PPd5dJU_oeoJDLZkCoWiePdTsMnUA25RjtPBS0wyKd0s5zEl-gGUcSKd6TJDtpKTJNAvCJZ7YHTxBfO1gM6QWwBWbgxbY0L38bn9Z9oXLD12SVUDZYDgMzafgWOdNFJzOLy7Cx93up9XjaXFzdAw Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:04.130114 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8e5063e034d455da19f73c82136edef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8e5063e034d455da19f73c82136edef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}] Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 09a701dfa8db493ca93820f0b8f0a662 Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:50:04.131516 ncdv-master-1 devstack@n-api.service[140434]: exception: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '14105bd4-d585-43a7-bb50-ef300de8f1dd', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.132288 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.133494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:04.134575 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:04.134575 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.134575 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.134575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Returning 404 to user: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:04.134575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b7fc67f-1547-4a5e-8f13-68d459159d95 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd" status: 404 len: 110 microversion: 2.53 time: 0.345645 Aug 27 20:50:04.134956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 120/221] 10.222.0.40 () {62 vars in 1309 bytes} [Sat Aug 27 20:50:03 2022] PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd => generated 110 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:04.140724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf0c3421-3a63-4ccc-9057-2a59305fbf29 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.150418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1d1b3ac-7f40-4e73-bb21-a1e925f75d42 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fda4790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.154995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf0c3421-3a63-4ccc-9057-2a59305fbf29 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.155819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf0c3421-3a63-4ccc-9057-2a59305fbf29 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.156878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf0c3421-3a63-4ccc-9057-2a59305fbf29 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.291890 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1d1b3ac-7f40-4e73-bb21-a1e925f75d42 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2" status: 200 len: 371 microversion: 2.1 time: 0.620517 Aug 27 20:50:04.292521 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 102/222] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 20:50:03 2022] GET /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2 => generated 371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:04.304414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b2071cc0-d5f1-4a44-a59c-0e7c87a80c9a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] Calling method '.version_select at 0x7ff84fdb2d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.369797 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf0c3421-3a63-4ccc-9057-2a59305fbf29 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.233471 Aug 27 20:50:04.370953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 121/223] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:04.386233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fb46310>, body: {"status": "disabled"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.398770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.399732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.400459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.423207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.423971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.424755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.442556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] HTTP exception thrown: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Request method failure captured: Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd HTTP/1.1 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 22 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoN7FUeUpVrd1KUdWsRbQyABmV6PPd5dJU_oeoJDLZkCoWiePdTsMnUA25RjtPBS0wyKd0s5zEl-gGUcSKd6TJDtpKTJNAvCJZ7YHTxBfO1gM6QWwBWbgxbY0L38bn9Z9oXLD12SVUDZYDgMzafgWOdNFJzOLy7Cx93up9XjaXFzdAw Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:04.444338 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8e5063e034d455da19f73c82136edef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8e5063e034d455da19f73c82136edef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}] Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 09a701dfa8db493ca93820f0b8f0a662 Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: {"status": "disabled"} Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: exception: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.446025 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '14105bd4-d585-43a7-bb50-ef300de8f1dd', 'body': {'status': 'disabled'}} Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.446940 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:04.448787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:04.450159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.450159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.450159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Returning 404 to user: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:04.450159 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-13fea744-ab81-4797-b60c-77c667c75799 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd" status: 404 len: 110 microversion: 2.53 time: 0.066467 Aug 27 20:50:04.450159 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 122/224] 10.222.0.40 () {62 vars in 1309 bytes} [Sat Aug 27 20:50:04 2022] PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:04.460185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.461063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:04.469731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.470242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.470669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.471605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.472495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.473484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.604670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:04.608846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b2071cc0-d5f1-4a44-a59c-0e7c87a80c9a tempest-SecurityGroupsTestAdminJSON-302916657 tempest-SecurityGroupsTestAdminJSON-302916657-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/c0c407f0-383a-4833-807c-b4d4223a3661" status: 202 len: 0 microversion: 2.1 time: 0.308490 Aug 27 20:50:04.609446 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 103/225] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:50:04 2022] DELETE /compute/v2.1/os-security-groups/c0c407f0-383a-4833-807c-b4d4223a3661 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:04.614672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fdb2160>, body: {"quota_set": {"ram": "5120"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.623129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:04.625113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:04.627033 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e694b06e-dfd5-4291-8978-71a532cc46fb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1313 microversion: 2.25 time: 0.179497 Aug 27 20:50:04.628120 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 123/226] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:04 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:04.633252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-005a6476-c355-4a0a-b089-c70ce4d97fb9 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.645058 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-005a6476-c355-4a0a-b089-c70ce4d97fb9 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.015594 Aug 27 20:50:04.647244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 124/227] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:50:04 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:04.653857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f9c5c10>, body: {"status": "enabled"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.673821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.674521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.675322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.685032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.685883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.686491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.699003 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] HTTP exception thrown: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Request method failure captured: Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd HTTP/1.1 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 21 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoN7FUeUpVrd1KUdWsRbQyABmV6PPd5dJU_oeoJDLZkCoWiePdTsMnUA25RjtPBS0wyKd0s5zEl-gGUcSKd6TJDtpKTJNAvCJZ7YHTxBfO1gM6QWwBWbgxbY0L38bn9Z9oXLD12SVUDZYDgMzafgWOdNFJzOLy7Cx93up9XjaXFzdAw Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:04.703993 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8e5063e034d455da19f73c82136edef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8e5063e034d455da19f73c82136edef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8e5063e034d455da19f73c82136edef"}]}] Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b8e5063e034d455da19f73c82136edef Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629 Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 09a701dfa8db493ca93820f0b8f0a662 Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: {"status": "enabled"} Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: exception: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.705425 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '14105bd4-d585-43a7-bb50-ef300de8f1dd', 'body': {'status': 'enabled'}} Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.706310 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:04.707921 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:04.709660 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. Aug 27 20:50:04.709660 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:04.714168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Returning 404 to user: Service 14105bd4-d585-43a7-bb50-ef300de8f1dd could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:04.715677 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4d23d1f1-5625-43c1-9081-3964ee98e683 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd" status: 404 len: 110 microversion: 2.53 time: 0.066914 Aug 27 20:50:04.720773 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 125/228] 10.222.0.40 () {62 vars in 1309 bytes} [Sat Aug 27 20:50:04 2022] PUT /compute/v2.1/os-services/14105bd4-d585-43a7-bb50-ef300de8f1dd => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:04.726501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.728036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:04.734995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.735757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.736362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.737229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.737832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.738489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.791099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.791612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.795624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.796726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.800213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.801098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:04.856441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16f4de73-2081-4ad0-bebf-899d98700551 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2" status: 200 len: 328 microversion: 2.1 time: 0.245534 Aug 27 20:50:04.857014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 104/229] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:50:04 2022] PUT /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2 => generated 328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:04.863643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b12d38fa-e785-469f-b4b0-c5db520d0e44 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] Calling method '.version_select at 0x7ff84fdec790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:04.923546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:04.932274 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0398fa3-a138-4f20-8173-f6875c11d4a2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1463 microversion: 2.1 time: 0.209996 Aug 27 20:50:04.933746 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 126/230] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:04 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:04.939232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82219cb5-1bc2-461e-955b-3a1b2abf4972 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:04.956461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82219cb5-1bc2-461e-955b-3a1b2abf4972 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:04.958420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82219cb5-1bc2-461e-955b-3a1b2abf4972 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:04.959163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82219cb5-1bc2-461e-955b-3a1b2abf4972 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.106527 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82219cb5-1bc2-461e-955b-3a1b2abf4972 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.171201 Aug 27 20:50:05.109671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 127/231] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:05.122947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.135750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.136532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.137121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.138511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.139244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.139973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.150393 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b12d38fa-e785-469f-b4b0-c5db520d0e44 tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/2a6782ca-038c-4178-a745-6606857db0c9" status: 202 len: 0 microversion: 2.1 time: 0.291855 Aug 27 20:50:05.155499 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 105/232] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:50:04 2022] DELETE /compute/v2.1/os-security-groups/2a6782ca-038c-4178-a745-6606857db0c9 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:05.167868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47e154a7-4fba-453c-b317-119eb1d0f8ea tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.171852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b846eeae-6746-43ce-bbb1-9238c1de1bf9 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.054435 Aug 27 20:50:05.173206 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 128/233] 10.222.0.40 () {60 vars in 1178 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:05.187145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1349342849", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ef14e11f-a30d-4cc5-96a3-98cd978d619a"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:05.197248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47e154a7-4fba-453c-b317-119eb1d0f8ea tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2" status: 202 len: 0 microversion: 2.1 time: 0.040340 Aug 27 20:50:05.200608 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 106/234] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 20:50:05 2022] DELETE /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:05.203557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f2a6900-2a05-4363-b956-11e3bc9adc16 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.232992 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f2a6900-2a05-4363-b956-11e3bc9adc16 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.033337 Aug 27 20:50:05.234467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 107/235] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:05.240185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4c82796-3911-4927-970c-543f9347580f tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] Calling method '.version_select at 0x7ff84fda4d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.263911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:05.568968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:05.569481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:05.570473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:05.571005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:05.571728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:05.581646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.582565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.583653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.584020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.584573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.585169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.596670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4c82796-3911-4927-970c-543f9347580f tempest-SecurityGroupsTestAdminJSON-397041242 tempest-SecurityGroupsTestAdminJSON-397041242-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/16a8e6a9-854e-40b5-8f29-95a87d59867e" status: 202 len: 0 microversion: 2.1 time: 0.360982 Aug 27 20:50:05.597842 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 108/236] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:50:05 2022] DELETE /compute/v2.1/os-security-groups/16a8e6a9-854e-40b5-8f29-95a87d59867e => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:05.607532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.614600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.615195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.615543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.623813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.624294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.624707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.653171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-758b0fab-6177-4f78-b5ef-b451c9a7ea25 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.053962 Aug 27 20:50:05.653890 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 109/237] 10.222.0.40 () {60 vars in 1211 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:05.658385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9744fdf7-fea9-4daf-8d87-0470b355350e tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fdb2a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.669091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:05.678868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Getting quotas for user 7a345ebf9ea846089ee8e5d8eac1b47d and project 51f5f4f721bb419693f552f7aba3effd. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:05.690622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:05.693618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:05.765326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d690eb8-13fb-4953-be86-ee986a23140e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590869 Aug 27 20:50:05.770461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 129/238] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:50:05.773842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9b18ac9-c9ea-40fa-93a0-e9b9059f4221 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2083450986"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:05.777937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-e9b18ac9-c9ea-40fa-93a0-e9b9059f4221 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid 8a97ccf4-23d3-4da7-a2c6-df369b578319 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:05.787744 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9744fdf7-fea9-4daf-8d87-0470b355350e tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2" status: 200 len: 371 microversion: 2.1 time: 0.130181 Aug 27 20:50:05.788368 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 110/239] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/os-quota-sets/fb1dbdaa580444b79da4d389cd9c1fb2 => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:05.830434 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9b18ac9-c9ea-40fa-93a0-e9b9059f4221 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063075 Aug 27 20:50:05.832034 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 130/240] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:05.838100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.842375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.843098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.843705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.845724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.846513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.847583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.849709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.851973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:05.873048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.874687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.877049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.880237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:05.884430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2fac8df6-8b89-456a-b272-4355b88555c1 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.050706 Aug 27 20:50:05.884624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:05.886372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:05.886506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 131/241] 10.222.0.40 () {60 vars in 1178 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:05.892969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37864320-5cdd-497a-9c26-3b17b948c8c5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:05.895365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37864320-5cdd-497a-9c26-3b17b948c8c5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:05.994898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37864320-5cdd-497a-9c26-3b17b948c8c5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:06.002396 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37864320-5cdd-497a-9c26-3b17b948c8c5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1214 microversion: 2.1 time: 0.114568 Aug 27 20:50:06.017908 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 132/242] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:06.026459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ce6d7dc-983a-4391-8920-f13eee3f1022 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:06.061551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:06.070660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce6d7dc-983a-4391-8920-f13eee3f1022 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.071370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce6d7dc-983a-4391-8920-f13eee3f1022 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.072033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce6d7dc-983a-4391-8920-f13eee3f1022 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.290289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:06.304316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:06.309445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:06.312505 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f369da79-1681-47a8-b573-a371f88d289d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.488750 Aug 27 20:50:06.316875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 111/243] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:05 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:06.337781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:06.350236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.352255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.352765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.354783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.361407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.361957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.373544 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ce6d7dc-983a-4391-8920-f13eee3f1022 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.363247 Aug 27 20:50:06.383471 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 133/244] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:06.390757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:06.391432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:06.399160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.399706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.400130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.400899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.401370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.402810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.419103 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94f1647e-3f5b-4714-9a32-1cebcffa103b tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100758 Aug 27 20:50:06.424138 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 112/245] 10.222.0.40 () {60 vars in 1237 bytes} [Sat Aug 27 20:50:06 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:06.433540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696e2116-4af3-4fa5-8e68-37bdf89f1a7f", "tag": "353ee501-5b6c-4545-aa2c-f5c566028c7e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:06.458252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.459375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.460062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:06.484841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] Creating event network-changed:353ee501-5b6c-4545-aa2c-f5c566028c7e for instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f on nch2-master-1 Aug 27 20:50:06.500157 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-70f41427-71f8-4948-8e9a-2b6045a4ecf3 req-7376eb78-0e8f-4c6e-8bb7-96039dde1afc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074573 Aug 27 20:50:06.502405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 113/246] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:06.513309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23dd9a43-51ae-49ea-973b-caff64e2d933 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fddc3a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:06.930261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23dd9a43-51ae-49ea-973b-caff64e2d933 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.426246 Aug 27 20:50:06.930934 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 114/247] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 20:50:06 2022] GET /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9/defaults => generated 371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:06.948283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-136907bb-e298-4a9d-86de-49c5711c0f55 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:06.985720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-136907bb-e298-4a9d-86de-49c5711c0f55 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:06.987764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-136907bb-e298-4a9d-86de-49c5711c0f55 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:06.988403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-136907bb-e298-4a9d-86de-49c5711c0f55 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.185620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:07.203171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:07.215126 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f14944a-cc39-4332-a627-b4b36e105cda tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 200 len: 1585 microversion: 2.1 time: 0.830564 Aug 27 20:50:07.219262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 134/248] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:06 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 1585 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:07.223866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-136907bb-e298-4a9d-86de-49c5711c0f55 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.291698 Aug 27 20:50:07.224635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:07.231419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.232352 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 115/249] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:07.234727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.235436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.236383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.237523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:07.238543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:07.240334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.243124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.245852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.246548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.247481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.249275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.250338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.251051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.317515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8dd02dd3-c8a0-4bf3-875b-f9e8a1d7d953 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.096755 Aug 27 20:50:07.318649 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 135/250] 10.222.0.40 () {60 vars in 1178 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:07.338099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a43ddff-3890-484f-aadf-535e2c027678 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:07.363284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a43ddff-3890-484f-aadf-535e2c027678 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.042410 Aug 27 20:50:07.364278 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 136/251] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:07 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:07.375875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:07.379982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.380463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.380909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.381674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.382127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.382536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.417540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-16ff8a7a-1ab7-4357-9e74-ace00771c954 tempest-ServicesAdminNegativeV253TestJSON-893252629 tempest-ServicesAdminNegativeV253TestJSON-893252629-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.051908 Aug 27 20:50:07.418390 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 137/252] 10.222.0.40 () {60 vars in 1239 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:07.423897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fafa3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:07.473745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:07.485739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e097771-db53-4bf8-b8c4-70deb1633266 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1266 microversion: 2.1 time: 0.251671 Aug 27 20:50:07.486519 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 116/253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:07.493443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:07.494652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:07.506176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.506950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.507588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.508466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.509095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.509684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.536482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:07.631529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.632157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.632652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.633506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:07.634019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:07.634503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:07.692665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:07.703784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:07.704004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bfe2eedf-e6df-4c84-ad8f-313b7c1ef143 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739" status: 200 len: 328 microversion: 2.1 time: 0.284160 Aug 27 20:50:07.705031 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 138/254] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 20:50:07 2022] PUT /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739 => generated 328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:07.705714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:07.710868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e66d96ff-078d-4b76-ae51-9f94371d2e83 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1707936632"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:07.712096 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e8cd480-b8ad-4ec2-ad6f-b799aac23643 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.218841 Aug 27 20:50:07.715649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-e66d96ff-078d-4b76-ae51-9f94371d2e83 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid d0de6b17-1951-4cc2-9a00-6621694cd98c for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:07.721825 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 117/255] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:07.729739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d27b0990-57a7-48a5-8221-0fba149795a2 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-512129789"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:07.733562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-d27b0990-57a7-48a5-8221-0fba149795a2 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Generated uuid ec3d69bb-2ddb-49a7-a6d3-71dc4d5be563 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:07.786832 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d27b0990-57a7-48a5-8221-0fba149795a2 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.063173 Aug 27 20:50:07.798181 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e66d96ff-078d-4b76-ae51-9f94371d2e83 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091857 Aug 27 20:50:07.799066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 139/256] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:07.803863 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 118/257] 10.222.0.40 () {62 vars in 1205 bytes} [Sat Aug 27 20:50:07 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:07.826774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fda4310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.021120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ce5f1a1-ed3f-466a-b614-28dacfa57fb5 tempest-ServicesAdminNegativeV253TestJSON-272577120 tempest-ServicesAdminNegativeV253TestJSON-272577120-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.029516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5ce5f1a1-ed3f-466a-b614-28dacfa57fb5 tempest-ServicesAdminNegativeV253TestJSON-272577120 tempest-ServicesAdminNegativeV253TestJSON-272577120-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8707ef2f03ff42c6b5a2a8611bc31a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6d38ecd4ea4624b6f72eb9dabccea7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ce5f1a1-ed3f-466a-b614-28dacfa57fb5 tempest-ServicesAdminNegativeV253TestJSON-272577120 tempest-ServicesAdminNegativeV253TestJSON-272577120-project] Request method failure captured: Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoN6YaZgPOnjxo9Mew6uDCcAKE2K9OQtAkVW4aMXOnpzY3YCxtH-LxI9PLy-iuU8geR6_IMzvRzdLhyijLPC8cWCopjFprpQCR_a83V50tUsVTufa_PHGH46lheShfRCBhZAxS_kEZ0Yb6Jmx9eQkSnWfckhTVunhERc8PGZPd3YXVI Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fc6d38ecd4ea4624b6f72eb9dabccea7 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-272577120 Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:08.031161 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc6d38ecd4ea4624b6f72eb9dabccea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc6d38ecd4ea4624b6f72eb9dabccea7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc6d38ecd4ea4624b6f72eb9dabccea7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc6d38ecd4ea4624b6f72eb9dabccea7"}]}] Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-272577120 Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fc6d38ecd4ea4624b6f72eb9dabccea7 Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-272577120 Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServicesAdminNegativeV253TestJSON-272577120-project Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8707ef2f03ff42c6b5a2a8611bc31a6b Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-272577120-project Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:50:08.032540 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:08.033229 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:50:08.034338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.042098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ce5f1a1-ed3f-466a-b614-28dacfa57fb5 tempest-ServicesAdminNegativeV253TestJSON-272577120 tempest-ServicesAdminNegativeV253TestJSON-272577120-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:08.043328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ce5f1a1-ed3f-466a-b614-28dacfa57fb5 tempest-ServicesAdminNegativeV253TestJSON-272577120 tempest-ServicesAdminNegativeV253TestJSON-272577120-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.236410 Aug 27 20:50:08.044210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 140/258] 10.222.0.40 () {60 vars in 1178 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:08.062743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b227a31-eafe-49fd-8133-8ecd83da5d21 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1526109032"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:08.279145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b227a31-eafe-49fd-8133-8ecd83da5d21 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.233195 Aug 27 20:50:08.281882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 141/259] 10.222.0.40 () {62 vars in 1210 bytes} [Sat Aug 27 20:50:08 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:08.293165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b48279d9-4f45-4185-b803-531b1d3a89b1 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.328997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b48279d9-4f45-4185-b803-531b1d3a89b1 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.043787 Aug 27 20:50:08.330243 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 142/260] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:08.336939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43b68b98-ae25-47dc-b2f0-f87f21c201af tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.348509 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-43b68b98-ae25-47dc-b2f0-f87f21c201af tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.015671 Aug 27 20:50:08.349722 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 143/261] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:50:08 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:08.355960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50f82fe9-3b88-4cca-81ef-999dacd190d8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.364765 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-50f82fe9-3b88-4cca-81ef-999dacd190d8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50f82fe9-3b88-4cca-81ef-999dacd190d8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Request method failure captured: Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEzBxPPOb2yKz93WmfaFRpAkA11ZtSt8bhcKR9UvptRej4rJQifdUGSRRixGQwaYQG4dBcxI6Gi5h-VAZazN4Gzp8PMApDADzA5jKbqgSLH5u1JqO3WV1bDo1BFshqt94p73Q0t183espAAMdYdnEA4VrTwHGP6JLWS770u45IqJw Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:08.367227 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e7e04c0840d492a908f82af5e1a11a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}] Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fe54174de20466598ebd5f2dec64781 Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate 5 could not be found. Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5'} Aug 27 20:50:08.368603 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.369429 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 20:50:08.370557 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.373432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50f82fe9-3b88-4cca-81ef-999dacd190d8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:08.374717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50f82fe9-3b88-4cca-81ef-999dacd190d8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.023674 Aug 27 20:50:08.375919 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 144/262] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:50:08 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:08.385019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84e3fdf3-cc07-490d-9b6e-79ab425423c1 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:08.400928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84e3fdf3-cc07-490d-9b6e-79ab425423c1 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.401612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84e3fdf3-cc07-490d-9b6e-79ab425423c1 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.402105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84e3fdf3-cc07-490d-9b6e-79ab425423c1 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.434450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:08.597769 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84e3fdf3-cc07-490d-9b6e-79ab425423c1 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.218574 Aug 27 20:50:08.599733 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 145/263] 10.222.0.40 () {62 vars in 1232 bytes} [Sat Aug 27 20:50:08 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:08.606194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fb2d7ae-bd98-4420-9ee3-7e87f8b48209 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.619714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.621618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.623665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.626022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.627198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.630438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.654279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1fb2d7ae-bd98-4420-9ee3-7e87f8b48209 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fb2d7ae-bd98-4420-9ee3-7e87f8b48209 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Request method failure captured: Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEzBxPPOb2yKz93WmfaFRpAkA11ZtSt8bhcKR9UvptRej4rJQifdUGSRRixGQwaYQG4dBcxI6Gi5h-VAZazN4Gzp8PMApDADzA5jKbqgSLH5u1JqO3WV1bDo1BFshqt94p73Q0t183espAAMdYdnEA4VrTwHGP6JLWS770u45IqJw Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:08.661095 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e7e04c0840d492a908f82af5e1a11a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}] Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fe54174de20466598ebd5f2dec64781 Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate 5 could not be found. Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5'} Aug 27 20:50:08.662515 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:08.663363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:08.664626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:08.667452 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:08.667452 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:08.667452 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:08.667452 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 20:50:08.667452 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:08.671476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fb2d7ae-bd98-4420-9ee3-7e87f8b48209 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:08.673074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fb2d7ae-bd98-4420-9ee3-7e87f8b48209 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.072246 Aug 27 20:50:08.676304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 146/264] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:08 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:08.693965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:08.697805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:08.705381 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac9b4e23-5f82-4dda-998d-6f1e60595178 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739/detail" status: 200 len: 916 microversion: 2.1 time: 0.896177 Aug 27 20:50:08.706186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 119/265] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:50:07 2022] GET /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739/detail => generated 916 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:08.719687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.720501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.721031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.723530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f02b814-5983-42e5-a72f-2e8551f825d7 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:08.726348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.726771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.727245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.748355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f02b814-5983-42e5-a72f-2e8551f825d7 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:08.749033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f02b814-5983-42e5-a72f-2e8551f825d7 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:08.754427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f02b814-5983-42e5-a72f-2e8551f825d7 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:08.868367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:08.877316 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e70ffe92-128a-42a1-b7f6-d58ee15e113f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1272 microversion: 2.1 time: 0.198367 Aug 27 20:50:08.884858 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 147/266] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:08 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:08.889982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b921b326-3cd4-4fdd-8678-1708e9638fd4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-635153581", "name": "tempest-test_aggregate-1453249235"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:08.926733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-b921b326-3cd4-4fdd-8678-1708e9638fd4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid 4ee9b314-d3bb-4591-b2a3-5ab7c4e87462 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:08.963841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f02b814-5983-42e5-a72f-2e8551f825d7 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.255108 Aug 27 20:50:08.964762 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 120/267] 10.222.0.40 () {62 vars in 1232 bytes} [Sat Aug 27 20:50:08 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:08.975791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c", "tag": "de4c6c4c-48ba-4c87-9fb2-90044336c2dc"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.010283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.013628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.014543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.024965 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b921b326-3cd4-4fdd-8678-1708e9638fd4 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.138314 Aug 27 20:50:09.028642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 148/268] 10.222.0.40 () {60 vars in 1165 bytes} [Sat Aug 27 20:50:08 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.043508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.044579 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] Creating event network-changed:de4c6c4c-48ba-4c87-9fb2-90044336c2dc for instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c on nch1-master-1 Aug 27 20:50:09.047014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:09.059222 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-104e4a63-3624-48b1-8c5a-c74649ae36b7 req-96748d93-d530-4c66-8495-b0d6707a37cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092788 Aug 27 20:50:09.060322 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 121/269] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.072330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ac85d7a-2d45-49ec-bc2c-946ba5a91462 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.078901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.080034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.085604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.088203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.090681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.092240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.104471 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ac85d7a-2d45-49ec-bc2c-946ba5a91462 tempest-AggregatesAdminTestV241-332385759 tempest-AggregatesAdminTestV241-332385759-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.041429 Aug 27 20:50:09.105381 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 122/270] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 20:50:09 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.112422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ed6a125-78f2-4d37-a8b4-09dc1f77530c tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.160176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ed6a125-78f2-4d37-a8b4-09dc1f77530c tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.053565 Aug 27 20:50:09.167486 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 123/271] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:09.173599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fdc5a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.394466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:09.408729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:09.410510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:09.411880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f46cf36d-6c9e-4285-bc4b-f3a9e1b66303 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.382252 Aug 27 20:50:09.428317 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 149/272] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:09 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:09.433257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e47f66b2-9a98-4b43-971a-331458b3aea8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.440488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e47f66b2-9a98-4b43-971a-331458b3aea8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e47f66b2-9a98-4b43-971a-331458b3aea8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Request method failure captured: Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEzBxPPOb2yKz93WmfaFRpAkA11ZtSt8bhcKR9UvptRej4rJQifdUGSRRixGQwaYQG4dBcxI6Gi5h-VAZazN4Gzp8PMApDADzA5jKbqgSLH5u1JqO3WV1bDo1BFshqt94p73Q0t183espAAMdYdnEA4VrTwHGP6JLWS770u45IqJw Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:09.442519 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e7e04c0840d492a908f82af5e1a11a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}] Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fe54174de20466598ebd5f2dec64781 Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate 7 could not be found. Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7'} Aug 27 20:50:09.443930 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.444804 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 20:50:09.446092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.448231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e47f66b2-9a98-4b43-971a-331458b3aea8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:09.449980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e47f66b2-9a98-4b43-971a-331458b3aea8 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.020343 Aug 27 20:50:09.450696 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 150/273] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:50:09 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:09.461285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6674f93-bb8c-4770-87c8-fd2c9cecbc85 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.475255 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e6674f93-bb8c-4770-87c8-fd2c9cecbc85 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6674f93-bb8c-4770-87c8-fd2c9cecbc85 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Request method failure captured: Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNEzBxPPOb2yKz93WmfaFRpAkA11ZtSt8bhcKR9UvptRej4rJQifdUGSRRixGQwaYQG4dBcxI6Gi5h-VAZazN4Gzp8PMApDADzA5jKbqgSLH5u1JqO3WV1bDo1BFshqt94p73Q0t183espAAMdYdnEA4VrTwHGP6JLWS770u45IqJw Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:09.479441 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e7e04c0840d492a908f82af5e1a11a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e7e04c0840d492a908f82af5e1a11a6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e7e04c0840d492a908f82af5e1a11a6"}]}] Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 0e7e04c0840d492a908f82af5e1a11a6 Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2131458538 Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fe54174de20466598ebd5f2dec64781 Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminTestJSON-2131458538-project-admin Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate 7 could not be found. Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7'} Aug 27 20:50:09.480906 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:09.481761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:09.483636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:09.486325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:09.486325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:09.486325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:09.486325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 20:50:09.486325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:09.489220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6674f93-bb8c-4770-87c8-fd2c9cecbc85 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:09.490276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6674f93-bb8c-4770-87c8-fd2c9cecbc85 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.034906 Aug 27 20:50:09.491022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 151/274] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:09 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:09.508560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5550d3b0-e116-4341-aaef-b9511a2de95c tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1224903991"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.513447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-5550d3b0-e116-4341-aaef-b9511a2de95c tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid b1ee2f46-41b6-4eef-a806-d0b5446d93c3 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:09.578151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5550d3b0-e116-4341-aaef-b9511a2de95c tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078404 Aug 27 20:50:09.580136 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 152/275] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.598930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-88b0b196-a5d5-4087-bd12-6d89d7c6b483 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.635947 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-88b0b196-a5d5-4087-bd12-6d89d7c6b483 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.046556 Aug 27 20:50:09.638779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 153/276] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:50:09 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.651328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75a35775-29de-4a77-976b-96f5a1a0419b tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.685217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.685775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.686156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.690367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75a35775-29de-4a77-976b-96f5a1a0419b tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.042752 Aug 27 20:50:09.699402 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 154/277] 10.222.0.40 () {60 vars in 1191 bytes} [Sat Aug 27 20:50:09 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.704506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.705098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.706161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6cb0fccd-b4b9-40fd-b3ee-04f8c7e32766 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.707205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.716732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6cb0fccd-b4b9-40fd-b3ee-04f8c7e32766 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.014755 Aug 27 20:50:09.725730 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 155/278] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:50:09 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.731743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf0c1a19-3b6b-4037-8b05-c869c5909145 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:09.767499 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf0c1a19-3b6b-4037-8b05-c869c5909145 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.040404 Aug 27 20:50:09.768828 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 156/279] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:09 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:09.782995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52432150-9394-4679-ae9a-86da8022866d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1712508557", "availability_zone": "tempest-test_az-772537998"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.792564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-52432150-9394-4679-ae9a-86da8022866d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid 0175207a-ddd8-451e-94d3-a8b7d7dd4acd for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:09.813768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:09.820123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.825395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.826349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.834067 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52432150-9394-4679-ae9a-86da8022866d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.059618 Aug 27 20:50:09.836197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.836783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.837230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:09.838069 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 157/280] 10.222.0.40 () {60 vars in 1165 bytes} [Sat Aug 27 20:50:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:09.859852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68ab981b-081c-4143-a066-f4936ed6b78d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1712508557_new", "availability_zone": "tempest-test_az-772537998_new"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:09.947767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68ab981b-081c-4143-a066-f4936ed6b78d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:09.948273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68ab981b-081c-4143-a066-f4936ed6b78d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:09.948707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68ab981b-081c-4143-a066-f4936ed6b78d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.033717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68ab981b-081c-4143-a066-f4936ed6b78d tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.188118 Aug 27 20:50:10.035562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 158/281] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:50:09 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:10.049590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.051897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:10.068997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.069927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.070796 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a088612-d6e0-46cb-91ad-76a1fab74234 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739?user_id=60fb5a73df6a47f1aed3cf327c6f942a" status: 200 len: 328 microversion: 2.1 time: 0.902092 Aug 27 20:50:10.071862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.072911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.076157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.076611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.080778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 124/282] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:50:09 2022] PUT /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739?user_id=60fb5a73df6a47f1aed3cf327c6f942a => generated 328 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:10.087857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e3063a6-de76-4106-96f6-d30fb6516da6 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.099150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e3063a6-de76-4106-96f6-d30fb6516da6 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.017113 Aug 27 20:50:10.100447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 125/283] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:10.105381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00c021aa-a7d7-441b-88f9-af557216f3e8 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fd7e1f0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.402568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:10.414138 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-892df778-0c3d-4fa5-973e-4d434053f586 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.375078 Aug 27 20:50:10.414890 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 159/284] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:10.431871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b0c6cb1-bc37-4f68-a2a4-9cec2e347f35 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.473084 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b0c6cb1-bc37-4f68-a2a4-9cec2e347f35 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.045482 Aug 27 20:50:10.479109 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 160/285] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:10 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:10.485775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.486522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:10.495573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.496598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.496598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.497254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.498030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.498886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.583431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00c021aa-a7d7-441b-88f9-af557216f3e8 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739?user_id=60fb5a73df6a47f1aed3cf327c6f942a" status: 200 len: 370 microversion: 2.1 time: 0.481432 Aug 27 20:50:10.584018 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 126/286] 10.222.0.40 () {58 vars in 1323 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/os-quota-sets/ec1fa7e058334253b2095531b9c90739?user_id=60fb5a73df6a47f1aed3cf327c6f942a => generated 370 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:10.596698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da88c105-6fe2-4c09-a8bc-288b12e5faeb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1280994779"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:10.600589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-da88c105-6fe2-4c09-a8bc-288b12e5faeb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Generated uuid 5014b089-94e4-4aa4-abf0-0ac9c250db25 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:10.641733 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da88c105-6fe2-4c09-a8bc-288b12e5faeb tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049730 Aug 27 20:50:10.643058 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 127/287] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:10.654027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e1394fc-2e0d-4084-bab7-dc91a0d6f334 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.666684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e1394fc-2e0d-4084-bab7-dc91a0d6f334 tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.016273 Aug 27 20:50:10.667608 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 128/288] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:10.683044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-647d22f3-5d88-4c22-8a4f-33103bfb0d7e tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.732526 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-647d22f3-5d88-4c22-8a4f-33103bfb0d7e tempest-AggregatesAdminTestJSON-2131458538 tempest-AggregatesAdminTestJSON-2131458538-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.057520 Aug 27 20:50:10.738591 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 129/289] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:10 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:10.756241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.756910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:10.777227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.778931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.779839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.785053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.785629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.786286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:10.787077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.799547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:10.805568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:10.809818 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39a04b07-539d-463c-9b16-a7768a0850b2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.332549 Aug 27 20:50:10.812864 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 161/290] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:10.835711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] HTTP exception thrown: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Request method failure captured: Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 HTTP/1.1 Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNBb7h27wyHjAbtYm7mksIAIMj7BAUixvHtbGFH3LErvDliacIxU7-pFxMpASL-uiPnaQtmQ9emi6d1WSOLMbmOmOl_MtNxI3f9nkvQ2OB7cFyAKXLXQDxnExD2Ar1x2csR88qF9S9msPls8-18-psSjQZdvYQd0OBbfqtezh684eo Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:50:10.837515 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee1b1163e1504c45a46c7587660a92ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}] Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c41583fc2a824031a57658dabfa561f6 Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.838901 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '000ccbb0-4cae-4f2d-9e8c-a25d079e37f9'} Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:10.839602 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.840700 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.842071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Returning 404 to user: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:10.842071 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87c2f53f-7175-4378-9b8d-fa061186963c tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "DELETE /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 404 len: 111 microversion: 2.1 time: 0.099520 Aug 27 20:50:10.842071 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 130/291] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:50:10 2022] DELETE /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:10.849015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:10.849863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] [instance: 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:10.857652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.858562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.859657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.860661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:10.861327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:10.861998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:10.881508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] HTTP exception thrown: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Request method failure captured: Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 HTTP/1.1 Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNBb7h27wyHjAbtYm7mksIAIMj7BAUixvHtbGFH3LErvDliacIxU7-pFxMpASL-uiPnaQtmQ9emi6d1WSOLMbmOmOl_MtNxI3f9nkvQ2OB7cFyAKXLXQDxnExD2Ar1x2csR88qF9S9msPls8-18-psSjQZdvYQd0OBbfqtezh684eo Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:10.883855 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ee1b1163e1504c45a46c7587660a92ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ee1b1163e1504c45a46c7587660a92ee", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ee1b1163e1504c45a46c7587660a92ee"}]}] Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ee1b1163e1504c45a46c7587660a92ee Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-761911652 Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c41583fc2a824031a57658dabfa561f6 Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminTestJSON-761911652-project Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.885323 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '000ccbb0-4cae-4f2d-9e8c-a25d079e37f9'} Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:10.886184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. Aug 27 20:50:10.887515 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:10.889905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] Returning 404 to user: Instance 000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:10.891444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2fbbb3dc-9ca3-455e-bbbc-28843a3298a2 tempest-AggregatesAdminTestJSON-761911652 tempest-AggregatesAdminTestJSON-761911652-project] 10.222.0.40 "GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9" status: 404 len: 111 microversion: 2.1 time: 0.046519 Aug 27 20:50:10.895093 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 162/292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:10 2022] GET /compute/v2.1/servers/000ccbb0-4cae-4f2d-9e8c-a25d079e37f9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:11.082735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f791e927-8e41-4728-89d3-3c267b9742bf", "tag": "137ce93d-2cf3-4c18-9644-36698cbeb55d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:11.107391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:11.108824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:11.111694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:11.144375 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] Creating event network-changed:137ce93d-2cf3-4c18-9644-36698cbeb55d for instance f791e927-8e41-4728-89d3-3c267b9742bf on nch2-master-1 Aug 27 20:50:11.172370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c924879b-391c-45ec-9910-e936b249a716 req-66d2a7cc-8dda-441d-9e87-d696c4cebbe8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094370 Aug 27 20:50:11.174030 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 131/293] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:11.438559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:11.439453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:11.448708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:11.449326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:11.450138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:11.451190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8570759-eca2-44ae-94e9-ec6864b87a37 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Calling method '.version_select at 0x7ff84fdf2ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:11.452897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:11.453493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:11.454025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:11.669392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:11.680217 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd015530-c37a-437b-a42d-933781034b67 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.248334 Aug 27 20:50:11.680974 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 163/294] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:11 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:11.835060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:11.835994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:11.846490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:11.848988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:11.852008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:11.854771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:11.856377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:11.857897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:12.160300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:12.170055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:12.171744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:12.173504 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-789050db-9a7e-46b2-ae82-b01eba5191b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.342637 Aug 27 20:50:12.174269 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 164/295] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:11 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:12.250179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8570759-eca2-44ae-94e9-ec6864b87a37 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.803369 Aug 27 20:50:12.251292 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 132/296] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 20:50:11 2022] GET /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9/defaults => generated 371 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:12.264288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f951dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:12.707852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:12.708686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:12.717642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:12.718239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:12.718767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:12.719611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:12.720154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:12.720783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:12.809528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:12.812307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:12.813369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:12.814328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:12.815826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:12.816552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:12.941500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:12.955105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eb3caaf0-c5f9-4987-bcdc-f090d862ff5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.250559 Aug 27 20:50:12.956127 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 133/297] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:12 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:13.133245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a471a463-40e1-4b07-8769-01681eeaa0a3 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9" status: 200 len: 329 microversion: 2.1 time: 0.871223 Aug 27 20:50:13.139397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 165/298] 10.222.0.40 () {60 vars in 1263 bytes} [Sat Aug 27 20:50:12 2022] PUT /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9 => generated 329 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:13.150381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fd7eca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:13.198172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:13.199032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:13.214634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:13.215584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:13.216351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:13.218303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:13.218780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:13.219603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:13.478927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:13.499391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:13.501227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:13.502709 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aeefd563-708e-4351-8095-8eb5d44d9a44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.308757 Aug 27 20:50:13.504925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 166/299] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:13 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:13.687506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:13.687962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:13.688343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:13.689065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:13.689513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:13.689947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:13.753075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:13.989194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:13.993962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:14.013031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.014031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.016049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.017645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.021692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.023100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.228074 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e71f4bf-9467-4a92-8fbe-2f28052846d6 tempest-QuotasAdminTestJSON-1031346638 tempest-QuotasAdminTestJSON-1031346638-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9" status: 200 len: 329 microversion: 2.1 time: 1.083580 Aug 27 20:50:14.229506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 134/300] 10.222.0.40 () {60 vars in 1263 bytes} [Sat Aug 27 20:50:13 2022] PUT /compute/v2.1/os-quota-sets/c2f209402de34663afad7de2327edeb9 => generated 329 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:14.431387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:14.439985 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a64e98d-c505-4ac9-b2a0-71230df6094e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.465160 Aug 27 20:50:14.447841 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 167/301] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:13 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:14.525571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:14.526186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:14.533228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.533709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.534142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.535062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.535815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.536032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.612805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-558358966", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:14.697534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:14.698094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:14.698399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:14.699078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:14.699772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:14.709564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.710413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.711377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.712319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:14.712972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:14.713611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:14.735744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Getting quotas for project 9b8f13c7b0c04f2d8edc472d032d5973. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:14.742212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Getting quotas for user d7f4bb27e9d7415eab81877c4c3748a1 and project 9b8f13c7b0c04f2d8edc472d032d5973. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:14.760530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:14.764840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:14.846403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:14.852271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-daea6489-fa54-47a8-b990-43ef4c276ac3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.514796 Aug 27 20:50:14.852966 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 135/302] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:50:14.860126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:14.861659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:14.862863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b15ff181-e00d-4d81-a023-62fe9add1db0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.341106 Aug 27 20:50:14.867449 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 168/303] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:14 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:14.867617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:14.873082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:15.149037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.163883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.168847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.188932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0207ae4b-9816-4805-a006-c023e2c26466 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "PUT /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1358 microversion: 2.75 time: 0.328132 Aug 27 20:50:15.208001 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 136/304] 10.222.0.40 () {62 vars in 1297 bytes} [Sat Aug 27 20:50:14 2022] PUT /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:15.217051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:15.217849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:15.413193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.424919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.426793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.445662 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4909ba03-662c-4cde-86fc-1737dfb9d441 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1358 microversion: 2.75 time: 0.233266 Aug 27 20:50:15.446255 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 169/305] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:15 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:15.473245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:15.473870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:15.481203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:15.487906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:15.488887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:15.491808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:15.492463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:15.492924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:15.590401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c", "name": "network-vif-plugged", "status": "completed", "tag": "de4c6c4c-48ba-4c87-9fb2-90044336c2dc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:15.619271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:15.621424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:15.621518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:15.638172 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] Creating event network-vif-plugged:de4c6c4c-48ba-4c87-9fb2-90044336c2dc for instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c on nch1-master-1 Aug 27 20:50:15.644271 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e06286d6-d5fc-4635-95ac-1eb21cb43c95 req-9ab3e1b9-9077-4c00-9b87-f22ead5e96ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058723 Aug 27 20:50:15.645411 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 170/306] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:15.819135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:15.830617 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3a6532e-1ea7-4814-91bc-21b68c482ede tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.362078 Aug 27 20:50:15.835911 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 137/307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:15 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:15.886734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:15.887490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:15.899555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:15.900424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:15.901085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:15.902683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:15.904107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:15.904916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:16.473401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:16.474424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:16.508239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:16.509932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:16.515293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:16.517417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:16.518652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:16.524502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:16.581097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.595576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.601325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.604198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ba00275-60c1-425e-bd4a-291bd8a90b67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1361 microversion: 2.25 time: 0.720441 Aug 27 20:50:16.604808 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 171/308] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:15 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1361 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:16.793722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.805282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.809054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:16.828352 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-197edf02-5637-4f42-9edf-357293dce3e7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1410 microversion: 2.75 time: 0.360773 Aug 27 20:50:16.830758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 138/309] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:16 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1410 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:16.853815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:16.856192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:16.873285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:16.874780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:16.877657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:16.879611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:16.882862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:16.883768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.158418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:17.174673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe7c2e76-7b8d-4408-9910-c87a2c08fd98 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.325667 Aug 27 20:50:17.176822 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 172/310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:16 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:17.522032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:17.526486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:17.527151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:17.527763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.528631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:17.529089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:17.529683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.598201 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3b63d0c-1601-4633-b387-886d6d6b718e tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.266513 Aug 27 20:50:17.602601 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 139/311] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:50:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:17.621796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-636f2c15-9ffb-4989-9e08-e972a3275fac tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2031349898"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:17.629082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:17.629708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:17.630195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-636f2c15-9ffb-4989-9e08-e972a3275fac tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid 1c04980b-727d-454d-9f75-e0e9d6f72e1d for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:17.648825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:17.649843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:17.650489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.656353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:17.658155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:17.659144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.682940 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-636f2c15-9ffb-4989-9e08-e972a3275fac tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065905 Aug 27 20:50:17.684909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 173/312] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:17.700355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75500e22-c751-410f-85b8-aff31197d959 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:17.727462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75500e22-c751-410f-85b8-aff31197d959 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:17.728330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75500e22-c751-410f-85b8-aff31197d959 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:17.728983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75500e22-c751-410f-85b8-aff31197d959 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:17.738175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=17,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:17.962600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75500e22-c751-410f-85b8-aff31197d959 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.271466 Aug 27 20:50:17.963896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 174/313] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:17.992525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:17.993611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:18.009087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.010538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.013263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.015355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.029844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.032655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.035440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.044848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.055028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.063479 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a44e88ae-3147-4c38-b36c-78c73cefd9ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1557 microversion: 2.25 time: 0.437229 Aug 27 20:50:18.069344 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 140/314] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:17 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1557 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:18.079571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:18.120697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.121197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.134491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.166609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:INSERT=17,nova_api:SELECT=70,nova_api:UPDATE=13 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:18.189718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Aggregate 11 already has host nch1-master-1. Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 39 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:50:18.205410 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: {"add_host": {"host": "nch1-master-1"}} Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:50:18.206834 ncdv-master-1 devstack@n-api.service[140433]: exception: Aggregate 11 already has host nch1-master-1. Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch1-master-1'}}} Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result.read() Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:50:18.208862 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 20:50:18.210826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 20:50:18.212984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:50:18.214986 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result.read() Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 20, 50, 18, 165883), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 11}] Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:18.219671 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch1-master-1. Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.222469 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch1-master-1. Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:18.225328 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:18.229636 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch1-master-1. Aug 27 20:50:18.229636 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:18.230003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.230164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 409 to user: Aggregate 11 already has host nch1-master-1. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:18.230164 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d060738-6beb-43ab-9bfa-24fa01ca2bc2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.148746 Aug 27 20:50:18.230164 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 141/315] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:18 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 20:50:18.230518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.231686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.239904 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0ac3f951-dc9d-4914-8b4f-8fd69913187b tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1416 microversion: 2.75 time: 0.274125 Aug 27 20:50:18.242734 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 175/316] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:17 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1416 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:18.250512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:18.251141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:18.258871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.259403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.259846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.260888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.261937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.262381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.541732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:18.552691 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a2724b4-7bd8-4bbf-915f-eec1fdf86b27 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.308149 Aug 27 20:50:18.552892 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 176/317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:18 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:18.574397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:18.574954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:18.579326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32874617-05eb-448b-a646-de2fa3ecdacf tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:18.585985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.586542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.586927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.589041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.589508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.589941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.605796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32874617-05eb-448b-a646-de2fa3ecdacf tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:18.606447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32874617-05eb-448b-a646-de2fa3ecdacf tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:18.608733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32874617-05eb-448b-a646-de2fa3ecdacf tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:18.785774 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32874617-05eb-448b-a646-de2fa3ecdacf tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.222733 Aug 27 20:50:18.790013 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 177/318] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:18 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:18.801756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02bc9f36-e9cb-4138-bf09-965959207344 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:18.869763 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02bc9f36-e9cb-4138-bf09-965959207344 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.072088 Aug 27 20:50:18.872977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 178/319] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:18.884735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e738978-7b51-4417-92ec-7ece15aabc83 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1660313969"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:18.893038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-6e738978-7b51-4417-92ec-7ece15aabc83 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid 7d86f96e-6c86-4a8a-ace5-18facd2d3219 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:18.934648 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e738978-7b51-4417-92ec-7ece15aabc83 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054574 Aug 27 20:50:18.936253 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 179/320] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:18.995834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:19.135217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1643623-5aca-492c-912d-0d482608fe10 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 2049 microversion: 2.25 time: 0.899838 Aug 27 20:50:19.137069 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 142/321] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:18 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 2049 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:19.172175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:19.173141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:19.194159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.195171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.196774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.198927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.201196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.202237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.344080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91b05f6-c9cb-4e47-b940-155192c9821c tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:19.350577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b91b05f6-c9cb-4e47-b940-155192c9821c tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91b05f6-c9cb-4e47-b940-155192c9821c tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 39 Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:19.352435 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: {"add_host": {"host": "nch1-master-1"}} Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:19.353603 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch1-master-1'}}} Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:19.354318 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 20:50:19.355396 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:19.356757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91b05f6-c9cb-4e47-b940-155192c9821c tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:19.360088 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b91b05f6-c9cb-4e47-b940-155192c9821c tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.409457 Aug 27 20:50:19.361416 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 180/322] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:18 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:19.375072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f791e927-8e41-4728-89d3-3c267b9742bf", "name": "network-vif-plugged", "status": "completed", "tag": "137ce93d-2cf3-4c18-9644-36698cbeb55d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:19.401060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.401818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.403100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.431718 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] Creating event network-vif-plugged:137ce93d-2cf3-4c18-9644-36698cbeb55d for instance f791e927-8e41-4728-89d3-3c267b9742bf on nch2-master-1 Aug 27 20:50:19.443198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-15e67dd0-cdbb-480a-8029-51158c090541 req-27966c53-f9c0-48a9-b41c-e575df4d46ac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078614 Aug 27 20:50:19.447100 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 181/323] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:19.457745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:19.461485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:19.478922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.478922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.484574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.493629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.502912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.503589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.539699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:19.811119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:19.827450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:19.831452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:19.846559 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-349c0536-29a5-416f-b5c0-5efa760a2bd2 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1416 microversion: 2.75 time: 0.398063 Aug 27 20:50:19.847981 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 182/324] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:19 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1416 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:19.863683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-360f5467-e63d-4dbe-ae14-5715bb2bfcbb tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:19.907585 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-360f5467-e63d-4dbe-ae14-5715bb2bfcbb tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058134 Aug 27 20:50:19.908716 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 183/325] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:19 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:19.918861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:19.919879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:19.931838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.936941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.942923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:19.943992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:19.944661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:19.945247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.075176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:20.124098 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e68bb5e2-920b-4ccd-9d1a-7749b1384062 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 2049 microversion: 2.25 time: 0.959289 Aug 27 20:50:20.129067 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 143/326] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:19 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 2049 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:20.135163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c481db73-0a4d-4d80-b362-16e2ae5b3e78 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-510724879"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.173302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-c481db73-0a4d-4d80-b362-16e2ae5b3e78 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid cfff84b9-e56b-46b6-a2cb-14efd088e2c9 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:20.209449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c481db73-0a4d-4d80-b362-16e2ae5b3e78 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078158 Aug 27 20:50:20.210956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 144/327] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:20.223526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:20.231569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.232065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.232499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.236847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.239010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.240994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.297178 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bece8ea0-2d05-41d0-8d41-da6620d349af tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084543 Aug 27 20:50:20.325979 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 145/328] 10.222.0.40 () {60 vars in 1217 bytes} [Sat Aug 27 20:50:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:20.332839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1181318372"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.362412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.364575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.365200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.389261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.390080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.390547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.401933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:20.410101 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1181318372 could not be found. Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 58 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:50:20.415031 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: {"add_host": {"host": "tempest-nonexist_host-1181318372"}} Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:50:20.416350 ncdv-master-1 devstack@n-api.service[140433]: exception: Compute host tempest-nonexist_host-1181318372 could not be found. Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1181318372'}}} Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1181318372' is not mapped to any cell Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.417153 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 20:50:20.419750 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1181318372 could not be found. Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1181318372 could not be found. Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.421827 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1181318372 could not be found. Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1181318372 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9a7a18e-fca4-4daa-941c-5cdb68cba529 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.088586 Aug 27 20:50:20.424669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 146/329] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:20.427310 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9386559e-bf3f-4575-bd30-c74439bf1639 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.506747 Aug 27 20:50:20.427310 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 184/330] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:19 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:20.430899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.433439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:20.437342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94a3a1b0-055f-4708-8574-f0cdb53b4880 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:20.446804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.449765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.451255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.457645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:20.458616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:20.460875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:20.494018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94a3a1b0-055f-4708-8574-f0cdb53b4880 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.067116 Aug 27 20:50:20.501895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 185/331] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:20 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:20.513057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-138d4745-1fe9-41b1-8163-ed40348164e1 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-138d4745-1fe9-41b1-8163-ed40348164e1 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 283 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:20.522715 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.524117 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:50:20.524706 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:20.525284 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.526211 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.527037 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:50:20.527037 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:50:20.527037 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:50:20.527037 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.527037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-138d4745-1fe9-41b1-8163-ed40348164e1 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:20.528751 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-138d4745-1fe9-41b1-8163-ed40348164e1 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021581 Aug 27 20:50:20.528751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 186/332] 10.222.0.40 () {60 vars in 1165 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:20.551665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ee0d16f-e8b5-4886-9a50-772185f23829 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ee0d16f-e8b5-4886-9a50-772185f23829 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 27 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:20.562162 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: {"aggregate": {"name": ""}} Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:20.563522 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '' Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:20.564244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 20:50:20.565585 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.567036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ee0d16f-e8b5-4886-9a50-772185f23829 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:20.567036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ee0d16f-e8b5-4886-9a50-772185f23829 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.025749 Aug 27 20:50:20.573387 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 187/333] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:50:20.578316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0783ff1e-8a88-45b5-b258-dd2fe119388f tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1185735815"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.581997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0783ff1e-8a88-45b5-b258-dd2fe119388f tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0783ff1e-8a88-45b5-b258-dd2fe119388f tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 60 Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:20.594476 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: {"aggregate": {"name": "tempest-test_aggregate-1185735815"}} Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:20.595843 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1185735815'}}} Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:20.596584 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:20.597640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 20:50:20.598883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:20.598883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0783ff1e-8a88-45b5-b258-dd2fe119388f tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:20.598883 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0783ff1e-8a88-45b5-b258-dd2fe119388f tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021753 Aug 27 20:50:20.604971 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 188/334] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:20.609952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92ace04b-e0b1-4185-a585-a429f2cb1a2d tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2036882742"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:20.622389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-92ace04b-e0b1-4185-a585-a429f2cb1a2d tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid cd7130df-2b83-499d-a02d-a30a6ce94f85 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:20.677175 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92ace04b-e0b1-4185-a585-a429f2cb1a2d tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070361 Aug 27 20:50:20.678013 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 189/335] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:20.706760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'flavor' on Instance uuid 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:20.847307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Going to try to live migrate instance to nch2-master-1 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:50:21.118593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d57b0f18-5bdb-4d08-8f86-d5cabf670bd8 tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1237352037", "id": 2040505240, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:21.154318 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d57b0f18-5bdb-4d08-8f86-d5cabf670bd8 tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.472606 Aug 27 20:50:21.160174 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 190/336] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/flavors => generated 449 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:21.171751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2036882742"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:21.183260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid eaae5978-61f1-4843-9a7a-c30e6535e053 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:21.210268 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2036882742 already exists. Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 60 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:21.212080 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: {"aggregate": {"name": "tempest-test_aggregate-2036882742"}} Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:21.213474 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate tempest-test_aggregate-2036882742 already exists. Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2036882742'}}} Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 20:50:21.214266 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2036882742 already exists. Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:21.215382 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2036882742 already exists. Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2036882742 already exists. Aug 27 20:50:21.216777 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:21.218970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2036882742 already exists. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:21.220853 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aea3c596-1c83-4194-b347-ec66294e930b tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.057583 Aug 27 20:50:21.222560 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 191/337] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:21 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:21.231990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:21.232947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:21.247726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:21.249912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:21.250004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:21.253329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:21.255419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:21.255891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:21.412771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:21.429467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:21.431365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:21.445958 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01afee93-cb9f-4bee-a4eb-188b1d97bf36 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1416 microversion: 2.75 time: 0.220649 Aug 27 20:50:21.446841 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 192/338] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:21 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1416 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:21.924177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a78ca2b-3167-4f52-86ae-7c34b009e609 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:21.933377 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a78ca2b-3167-4f52-86ae-7c34b009e609 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] 10.222.0.40 "GET /compute/v2.1/flavors/2040505240" status: 200 len: 449 microversion: 2.55 time: 0.485304 Aug 27 20:50:21.934180 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 193/339] 10.222.0.40 () {60 vars in 1199 bytes} [Sat Aug 27 20:50:21 2022] GET /compute/v2.1/flavors/2040505240 => generated 449 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:21.948838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-420626ed-c90d-4637-abf5-511cf70c23f7 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:22.004302 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-420626ed-c90d-4637-abf5-511cf70c23f7 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.068891 Aug 27 20:50:22.005489 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 194/340] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:21 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:22.021497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:22.022583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:22.043677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:22.044186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:22.044650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:22.045316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:22.045768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:22.046318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:22.538935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:22.568553 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc89dd02-efb4-48c4-a7d1-cf2f2e4727b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1314 microversion: 2.1 time: 0.561706 Aug 27 20:50:22.569926 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 195/341] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:22 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:22.575169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a170aff2-b824-44a5-a1cf-c8a78d42b7fd tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] Action: 'update', calling method: .version_select at 0x7ff85510dd30>, body: {"flavor": {"description": "new"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:22.647989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a170aff2-b824-44a5-a1cf-c8a78d42b7fd tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/2040505240" status: 200 len: 450 microversion: 2.55 time: 0.076373 Aug 27 20:50:22.649111 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 196/342] 10.222.0.40 () {62 vars in 1219 bytes} [Sat Aug 27 20:50:22 2022] PUT /compute/v2.1/flavors/2040505240 => generated 450 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:22.654592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-16d01309-d468-4948-9792-dffe1facf195 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-192337304"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:22.661155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-16d01309-d468-4948-9792-dffe1facf195 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid ef1505fb-1e00-4a8a-a325-8126144c9c11 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:22.693292 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-16d01309-d468-4948-9792-dffe1facf195 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041433 Aug 27 20:50:22.694502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 197/343] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:22.829097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=19 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:22.870021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-707200815", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:22.932966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:23.178414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:23.178954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:23.179713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:23.180360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:23.180975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:23.191498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.192006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.192430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.193225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.193684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.194110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.217488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Getting quotas for project 3937d675725a43fbb31c3b2e231a93f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:23.223636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Getting quotas for user 55343911d6f24e9fbd4e222b911edc45 and project 3937d675725a43fbb31c3b2e231a93f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:23.235470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:23.238943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:23.289074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19f9a697-9ebe-4141-9ca7-532a9df9376f tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593372 Aug 27 20:50:23.290291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 198/344] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:50:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:50:23.295099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.296335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:23.303658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.304360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.304935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.305803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.306385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.306934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.413053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:23.440478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:23.446859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:23.459328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:23.461715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a621f75-5a44-4da3-b1a2-f8def0de41a8 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1437 microversion: 2.75 time: 0.170109 Aug 27 20:50:23.482642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 199/345] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:23 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1437 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:23.490047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68927339-e5a4-472e-9b57-9699b14d8783 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.519031 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68927339-e5a4-472e-9b57-9699b14d8783 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.035161 Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 200/346] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:50:23 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cac6f0c-34d1-4832-9c7c-6e7121de0d7b tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4cac6f0c-34d1-4832-9c7c-6e7121de0d7b tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cac6f0c-34d1-4832-9c7c-6e7121de0d7b tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:23.531903 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:23.532954 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '15'} Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:23.533866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:23.535048 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cac6f0c-34d1-4832-9c7c-6e7121de0d7b tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4cac6f0c-34d1-4832-9c7c-6e7121de0d7b tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.011018 Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 201/347] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:23 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7c5064b-eb1d-466d-8d1c-6c20e10007b4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.540755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b7c5064b-eb1d-466d-8d1c-6c20e10007b4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:23.622644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b7c5064b-eb1d-466d-8d1c-6c20e10007b4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:23.635502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7c5064b-eb1d-466d-8d1c-6c20e10007b4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1222 microversion: 2.1 time: 0.100355 Aug 27 20:50:23.637451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 202/348] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:23 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:23.645499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:23.648708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:23.658726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.659246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.660304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.660980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.661436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.661863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.718293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c0a93476-509f-4f82-9ef8-16273dfb86bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c/action" status: 202 len: 0 microversion: 2.25 time: 3.299002 Aug 27 20:50:23.719221 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 147/349] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:50:20 2022] POST /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c/action => generated 0 bytes in 3301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:50:23.728662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82ee2894-fe38-4b8f-8e14-b60149e2f13a tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.791490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:23.792177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:23.792970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:23.793687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:23.794282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:23.821540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82ee2894-fe38-4b8f-8e14-b60149e2f13a tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.097028 Aug 27 20:50:23.823058 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 148/350] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:23 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:23.857752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa1ed65b-fcde-44fe-add2-388826c96731 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.902009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:23.921201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.922253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.924045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.925173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:23.926298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:23.928705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:23.970115 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa1ed65b-fcde-44fe-add2-388826c96731 tempest-FlavorsV255TestJSON-1326709250 tempest-FlavorsV255TestJSON-1326709250-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.139284 Aug 27 20:50:23.970722 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 149/351] 10.222.0.40 () {60 vars in 1166 bytes} [Sat Aug 27 20:50:23 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:23.989526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:23.991636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:24.018410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.023058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.024967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.028702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.029396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.030004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.233603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.246379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.248103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.256996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-537c446a-d114-4e72-9ee7-4b47f3ffbd8e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "POST /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6/action" status: 202 len: 1494 microversion: 2.75 time: 0.617262 Aug 27 20:50:24.258264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 203/352] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:50:23 2022] POST /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6/action => generated 1494 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 20:50:24.286774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:24.287865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:24.297776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.298474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.299158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.300271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.301235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.308886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.647022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.658129 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c04f25c-8468-4d9e-aad0-5da9f3ef2a8d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1464 microversion: 2.1 time: 0.678573 Aug 27 20:50:24.672441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 150/353] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:23 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1464 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:24.677199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32b9278e-a987-46a1-a5bf-8d7a7adc7319 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:24.691049 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-32b9278e-a987-46a1-a5bf-8d7a7adc7319 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32b9278e-a987-46a1-a5bf-8d7a7adc7319 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:50:24.693119 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: exception: Aggregate -1 could not be found. Aug 27 20:50:24.694693 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '-1'} Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:24.695539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:24.696830 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 20:50:24.698187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:24.699523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32b9278e-a987-46a1-a5bf-8d7a7adc7319 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:24.700649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32b9278e-a987-46a1-a5bf-8d7a7adc7319 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027159 Aug 27 20:50:24.701538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 151/354] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:24 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:24.707509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-696a6182-a132-40dd-9dc3-330807d79478 tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:24.744942 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-696a6182-a132-40dd-9dc3-330807d79478 tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/2040505240" status: 202 len: 0 microversion: 2.55 time: 0.041840 Aug 27 20:50:24.745926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 152/355] 10.222.0.40 () {60 vars in 1202 bytes} [Sat Aug 27 20:50:24 2022] DELETE /compute/v2.1/flavors/2040505240 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:50:24.753996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:24.756711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:24.763653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.764465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.765099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.766071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.766728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.767371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.796965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:24.851264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.861124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.862951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.865521 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44cc4a17-a044-4801-8104-ba74a4defca4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.605826 Aug 27 20:50:24.866460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 204/356] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:24 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:24.887798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.901498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.901741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:24.902291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:24.903104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:24.908973 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8513d642-b297-4ac6-b7f0-4ba642d89993 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.161807 Aug 27 20:50:24.911208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.912146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.912789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.913699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:24.914343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:24.914962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:24.923818 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 153/357] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:24 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:25.016228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:25.024539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01a9a9f5-e89e-4824-a5b6-f4daa738768b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1274 microversion: 2.1 time: 0.128499 Aug 27 20:50:25.035798 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 205/358] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:24 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:25.043058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb8a8fcf-a051-4c56-b64c-3a0cd22224b5 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-624070649"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:25.046583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-eb8a8fcf-a051-4c56-b64c-3a0cd22224b5 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid 57b6aeb2-4c41-4797-8be8-9d35fa3d1287 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:25.097804 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb8a8fcf-a051-4c56-b64c-3a0cd22224b5 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060717 Aug 27 20:50:25.101698 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 206/359] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:25.108887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81f5b19b-4e6e-441f-8e22-49450643735e tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.135831 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81f5b19b-4e6e-441f-8e22-49450643735e tempest-FlavorsV255TestJSON-1766720286 tempest-FlavorsV255TestJSON-1766720286-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.032511 Aug 27 20:50:25.149630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 207/360] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:50:25 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:25.154438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=83 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:25.161184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6bd91d7-4129-491f-a6ad-4788981f89d5 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.162851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6bd91d7-4129-491f-a6ad-4788981f89d5 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6bd91d7-4129-491f-a6ad-4788981f89d5 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:25.164600 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 20:50:25.166084 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '16'} Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:25.166897 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 20:50:25.168169 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.169352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6bd91d7-4129-491f-a6ad-4788981f89d5 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:25.170334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6bd91d7-4129-491f-a6ad-4788981f89d5 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.019503 Aug 27 20:50:25.174191 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 208/361] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:25 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:25.180603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e8ec553-131c-47bf-a775-26f7e6c1ba2c tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.237032 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e8ec553-131c-47bf-a775-26f7e6c1ba2c tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.061100 Aug 27 20:50:25.238369 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 209/362] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:25 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 20:50:25.249637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64eec891-8e9c-41ca-b3d4-2ace40214c91 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.266852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-64eec891-8e9c-41ca-b3d4-2ace40214c91 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64eec891-8e9c-41ca-b3d4-2ace40214c91 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:25.268860 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: exception: Aggregate -1 could not be found. Aug 27 20:50:25.270050 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '-1'} Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.270699 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 20:50:25.271991 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.276283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64eec891-8e9c-41ca-b3d4-2ace40214c91 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:25.280522 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64eec891-8e9c-41ca-b3d4-2ace40214c91 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035131 Aug 27 20:50:25.281699 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 210/363] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:50:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:25.295320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b2ff28f-876c-4065-bdb2-2efc4167bf97 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.317486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b2ff28f-876c-4065-bdb2-2efc4167bf97 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b2ff28f-876c-4065-bdb2-2efc4167bf97 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:25.319064 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 20:50:25.320257 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:25.320906 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.321963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b2ff28f-876c-4065-bdb2-2efc4167bf97 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:25.323605 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b2ff28f-876c-4065-bdb2-2efc4167bf97 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.034828 Aug 27 20:50:25.323605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 211/364] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:50:25 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:50:25.350127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74750b06-d6f3-4d34-85a3-76250cc0fb30 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1071319599"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:25.358183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-74750b06-d6f3-4d34-85a3-76250cc0fb30 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid 40e32345-060e-4c9a-a122-cc7eaec99c1f for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:25.416295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74750b06-d6f3-4d34-85a3-76250cc0fb30 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.085331 Aug 27 20:50:25.420484 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 212/365] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:25.431643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e2471db-9c68-4f19-8a61-8f54a5aafd08 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:25.459864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e2471db-9c68-4f19-8a61-8f54a5aafd08 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.462819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e2471db-9c68-4f19-8a61-8f54a5aafd08 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.463505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e2471db-9c68-4f19-8a61-8f54a5aafd08 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:25.465702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.472671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'deleted': False, 'project_id': '7fdcc227e13c423fba84dde03f3a4229'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:25.496340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.501971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.502440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:25.504725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.505229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.506900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:25.710232 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e2471db-9c68-4f19-8a61-8f54a5aafd08 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.282276 Aug 27 20:50:25.717593 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 213/366] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:25.725876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69684378-4914-4880-8988-f345cc1a85d6 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:25.732311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-69684378-4914-4880-8988-f345cc1a85d6 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0fe3abcbc5564a98929aa641bc3e71a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8c717bd48f4ddf9ab30f3efdcc46df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69684378-4914-4880-8988-f345cc1a85d6 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Request method failure captured: Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 42 Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOHh-sAvzSgXyHNjK_eclNlC-zTLmKre8jxiJuuSwj2abmWVtsOftUS9tqhZEYskNKdp7Rw9yoqB_ai3Z_pKZmA3_zMqAdT4q6NqyDOgb_lULaIVB-Nt36T5mD2fnZbSkOSbvnoEblXWOoSOlGuBUXst0O0N0OdGl0m88xDiVfJYlo Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:25.745868 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f8c717bd48f4ddf9ab30f3efdcc46df", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f8c717bd48f4ddf9ab30f3efdcc46df"}]}] Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f8c717bd48f4ddf9ab30f3efdcc46df Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327 Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0fe3abcbc5564a98929aa641bc3e71a3 Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1857475327-project Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: {"remove_host": {"host": "nch1-master-1"}} Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:25.747455 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:25.748370 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 20:50:25.749598 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:25.751981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69684378-4914-4880-8988-f345cc1a85d6 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:25.753032 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69684378-4914-4880-8988-f345cc1a85d6 tempest-AggregatesAdminNegativeTestJSON-1857475327 tempest-AggregatesAdminNegativeTestJSON-1857475327-project] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.032014 Aug 27 20:50:25.754160 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 214/367] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:50:25.775005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64bf6740-01f5-461e-878f-9fcba23deefd tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:25.819887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64bf6740-01f5-461e-878f-9fcba23deefd tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.823429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64bf6740-01f5-461e-878f-9fcba23deefd tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.824427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64bf6740-01f5-461e-878f-9fcba23deefd tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:25.860453 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b5feea19-bfe7-4e0d-ac3a-9fefe55fd5e5 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.934782 Aug 27 20:50:25.861769 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 154/368] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:50:24 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:50:25.895686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:25.904160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'deleted': False} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:25.915702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.916421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.917077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:25.918303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:25.919186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:25.919805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.077878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64bf6740-01f5-461e-878f-9fcba23deefd tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.317341 Aug 27 20:50:26.079226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 215/369] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:26.100521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:26.103563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:26.125022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.125524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.129674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.132085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.132640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.139159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.164221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:50:26.307210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.307654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.308100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.531565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.549287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.552875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.554722 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19cfe853-7e3e-4254-8949-96a26861c9d8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.473397 Aug 27 20:50:26.556439 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 216/370] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:26 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:26.562343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:26.563392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:26.575197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.577731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.578445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.579610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.580316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.580947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.817637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.839324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.850671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:26.867271 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28a7a726-d19d-48c7-b3cb-39dcaa1f1d93 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.309494 Aug 27 20:50:26.890188 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 217/371] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:26 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:26.890477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:26.891845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:26.930111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.931024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.932939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:26.934182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:26.934994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:26.935820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.164565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:27.174173 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-714a4a95-17a7-49c8-aacb-f3cf479f5be1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1280 microversion: 2.1 time: 0.296926 Aug 27 20:50:27.190005 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 218/372] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:26 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:27.196190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f43f8af6-cbba-4c69-b1c1-bba0d528d96d tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:27.224027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f43f8af6-cbba-4c69-b1c1-bba0d528d96d tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.031942 Aug 27 20:50:27.225385 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 219/373] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:27.234636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f075ae6-7714-4f7c-92b5-5b5a59eb13ce tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-226883705"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:27.239752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.aggregate [None req-2f075ae6-7714-4f7c-92b5-5b5a59eb13ce tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Generated uuid fb4ad530-ef0f-4951-8a03-2d968ed4bbf7 for aggregate {{(pid=140434) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 20:50:27.272595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f075ae6-7714-4f7c-92b5-5b5a59eb13ce tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041604 Aug 27 20:50:27.274765 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 220/374] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 20:50:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:27.289856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:27.308264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.308990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.309629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.325854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.326517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.327093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.339651 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.compute.aggregates [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 20:50:27.340175 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Request method failure captured: Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 42 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOJc9z3AKjIzuEkuAngSA4DxvBGwk29o2Tme2E-Po7gEqbI2zKH5-LWeDfdjj8pT6pjlvbmH03NVbextVC9Gz1UtMEEc11FpeUe0Jmd_p1KWkifBxDHQDJZF9V9dBgoWItTToV57BW_z4fvHEQKmnz5rYuRIe3FDPwdUPFCvR1_oM0 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:50:27.342561 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5f9669e87f2f4b3e8da558efb35f298e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5f9669e87f2f4b3e8da558efb35f298e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5f9669e87f2f4b3e8da558efb35f298e"}]}] Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5f9669e87f2f4b3e8da558efb35f298e Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-945005375 Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f77fa8837eaa470097a217f4e8675887 Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: {"remove_host": {"host": "nonexist_host"}} Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:27.344028 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 20:50:27.344961 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 20:50:27.346250 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.347888 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 27 20:50:27.349197 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:27.352624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:27.353702 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82c8f253-5787-41f6-bcca-bf63665fb1b2 tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.068849 Aug 27 20:50:27.357896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 221/375] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 20:50:27 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:50:27.364363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ce01c707-5c7a-476e-8761-a3190455954f tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:27.365188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-adf81aa1-1ba3-41a3-bfff-74115014d7aa tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11202 microversion: 2.1 time: 1.484131 Aug 27 20:50:27.381418 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 155/376] 10.222.0.40 () {58 vars in 1171 bytes} [Sat Aug 27 20:50:25 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11202 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:27.408269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:27.414247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'deleted': False, 'project_id': '7fdcc227e13c423fba84dde03f3a4229'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:27.425251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.425740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.426385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.427120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.427686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.427812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ce01c707-5c7a-476e-8761-a3190455954f tempest-AggregatesAdminNegativeTestJSON-945005375 tempest-AggregatesAdminNegativeTestJSON-945005375-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.068424 Aug 27 20:50:27.428058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.428443 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 222/377] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 20:50:27.431675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=31 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:27.456871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c", "name": "network-vif-unplugged", "status": "completed", "tag": "de4c6c4c-48ba-4c87-9fb2-90044336c2dc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:27.477860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.478740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.479378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.514842 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfc55c1c-bb6d-4068-8d7d-57aa25edee99 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?tenant_id=51f5f4f721bb419693f552f7aba3effd" status: 200 len: 15 microversion: 2.1 time: 0.111546 Aug 27 20:50:27.517143 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] Creating event network-vif-unplugged:de4c6c4c-48ba-4c87-9fb2-90044336c2dc for instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c on nch1-master-1 Aug 27 20:50:27.520697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 156/378] 10.222.0.40 () {58 vars in 1231 bytes} [Sat Aug 27 20:50:27 2022] GET /compute/v2.1/servers/detail?tenant_id=51f5f4f721bb419693f552f7aba3effd => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:50:27.543321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:27.548729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-22cb2cff-fec0-4178-801b-046a3053bf06 req-2201bdeb-10cc-4e8e-a23d-cf4d58160de7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096378 Aug 27 20:50:27.551648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'tenant_id': '51f5f4f721bb419693f552f7aba3effd', 'deleted': False} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:27.553652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 223/379] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:27.571608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.572098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.573800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.573800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.575597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.576645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.584065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:27.590025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:27.615959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.617953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.618501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.619767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.622919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.623510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:27.688364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:50:27.891683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:27.894909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:27.896202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.329452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.347764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.349139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.350395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a67ce45a-cfd4-4de7-a42d-78f0c45fc873 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.773809 Aug 27 20:50:28.350979 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 224/380] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:27 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:28.367606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:28.368243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:28.388929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.389664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.390302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.391051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.391561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.391992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.454639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:28.596452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.629598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.638669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.654265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a430e5a9-029a-40f8-8322-847820b819f7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.292647 Aug 27 20:50:28.655499 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 225/381] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:28 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:28.676506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:28.679513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:28.685119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a09e759d-789c-47cf-9c1c-4341fa530dc0 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51f5f4f721bb419693f552f7aba3effd" status: 200 len: 4825 microversion: 2.1 time: 1.145455 Aug 27 20:50:28.686573 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 157/382] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 20:50:27 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51f5f4f721bb419693f552f7aba3effd => generated 4825 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:28.691590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.692454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.692966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.693832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.694289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.694722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.722318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:28.730512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'tenant_id': '7fdcc227e13c423fba84dde03f3a4229', 'deleted': False} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:28.739016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.739826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.740749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.741930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.742563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.743140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.796786 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a8b5ab7d-9ae0-4e53-aa43-dbbe04a65923 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7fdcc227e13c423fba84dde03f3a4229" status: 200 len: 15 microversion: 2.1 time: 0.078984 Aug 27 20:50:28.797198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 158/383] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 20:50:28 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7fdcc227e13c423fba84dde03f3a4229 => generated 15 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:50:28.825412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20bcd758-357d-4e09-b5d7-0807d4c20d2a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:28.831570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20bcd758-357d-4e09-b5d7-0807d4c20d2a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.016151 Aug 27 20:50:28.837898 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 159/384] 10.222.0.40 () {58 vars in 1189 bytes} [Sat Aug 27 20:50:28 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:50:28.869979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:28.875613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:28.898676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.899512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.900416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.901827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:28.902445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:28.903051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:28.940173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:28.952770 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54b6fb57-83a3-456a-9797-3d8fdcc90440 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.292133 Aug 27 20:50:28.960287 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 226/385] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:28 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:29.041438 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78ce8100-9b90-4b65-9ae7-314453b78207 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 0 microversion: 2.1 time: 0.182914 Aug 27 20:50:29.042882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 160/386] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:50:28 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:50:29.061308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:29.073483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.074477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '51f5f4f721bb419693f552f7aba3effd'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:29.090492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.091733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.092425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.093561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.094818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.095482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.223272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:50:29.383574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:29.385486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:29.404163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.405377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.407331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.411404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.413316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.413788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.436182 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf96c633-15e6-420e-b80a-cb1fc6f283aa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.385102 Aug 27 20:50:29.447178 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 227/387] 10.222.0.40 () {58 vars in 1150 bytes} [Sat Aug 27 20:50:29 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:29.466102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:29.470998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:29.484119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.484810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.489434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.490489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.491145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.491766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.703978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5c8f125-4604-4fea-837f-c2dbe7812f5a tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 0 microversion: 2.1 time: 0.254999 Aug 27 20:50:29.705173 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 228/388] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:50:29 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:29.714154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c", "tag": "de4c6c4c-48ba-4c87-9fb2-90044336c2dc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:29.727077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.727702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.728275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.743772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] Creating event network-changed:de4c6c4c-48ba-4c87-9fb2-90044336c2dc for instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c on nch1-master-1 Aug 27 20:50:29.750781 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8b18387e-b826-41c1-980a-ce4b45075595 req-75ed3000-17e6-4578-8a2c-0dbbbff05b9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044218 Aug 27 20:50:29.752109 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 229/389] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:29.774526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:29.777541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:29.791211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.796134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.796889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.797702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:29.801114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:29.801715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:29.942769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.954678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.962067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.968962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.979240 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97af8be0-263d-4ff1-a49f-de7fbe958d52 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.605295 Aug 27 20:50:29.981334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.987701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:29.988203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 161/390] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:29 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:30.000620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:30.017038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:30.022306 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b1c9390a-9555-4605-b824-95720edf169a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.268257 Aug 27 20:50:30.043376 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 230/391] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:29 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:30.055462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.057686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.058239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.059574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.060865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.065917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.073261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:30.073914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:30.081012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.081651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.082415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.082775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.083225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.083691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.358677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:30.358677 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b888779e-f0c6-4038-a6fb-c98c199bd5ac tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.299304 Aug 27 20:50:30.363913 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 231/392] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:30 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:30.407867 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e786afa3-41da-416b-b355-ab0ecb2bb9b3 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1614 microversion: 2.1 time: 0.418336 Aug 27 20:50:30.408457 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 162/393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:29 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1614 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:30.414759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5856fe5-932a-4445-9c94-74cd6a909c48", "tag": "f89446dd-aa6e-416e-a7e0-6f82861c2785"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:30.432531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:30.434223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:30.434845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:30.451999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.452711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.453223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.453945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.456398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.473768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.474740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.475915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.476367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.482225 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] Creating event network-changed:f89446dd-aa6e-416e-a7e0-6f82861c2785 for instance d5856fe5-932a-4445-9c94-74cd6a909c48 on nch2-master-1 Aug 27 20:50:30.505655 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-690183da-4c42-43ce-b9fb-9ab240dff8ec req-3e738641-f102-449b-ae7a-1b68f98a1528 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097028 Aug 27 20:50:30.507163 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 232/394] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:30.849420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa96d925-6a6d-4f07-bdee-d49d43ddeb25 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1614 microversion: 2.1 time: 0.421968 Aug 27 20:50:30.853873 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 163/395] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:30 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1614 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:30.884933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:30.898769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:30.921390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.922318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.922860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:30.924075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:30.925233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:30.927016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.009921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:31.011806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:31.023670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.024519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.026310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.027998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.031796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.032511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.119981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:50:31.219382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac46ee8c-ad2c-4787-9580-e4b09dc0ab1f tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1337 microversion: 2.1 time: 0.342490 Aug 27 20:50:31.219973 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 233/396] 10.222.0.40 () {58 vars in 1190 bytes} [Sat Aug 27 20:50:30 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1337 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:31.230044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:31.240477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:31.255935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.256430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.256868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.257575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.258025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.258440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.452743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.469860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.472940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.488936 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7daa1959-c60d-4676-814e-d02e63c37b2d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.264380 Aug 27 20:50:31.491779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 234/397] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:31 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:31.501778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:31.506773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.521534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.523935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.525464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b8ef6c0-62c4-4984-b07d-1e68207cab44 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.519418 Aug 27 20:50:31.526800 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 164/398] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:31 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:31.532172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:31.533121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:31.557708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.558624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.560992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.561156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:50:31.564613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.569963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.570674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.574545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.575094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.575556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.576282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.576718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.577138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.599379 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-992bef17-1bec-46e6-8644-47fd715b9e57 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.105216 Aug 27 20:50:31.600022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 235/399] 10.222.0.40 () {58 vars in 1196 bytes} [Sat Aug 27 20:50:31 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:50:31.613330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:31.626753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:31.633511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.634654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.635147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.635945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.637532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.637973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.767314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:31.776503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca1fefc0-63d3-4757-ad28-7687543d4028 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.248408 Aug 27 20:50:31.777222 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 165/400] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:31 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:31.819324 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09727fca-a107-4424-9c92-91cba97c6b0b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 0 microversion: 2.1 time: 0.210349 Aug 27 20:50:31.820632 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 236/401] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:50:31 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:50:31.838859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:31.849678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:31.869579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.872497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.873210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:31.883086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:31.885684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:31.886249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.086427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:32.087610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:32.088274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:32.088882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:32.089472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:32.222313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:32.237301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.238119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.241924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.241924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.241924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.245559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.286024 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-065cc4bb-c3e8-48c5-8e62-7ae73371153b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 1067 microversion: 2.1 time: 0.458815 Aug 27 20:50:32.288548 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 166/402] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:50:31 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 1067 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 20:50:32.305065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:32.305905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:32.318364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.319031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.319650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.320578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.321179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.321897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.738511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f650430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:32.742209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.742704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.743147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.745397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.746273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.746862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.825456 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-98800153-499e-4cf6-8181-91ef379872e6 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.361783 Aug 27 20:50:32.827097 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 167/403] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 20:50:32 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:32.842730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:32.849437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:32.856266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.863819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.864473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.865232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.865694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.866837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.922155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:32.934586 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-902df108-cd67-449e-b20e-7abcb03716f1 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.633576 Aug 27 20:50:32.935720 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 237/404] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:32 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:32.942251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:32.943218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:32.950291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.951147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.951781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:32.952891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:32.953495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:32.954295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.044281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.054889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.056933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.064439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7dc43bae-6da3-42a1-86cd-06d26271141a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.236193 Aug 27 20:50:33.066544 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 168/405] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:32 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:33.078192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.079979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:33.103947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.104592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.104936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.105654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.106109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.106536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.149409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:33.313742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.324244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.332761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.334150 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d96683f0-c056-4c27-8d03-c65122c5937b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.396979 Aug 27 20:50:33.338430 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 238/406] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:32 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:33.348836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f882700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.356503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.357272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.357867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.358761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.359425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.360015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.383700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:33.392254 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ed688b5-680c-459f-866a-61efaf53f2de tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.324428 Aug 27 20:50:33.396726 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f269b1e-2adb-4727-b17f-2d29bfb15a71 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.056540 Aug 27 20:50:33.397350 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 239/407] 10.222.0.40 () {58 vars in 1139 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.404007 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 169/408] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:33.415665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f6c8940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.415665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.415665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.415665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.419981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.420525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.420975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.448841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-735c1123-782d-4160-9ee2-59fbf9c30637 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.043842 Aug 27 20:50:33.457012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 170/409] 10.222.0.40 () {58 vars in 1145 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:50:33.462852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f6945e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.467249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.468101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.468725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.469672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.470555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.471168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.501764 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-148f1986-1b4d-4854-820c-0502aca66a6f tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.042605 Aug 27 20:50:33.502988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 240/410] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.513377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f6bcaf0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.517798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.518760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.519661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.520859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.521454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.522000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.544040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:33.553654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d8884a9-fe3b-40a4-baaf-bd443413f4eb tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.043838 Aug 27 20:50:33.554777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 171/411] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.566457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f6c6a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.570790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.571119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.571631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.572402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.572859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.573279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.601226 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf84993e-d2e1-4cdb-858b-f7c35dd1ca64 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.038729 Aug 27 20:50:33.602111 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 241/412] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.613991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84fad0a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.623271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.623930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.624373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.640008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.640511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.640954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.683778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e06bb705-861a-4b92-8c84-4bf08ce39048 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.073332 Aug 27 20:50:33.684566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 172/413] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.696873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Calling method '.version_select at 0x7ff84f826dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.700986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=61 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:33.705384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.705914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.707288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.724149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.724824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.725438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.729483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:33.752960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fed49f7b-a975-4e13-bf83-17effa00e3f0 tempest-HostsAdminTestJSON-2092115759 tempest-HostsAdminTestJSON-2092115759-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.059762 Aug 27 20:50:33.753549 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 242/414] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:33.957148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:33.957767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:33.967560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.968062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.968497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:33.969201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:33.973507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:33.974005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.092520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:34.093837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:34.102203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.102847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.103452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.105820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.106437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.106941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.150826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.168939 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0d22d46-0772-414d-8c62-c878774e1b02 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.216003 Aug 27 20:50:34.188593 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 173/415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:33 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:34.224205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.234139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.235870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.243326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f071aca-bbb4-426a-80ad-a352ce956731 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.156528 Aug 27 20:50:34.260391 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 243/416] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:34 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:34.370145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:34.371293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:34.389240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.392360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.394517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.395942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.398809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.399407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.667833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.680083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.682294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.684178 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97dfe8d7-defc-466c-b878-5fb4d55b28ff tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.318901 Aug 27 20:50:34.685790 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 244/417] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:34 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:34.691846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:34.692864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:34.709610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.711401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.712107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.714042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:34.714691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:34.715277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:34.753308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8c5b421a-e1dc-4f19-96a6-55599f1ac814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Action: 'create', calling method: .version_select at 0x7ff84f69b3a0>, body: {"keypair": {"name": "tempest-keypair-1493849134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jg4t6T2pAmc10tL0wM3OXiCSQr14POAZkR8zwsEvfrFL6YKVEaJM01B1aKtYMLY3JTOfgi2YiPBaSZY55aOG4IxGhMEZ2QqImzynyMockSXalI0VVbVi9HFunZUxegQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:34.788196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-8c5b421a-e1dc-4f19-96a6-55599f1ac814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for project 96fc49f44f7a4bcca55eae824956691c. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:34.804266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-8c5b421a-e1dc-4f19-96a6-55599f1ac814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for user 9f6ceb86c4584847aa1ec7631644a264 and project 96fc49f44f7a4bcca55eae824956691c. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:34.867838 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8c5b421a-e1dc-4f19-96a6-55599f1ac814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.677311 Aug 27 20:50:34.869000 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 174/418] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:50:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:34.927987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:34.956290 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2a7370d-03b8-4ddc-b512-ea140b6bde77 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.267549 Aug 27 20:50:34.958662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 245/419] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:34 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:35.196674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:35.197348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:35.205588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.208013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.208457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.211721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.215389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.216214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.520362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1441163709", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:35.592661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:35.608187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84aa54db-77bd-44f4-bd96-ca95ea321f00 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.413929 Aug 27 20:50:35.619887 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 246/420] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:35 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:35.627937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:35.637741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:35.638662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:35.648877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.649992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.650592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.653018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.654347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.656042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.818649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:35.843388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:35.868390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:35.905534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff1cc565-f1c9-427d-95ba-b0fafc002bfb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.262891 Aug 27 20:50:35.906298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 247/421] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:35 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:35.941507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:35.945736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:35.960190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.962189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.962904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.964563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:35.965280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:35.968990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:35.998486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:35.999196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:35.999806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:36.000317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:36.000834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:36.016352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.019755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.020365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.021535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.023555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.024512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.062346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Getting quotas for project cd9abafae3214a60a0117480d12d6b06. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:36.068564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Getting quotas for user 83653c8d8f0b4973b8cb91f2375a9b98 and project cd9abafae3214a60a0117480d12d6b06. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:36.089695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:36.092924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:36.200548 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-22f52231-4ff0-4966-b61d-f04e0ab15c6b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166497 Aug 27 20:50:36.202977 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 175/422] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 20:50:36.218541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:36.220374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:36.237082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.238823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.240034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.241440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.242284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.243003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.549979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:36.561582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:36.568131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:36.573073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:36.577865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-756adc41-96f8-47aa-9c97-e23d55e1616f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.669232 Aug 27 20:50:36.578464 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 248/423] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:35 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:36.585069 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-318d0bd0-e197-48bb-965d-b038c6887b42 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.380425 Aug 27 20:50:36.592273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 176/424] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:36 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:36.606577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b68315f-3a86-404b-94bd-0bff1e805d98 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:36.609308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b68315f-3a86-404b-94bd-0bff1e805d98 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:36.636151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:36.636836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:36.655672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.656648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.657185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.658116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.660077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.660633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.770125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b68315f-3a86-404b-94bd-0bff1e805d98 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:36.782819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b68315f-3a86-404b-94bd-0bff1e805d98 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1220 microversion: 2.1 time: 0.203261 Aug 27 20:50:36.784111 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 249/425] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:36 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:36.936587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:36.937671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:36.947639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.948135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.948568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.949275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:36.949726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:36.950155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:36.994310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:37.005544 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0bedc610-2479-4b5e-a5ab-9783c8af272c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.372154 Aug 27 20:50:37.023930 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 177/426] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:36 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:37.118697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:37.141369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:37.149889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:37.167127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c968fd9-1a86-44c6-ad21-67ac333208f1 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.236602 Aug 27 20:50:37.168516 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 250/427] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:36 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:37.609324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:37.616917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:37.622575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:37.623626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:37.640710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:37.643044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:37.644461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:37.644950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:37.646058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:37.646523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:37.647426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:37.648033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:37.648452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:37.648610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:37.649229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:37.649663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:37.958206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:37.992061 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96da7768-769b-4b2b-a7bd-b71a3ef3e4df tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.388427 Aug 27 20:50:37.993636 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 251/428] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:37 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:38.015879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:38.019174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:38.030948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.035079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.035977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.037027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.040299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.048032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.048558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.076093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.078603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.079902 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-043b4175-e3d0-4eb8-b8ee-373bf3bf109d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.481293 Aug 27 20:50:38.097430 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 178/429] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:37 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:38.105741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5856fe5-932a-4445-9c94-74cd6a909c48", "name": "network-vif-plugged", "status": "completed", "tag": "f89446dd-aa6e-416e-a7e0-6f82861c2785"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:38.118616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.119259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.119880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.134351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] Creating event network-vif-plugged:f89446dd-aa6e-416e-a7e0-6f82861c2785 for instance d5856fe5-932a-4445-9c94-74cd6a909c48 on nch2-master-1 Aug 27 20:50:38.142399 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-11516591-6cd0-4896-90ed-8093e1cef590 req-84c1b3a7-94f3-4076-a2f2-f2ff068170dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040192 Aug 27 20:50:38.148414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.149244 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 179/430] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:38.156768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:38.157899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:38.172673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.173599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.174306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.176068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.176810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.178012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.192649 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2caf7721-15a3-4d80-badb-6341a4f3efd1 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1280 microversion: 2.1 time: 0.193001 Aug 27 20:50:38.209560 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 252/431] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:37 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:38.235245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:38.238829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:38.263665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.270098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.271936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.272964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:38.274721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:38.275908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:38.490382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.516863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.518838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.533403 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e2af9b5-8e4b-41fb-999f-9cfcae3d9d79 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.322433 Aug 27 20:50:38.534669 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 253/432] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:38 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:38.645108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:38.654508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d5670117-c59e-4d03-904f-91317de5b5f5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.503362 Aug 27 20:50:38.655095 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 180/433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:38 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:38.939544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20e78e70-a630-4fb9-8b20-28835a30c165 tempest-InstanceUsageAuditLogTestJSON-2132569274 tempest-InstanceUsageAuditLogTestJSON-2132569274-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:38.951870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-815784319", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "e6cdac53-285c-4679-8aac-b49067522b09"}], "security_groups": [{"name": "tempest-securitygroup--305674788"}], "key_name": "tempest-keypair-1493849134", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:38.962214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20e78e70-a630-4fb9-8b20-28835a30c165 tempest-InstanceUsageAuditLogTestJSON-2132569274 tempest-InstanceUsageAuditLogTestJSON-2132569274-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 20:50:38" status: 200 len: 318 microversion: 2.1 time: 0.164424 Aug 27 20:50:38.963450 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 254/434] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 20:50:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2020%3A50%3A38 => generated 318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:38.976565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-666c956a-ae16-4bc3-a44f-7fece895bf23 tempest-InstanceUsageAuditLogTestJSON-2132569274 tempest-InstanceUsageAuditLogTestJSON-2132569274-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:38.993958 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-666c956a-ae16-4bc3-a44f-7fece895bf23 tempest-InstanceUsageAuditLogTestJSON-2132569274 tempest-InstanceUsageAuditLogTestJSON-2132569274-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021037 Aug 27 20:50:38.994708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 255/435] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:50:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:39.022395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:39.023301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:39.030362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.031206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.031935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.032909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.034511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.035215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.103062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] validate_networks() for [('e6cdac53-285c-4679-8aac-b49067522b09', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:39.457025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:39.466956 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-021d35cb-1c6f-4cb5-9c4a-e51313915f4e tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1322 microversion: 2.1 time: 0.452767 Aug 27 20:50:39.468350 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 256/436] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:39 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:39.474319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:39.475137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:39.482140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.482845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.483525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.484377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.484976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.485548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.808734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:39.823228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:39.824960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:39.826457 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-372626c2-6487-4e64-a2fa-7088c71a0bfc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1567 microversion: 2.25 time: 0.356947 Aug 27 20:50:39.827168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 257/437] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:39 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:39.842060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:39.842060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:39.851634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.852803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.853627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.855280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.856210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.856846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.857826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:39.858319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:39.858714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:39.859306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:39.859901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:39.880916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.884250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.884721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.887716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:39.888198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:39.888627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:39.916643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for project 96fc49f44f7a4bcca55eae824956691c. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:39.921268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for user 9f6ceb86c4584847aa1ec7631644a264 and project 96fc49f44f7a4bcca55eae824956691c. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:39.935754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:39.938293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:40.013553 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82d112fd-9e9b-4ecb-8c8d-c55be739d6f6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064809 Aug 27 20:50:40.014592 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 181/438] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:50:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:50:40.027901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.030901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.052167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.052782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.053312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.054520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.055330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.057639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.061776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.073704 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c348cb28-46fd-4abe-b838-3eb6557a6e02 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.244732 Aug 27 20:50:40.074328 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 258/439] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:39 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:40.079388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.080228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.087554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.088350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.088990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.089992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.090990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.092016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.158970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.176325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.177827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.190666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d274cb4c-915e-4bca-a0e8-4527cf0c2323 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.174784 Aug 27 20:50:40.191261 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 182/440] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:40.196086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d024bb9-17ef-402a-8450-e6e7549f830b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.208475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d024bb9-17ef-402a-8450-e6e7549f830b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.348416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.359735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6b839ec-a1b4-4bff-8423-f79acf0bfcf6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.284096 Aug 27 20:50:40.380128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0d024bb9-17ef-402a-8450-e6e7549f830b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.384587 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 259/441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:40.388530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d024bb9-17ef-402a-8450-e6e7549f830b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1241 microversion: 2.1 time: 0.196013 Aug 27 20:50:40.389495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 183/442] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:40.494719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.495364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.508582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.509100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.509547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.510277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.510734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.511155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.778057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.790180 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-beb0416c-b0a2-4d60-a6a5-32231fa371e4 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1472 microversion: 2.1 time: 0.299622 Aug 27 20:50:40.804424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 260/443] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:40.814889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.815614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.824370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.824842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.825798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.826687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.827449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.828383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.852787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.853497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.865076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Request method failure captured: Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48/diagnostics HTTP/1.1 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOMuIdbfinTrrDxg-XMYHy5oqPLCIWYd3GYjd63gDSQyhW7zokvJrNAoPu7nbrvTZTMcvsD8w145wXU83begpEspTHo8cbg--N1QHu_Vpsmj3Ua73-rRenU2x_L8HwKeSSYEtnLwU1rkRnwt41IYwu-nsIzswa3u-8_KoT3uMPEAU8 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 3937d675725a43fbb31c3b2e231a93f7 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:50:40.868524 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3937d675725a43fbb31c3b2e231a93f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3937d675725a43fbb31c3b2e231a93f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3937d675725a43fbb31c3b2e231a93f7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3937d675725a43fbb31c3b2e231a93f7"}]}] Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 3937d675725a43fbb31c3b2e231a93f7 Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiagnosticsNegativeTest-927983039-project Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 55343911d6f24e9fbd4e222b911edc45 Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-927983039-project Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:50:40.870178 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': 'd5856fe5-932a-4445-9c94-74cd6a909c48'} Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:50:40.870955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 20:50:40.872390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:50:40.873497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.873497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.873497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.873757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:40.873757 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6ec47c6-e741-4a12-8255-05194729e26d tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.063782 Aug 27 20:50:40.875745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.878483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.879280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.881555 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 184/444] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48/diagnostics => generated 117 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:50:40.890844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:40.891367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:40.901296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.901805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.902255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.903154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:40.903788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:40.904359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:40.957769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:50:41.070948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.083769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.086344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.088002 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-440c224b-2089-4d6f-98ad-118bb910c6d1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1557 microversion: 2.25 time: 0.239716 Aug 27 20:50:41.089332 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 261/445] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:40 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1557 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:41.095242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784a6000-e50e-48af-8077-5e0c2442eaa8", "tag": "8d51f640-821b-46b9-a14f-932bfe1c66c5"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:41.116955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.118412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.119151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.134379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:41.138315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] Creating event network-changed:8d51f640-821b-46b9-a14f-932bfe1c66c5 for instance 784a6000-e50e-48af-8077-5e0c2442eaa8 on nch1-master-1 Aug 27 20:50:41.144795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-758519b8-5c83-498a-96a4-ab6fc85fcef2 req-ca8c5842-04ca-4f5a-b042-11ea0fdf0a52 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054121 Aug 27 20:50:41.145665 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 262/446] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:41.152699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.154211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.164203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.164873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.165545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.166579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.167191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.167892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.207513 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ed0699e-0574-44a2-9578-c2278da5818b tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 204 len: 0 microversion: 2.1 time: 0.322752 Aug 27 20:50:41.211871 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 185/447] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:50:40 2022] DELETE /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:50:41.223669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-caf78496-af40-462e-84a1-d5c988f83a32 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '.version_select at 0x7ff84f5afca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.227619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-caf78496-af40-462e-84a1-d5c988f83a32 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.228522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-caf78496-af40-462e-84a1-d5c988f83a32 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.229038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-caf78496-af40-462e-84a1-d5c988f83a32 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.247253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-caf78496-af40-462e-84a1-d5c988f83a32 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.036790 Aug 27 20:50:41.247882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 186/448] 10.222.0.40 () {60 vars in 1184 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:50:41.252678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.253895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.261381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.262255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.263066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.263845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.265160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.265623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.454521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.464267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6769e1df-a174-40d4-813d-6b3138889633 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.317026 Aug 27 20:50:41.464852 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 263/449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:41.470456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.471400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.478504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.479196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.480001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.480975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.481432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.481860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.548135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.556557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4abd9e0-e801-4996-b126-3db7d1b69245 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1478 microversion: 2.1 time: 0.307625 Aug 27 20:50:41.557133 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 187/450] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1478 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:41.561781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.562555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.569378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.570127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.570654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.571299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.571964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.572271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.583716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.592734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.594341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.601048 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7361665a-b500-485f-859e-750b4d3ef667 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.134979 Aug 27 20:50:41.611699 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 264/451] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:41.611699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.611699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.617379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.617880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.618376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.619029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.619549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.619981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.827549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:41.837940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.843957 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-200d748a-eb40-4ae0-b005-75eba96d7341 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 2049 microversion: 2.25 time: 0.285598 Aug 27 20:50:41.845200 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 188/452] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 2049 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:41.847374 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2f1d968-0aee-4d2f-a400-c7cda4a2e7ed tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.244291 Aug 27 20:50:41.848041 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 265/453] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:41.863010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:41.863867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:41.870977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.872142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.872779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.873834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:41.874583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:41.875258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:41.942683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:41.951378 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3813de9d-1070-4843-81f1-b028136d9e8f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1293 microversion: 2.1 time: 0.098794 Aug 27 20:50:41.952314 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 189/454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:41 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:41.984567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1279043270", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "50ac8041-95db-40cf-b7b5-1165467e4b65"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:42.045758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] validate_networks() for [('50ac8041-95db-40cf-b7b5-1165467e4b65', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:42.429014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:42.429651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:42.429924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:42.430576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:42.431010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:42.440355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.440853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.441480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.442132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.442608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.443030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.460413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:42.465071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for user c75d7c2bf734450886113fe48be6c44e and project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:42.478236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:42.481679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:42.488218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.488923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.495379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.496412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.497054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.497974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.498493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.499081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.504720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:42.520061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:42.560520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e309186-5d04-45a9-a60e-e8de9d4806a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.579777 Aug 27 20:50:42.561503 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 266/455] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 20:50:42.576108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.577036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.676586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.693945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.696088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.697514 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b03f49ab-2957-49f0-a55f-e1fcc086a7fd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1262 microversion: 2.25 time: 0.127451 Aug 27 20:50:42.713787 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 267/456] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:42.713787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.713787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.717535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.718040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.718610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.721008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.722559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.727891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.742433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.751134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-556cd099-72f8-4eff-b445-80fd86ece5ec tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.269256 Aug 27 20:50:42.752229 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 190/457] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:42.770426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.771046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.781560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.782064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.782522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.783234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.783922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.784786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.896719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.909525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.912559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.922264 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29678458-15fa-4566-b550-855a0c83a8c9 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.168697 Aug 27 20:50:42.923417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 191/458] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:42.935499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:42.952857 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb7247cd-9573-4ca4-b8b0-00c38496ecb1 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1478 microversion: 2.1 time: 0.251681 Aug 27 20:50:42.953489 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 268/459] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:42.958490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.959221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.966583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.967082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.969242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.970497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.970497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.970841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.978784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:42.979857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:42.988525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.989750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.990574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:42.992920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:42.993725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:42.994770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.098823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:43.114162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c03a4def-c45b-49b7-a286-c919fae2b256 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1293 microversion: 2.1 time: 0.143690 Aug 27 20:50:43.116533 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 269/460] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:43.456892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:43.468087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6adf0855-9b8e-421a-bba8-8b4050b7f48e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.530344 Aug 27 20:50:43.475943 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 192/461] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:42 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:43.719366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5856fe5-932a-4445-9c94-74cd6a909c48", "name": "network-vif-deleted", "tag": "f89446dd-aa6e-416e-a7e0-6f82861c2785"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:43.727947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:43.727947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:43.737062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.737879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.738555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.739507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.740350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.740955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.751241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.752101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.756928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.794198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] Creating event network-vif-deleted:f89446dd-aa6e-416e-a7e0-6f82861c2785 for instance d5856fe5-932a-4445-9c94-74cd6a909c48 on nch2-master-1 Aug 27 20:50:43.802843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d23cffbe-bdec-4233-879e-64efc21f214d req-35f2573b-712b-4a25-b644-413f2ae1b178 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099948 Aug 27 20:50:43.804604 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 270/462] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:43.811845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:43.812561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:43.820318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.820810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.821247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.822101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.822558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.822984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.877132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:43.886145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:43.893810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:43.897883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f78b1ba9-2cb0-4a92-afcd-19e0acf450c9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1266 microversion: 2.25 time: 0.179057 Aug 27 20:50:43.899256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 193/463] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:43 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:43.950864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:43.951616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:43.961632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.964460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.965089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:43.969524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:43.970198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:43.971980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.466510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.475113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.487530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.490987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:44.494295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-04a97874-418d-4c29-9fd7-e68cbc627b78 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.547751 Aug 27 20:50:44.498080 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 194/464] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:43 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:44.514660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:44.515585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:44.528062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.528827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.529496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.531516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.534067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.534793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.587408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.601604 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d4d0fef2-ef53-401f-a699-0bb1866a73b4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.794901 Aug 27 20:50:44.602497 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 271/465] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:43 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:44.609058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.609553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.609994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.610455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lazy-loading 'fault' on Instance uuid d5856fe5-932a-4445-9c94-74cd6a909c48 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:44.619230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:44.620226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:44.626689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.631214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.631900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.632823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.633475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.634088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.792127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55343911d6f24e9fbd4e222b911edc45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3937d675725a43fbb31c3b2e231a93f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.809926 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-295819e1-223a-4db5-8338-48a2b531d41c tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 200 len: 1312 microversion: 2.1 time: 0.310134 Aug 27 20:50:44.810776 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 195/466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:44 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:44.818327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:44.825474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:44.850136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.857461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:44.861462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.866001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.866964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.868295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1dd6db27-5e09-4ecd-8238-e8514ff3d7f9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1299 microversion: 2.1 time: 0.264268 Aug 27 20:50:44.868911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.869480 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 272/467] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:44 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1299 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:44.869900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.925492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:44.926218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:44.938095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.941441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.942036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:44.942894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:44.944153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:44.944843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.089025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.102647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.104374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.105586 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a8be542-337a-40bc-8aff-f443f1250d07 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1314 microversion: 2.25 time: 0.184059 Aug 27 20:50:45.111287 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 273/468] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:44 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:45.328025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.341607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ede0f8ba-991d-432f-b1cd-983cca71965c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.527423 Aug 27 20:50:45.343192 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 196/469] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:44 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:45.529189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:45.530181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:45.541336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.543841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.544496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.545563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.546110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.546686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.624306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:45.625599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:45.632252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.633025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.633811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.634726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.635421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.636063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.677902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.689386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.693794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:45.701817 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9a2022b-ff16-42b9-ac81-47f8080f7ada tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.177143 Aug 27 20:50:45.703170 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 274/470] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:45 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:45.833430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:45.834196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] [instance: d5856fe5-932a-4445-9c94-74cd6a909c48] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:45.846156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.846454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.847984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.848741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.849247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.856322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.886647 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] HTTP exception thrown: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Request method failure captured: Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 HTTP/1.1 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOMuIdbfinTrrDxg-XMYHy5oqPLCIWYd3GYjd63gDSQyhW7zokvJrNAoPu7nbrvTZTMcvsD8w145wXU83begpEspTHo8cbg--N1QHu_Vpsmj3Ua73-rRenU2x_L8HwKeSSYEtnLwU1rkRnwt41IYwu-nsIzswa3u-8_KoT3uMPEAU8 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 3937d675725a43fbb31c3b2e231a93f7 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:50:45.888476 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3937d675725a43fbb31c3b2e231a93f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3937d675725a43fbb31c3b2e231a93f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3937d675725a43fbb31c3b2e231a93f7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3937d675725a43fbb31c3b2e231a93f7"}]}] Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 3937d675725a43fbb31c3b2e231a93f7 Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-927983039 Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerDiagnosticsNegativeTest-927983039-project Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 55343911d6f24e9fbd4e222b911edc45 Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-927983039-project Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. Aug 27 20:50:45.889741 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd5856fe5-932a-4445-9c94-74cd6a909c48'} Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:50:45.890571 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. Aug 27 20:50:45.892469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:50:45.894736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] Returning 404 to user: Instance d5856fe5-932a-4445-9c94-74cd6a909c48 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:50:45.894736 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5cff2bde-2337-47dc-adff-bec01df0c7c3 tempest-ServerDiagnosticsNegativeTest-927983039 tempest-ServerDiagnosticsNegativeTest-927983039-project] 10.222.0.40 "GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48" status: 404 len: 111 microversion: 2.1 time: 0.061629 Aug 27 20:50:45.910771 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 275/471] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:45 2022] GET /compute/v2.1/servers/d5856fe5-932a-4445-9c94-74cd6a909c48 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:50:45.915772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:45.916639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:45.923381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.927516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.928163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:45.929135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:45.931441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:45.932297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.164267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.183874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8479186-262c-492b-b206-855fdb63856f tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.560185 Aug 27 20:50:46.187800 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 197/472] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:45 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:46.208671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:46.214157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:46.250898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.254794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.255544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.258343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.261358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.263125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.522341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.542634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.543202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.546595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.549678 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ed35194-1179-4545-9e9d-4310a1d27cd3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1320 microversion: 2.25 time: 0.358038 Aug 27 20:50:46.552618 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b61b84f-c27d-44d8-b99d-ba94578444a8 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.640623 Aug 27 20:50:46.565887 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 276/473] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:45 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:46.565887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:46.565887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:46.566132 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 198/474] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:46 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:46.578136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.578734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.579079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.580004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.580291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.580786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.731183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:46.731837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:46.742957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.746593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.747113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.748007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:46.748533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:46.752248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:46.891041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.904659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.906637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.917747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9002752-2f01-455e-93ea-f54dd09bbac7 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.191116 Aug 27 20:50:46.919029 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 199/475] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:46 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:50:46.962736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:46.977914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9924d23a-3d38-437a-989e-cb9fd148ff70 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1471 microversion: 2.1 time: 0.420631 Aug 27 20:50:46.978518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 277/476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:46 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:47.210342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:47.211608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:47.221644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:47.222474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:47.223705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:47.224699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:47.226013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:47.226558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:47.581170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:47.582126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:47.627981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:47.635229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:47.635949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:47.637047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:47.644706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:47.646702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.391724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.407503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eca7ac82-636c-4bf6-bf09-ec9ca797b34a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 1.200581 Aug 27 20:50:48.409758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 200/477] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:47 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:48.422230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:48.423059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:48.443522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.444945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.446662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.449065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.451748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.452627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.561802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.589165 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f004c34d-0cb7-468c-bfcd-f928e1bfb1c5 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 1.015480 Aug 27 20:50:48.589846 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 278/478] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:47 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:48.597952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:48.598574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:48.609250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.609756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.610204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.610928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.615736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.616299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.759232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.776101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.778120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.784786 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4e29fbda-81d0-4f01-a80f-9ee60eb528d3 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.193867 Aug 27 20:50:48.786105 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 279/479] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:48 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:48.805524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:48.806546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:48.819921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.820430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.821062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.821962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.823738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.824042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.850931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.887395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.889310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:48.896917 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-193a6d78-cc32-4622-ba0f-9ba3a2bd8ef9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.485536 Aug 27 20:50:48.898106 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 201/480] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:48 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:48.908183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784a6000-e50e-48af-8077-5e0c2442eaa8", "name": "network-vif-plugged", "status": "completed", "tag": "8d51f640-821b-46b9-a14f-932bfe1c66c5"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:48.940438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:48.941802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:48.942257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:48.980972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] Creating event network-vif-plugged:8d51f640-821b-46b9-a14f-932bfe1c66c5 for instance 784a6000-e50e-48af-8077-5e0c2442eaa8 on nch1-master-1 Aug 27 20:50:48.999518 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d60ad898-e93b-426c-b3e1-8b133db32424 req-84cb72bb-f3fb-4d2f-ae67-121879343b15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096786 Aug 27 20:50:49.002617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 202/481] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:49.015194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c35889b-6c0a-4027-ad07-7b3cb8575afe", "tag": "6cf9e88d-0cd8-44d3-a58d-c26480ae4cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:49.031724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.032259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.032664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.046703 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] Creating event network-changed:6cf9e88d-0cd8-44d3-a58d-c26480ae4cde for instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe on nch2-master-1 Aug 27 20:50:49.055960 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e18b8965-cb68-46bb-a37f-3eff34d9b00b req-1da11024-a6fd-470f-b841-17e884fba2d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048913 Aug 27 20:50:49.057142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 203/482] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:49.182965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:49.198513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3465ae1a-aac0-441f-8e72-aa6715c4ecf3 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.410794 Aug 27 20:50:49.209796 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 280/483] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:48 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:49.435449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:49.436191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:49.447436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.447944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.458649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.460408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.465219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.466576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.612649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:49.613208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:49.620611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.621050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.621534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.622917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.623737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.624516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.839251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:49.859781 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d341284d-4159-4745-bd1f-8b52c748a93e tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1320 microversion: 2.1 time: 0.432807 Aug 27 20:50:49.860718 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 204/484] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:49 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:49.868181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:49.869024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:49.876301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.877121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.878073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.878991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:49.879681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:49.880321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:49.913967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=15 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:50.011056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.020480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.032739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.033926 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-48a9395b-045c-4b58-964e-5895e7fb1c93 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.427291 Aug 27 20:50:50.035714 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 281/485] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:49 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:50.037557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.048380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:50.050492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:50.052732 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-010ef7f6-a6e3-4d91-8e39-3c6e704a1ba0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.190658 Aug 27 20:50:50.053395 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 205/486] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:49 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:50.064466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.065063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.065506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:50.066401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.069213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.069851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:50.088320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:50.227308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:50.231261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:50.238549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.239207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.240000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:50.240943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.241642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.242274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:50.385766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=22 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:50.422610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.436312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.438684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.440256 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24d92622-538d-483e-b3ae-b001d1a7c5ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.401445 Aug 27 20:50:50.442626 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 282/487] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:50 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:50.525986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:50.534037 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ddef76c-4b72-4591-a905-b0a622e7b1c2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.314848 Aug 27 20:50:50.539652 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 206/488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:50 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:50.886796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:50.887571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:50.909878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.910714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.912510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:50.915069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:50.915754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:50.917216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.147274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-124631005", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:51.228740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:50:51.349971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:51.370388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa148c96-beab-40fb-bf65-2805d95495c0 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1469 microversion: 2.1 time: 0.487382 Aug 27 20:50:51.370858 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 283/489] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:50 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:51.390713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:51.400310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:51.415989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.421849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.421849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.421849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.421849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.422232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.634288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:51.634852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:51.635152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:51.635762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:51.636359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:51.652582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.652745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:51.653432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.654022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.654938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.655594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.656215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.663669 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-422ab33a-7285-4ded-9ee1-8a0653facb34 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.276786 Aug 27 20:50:51.668794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 284/490] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:51 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:51.677821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:51.678626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:51.685073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.685572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.686170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.687034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.687548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.687986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.689623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:50:51.694409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:50:51.713196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:50:51.718968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:50:51.782024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:51.800632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:51.804232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:51.804697 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ef10f8b-e367-4bcc-b5ff-003e3056fb57 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882712 Aug 27 20:50:51.805447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 207/491] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:50:51.824885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9fb86cd7-5947-4419-a1a5-1966a04da4c0 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.151852 Aug 27 20:50:51.826395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 285/492] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:51 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:51.837464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fb87b3-f2e5-4d84-a7e9-d5d2a4860709", "tag": "ad523f22-e411-4656-b109-5125c1ccd60b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:51.865965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.866812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.867995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.901533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] Creating event network-changed:ad523f22-e411-4656-b109-5125c1ccd60b for instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 on nch1-master-1 Aug 27 20:50:51.918442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f60dd0f9-92ca-47c4-b8b0-6e7c60c07b20 req-ea92ca17-c166-4305-994c-cdc3a0f5a1e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100055 Aug 27 20:50:51.919135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 208/493] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:51.927262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:51.929840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:51.948594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.949105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.949547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.950365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:51.956613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:51.957176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:51.962846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:52.221713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.237230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.241927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.246539 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36d45712-d7af-4443-b899-7a16821ff2be tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.324454 Aug 27 20:50:52.248002 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 209/494] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:51 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:52.258293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.259818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.273542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.274361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.275295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.276371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.284309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.288104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.329660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.330184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.338511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.339463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.340192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.341707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.342903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.343516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.401043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:50:52.455814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=18 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:52.527495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2886f81-21b0-4e25-b42c-87542211b0ec tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 204 len: 0 microversion: 2.1 time: 0.699118 Aug 27 20:50:52.528212 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 286/495] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:50:51 2022] DELETE /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:50:52.537485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.538200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.543589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.545844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.546350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.546805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.547572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.548039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.548466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.552543 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-098ce091-7e25-448c-82ba-3127855b4662 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.302074 Aug 27 20:50:52.553463 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 210/496] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:52 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:52.571919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.572836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.580031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.581089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.581695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.582574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.583216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.583830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.655582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.668105 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ce2947a0-710f-4d30-baac-8da9fa43853c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1220 microversion: 2.1 time: 0.137034 Aug 27 20:50:52.668105 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 287/497] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:52 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:52.689681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.690391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.694547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=18 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:52.699983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.700497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.701767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.702508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.702973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.703431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.892828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:52.902333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-14e721d9-b6e9-4cb0-bae8-b477a0e9a08a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1475 microversion: 2.1 time: 0.347624 Aug 27 20:50:52.902902 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 211/498] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:52 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:52.912230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:52.913083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:52.922554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.923143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.923681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.924668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:52.925361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:52.925860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:52.996015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.010792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27d86713-d0d2-4063-bc06-5b69249cf3de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.322379 Aug 27 20:50:53.011651 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 288/499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:52 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:53.022684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.036746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.040148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.046264 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3aeeac2-9062-4da2-b9f7-19ae54d474ec tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.141041 Aug 27 20:50:53.046938 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 212/500] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:52 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:53.279776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:53.280572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:53.288508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.288864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.289314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.290483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.290997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.291631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.511784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.538867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.541646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.543155 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-12a74440-2a2e-4718-bd88-1d34cda1f3c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.268373 Aug 27 20:50:53.549817 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 289/501] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:53 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:53.578045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:53.579152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:53.594794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.595293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.595988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.596700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.597324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.597746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.688533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:53.689300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:53.696190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.696691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.697157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.698018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.698478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.698936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.816749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.827066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8485f217-b2e3-434b-88f1-9fa21cd2bd4b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1220 microversion: 2.1 time: 0.142907 Aug 27 20:50:53.827993 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 290/502] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:53 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:53.859647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:53.868308 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-795ca5a3-9580-45a1-aac0-7137b0ba6d18 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.296959 Aug 27 20:50:53.869024 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 213/503] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:53 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:53.926204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:53.926838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:53.932967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.933461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.934052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:53.934786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:53.935544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:53.935975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.033316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:54.034436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:54.041009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.041649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.042158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.043002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.043574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.044098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.233001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.242065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38835c7d-254d-4574-a9de-74313734b509 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1475 microversion: 2.1 time: 0.320713 Aug 27 20:50:54.242638 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 291/504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:53 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:54.261344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:54.262205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:54.269912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.270798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.272007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.273543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.274199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.274778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.327651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.336952 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cb8478b-5fa4-4612-a1ca-189ecb71f68b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.309434 Aug 27 20:50:54.338225 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 214/505] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:54 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:54.399699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.410381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.412347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.418803 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af4fa8ef-279a-4057-b805-191371314554 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.161967 Aug 27 20:50:54.435459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 292/506] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:54 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:54.573510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:54.574332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:54.600665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.601267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.601712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.602443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.603785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.604996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.852790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:54.854443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:54.864364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.865156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.865746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.866879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:54.867539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:54.868115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:54.984006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:54.995622 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a5b2e82-51d7-4a3c-b2aa-df926feb2ec5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1212 microversion: 2.1 time: 0.150285 Aug 27 20:50:54.996797 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 293/507] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:54 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:54.997831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.010271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:55.011180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.013363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:55.013509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.014679 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1075a38-c5a7-4d0e-9e74-6fed47dbd1c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.446479 Aug 27 20:50:55.015291 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 215/508] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:54 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:55.021104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "name": "network-vif-plugged", "status": "completed", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:55.036014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.036817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.037406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.038636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.039262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.039740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.040130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.040352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.041040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.064030 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] Creating event network-vif-plugged:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:50:55.078872 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ab54518c-82ea-43c7-a200-1b2c276c0f2c req-8f3be326-0aea-451a-9074-c727742a1647 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062279 Aug 27 20:50:55.080702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 216/509] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:50:55.270906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:55.271909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:55.280607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.281224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.281780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.283640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.288122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.295073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.594504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.603127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ebaace82-dacc-46db-809a-9a44c4b28d7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.605072 Aug 27 20:50:55.616397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 294/510] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:54 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:55.623136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:55.623857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:55.630385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.636554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.637245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.638166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.639996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.640624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.832639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.842429 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd66fea3-52ea-47d0-8548-7571939c3b4a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1475 microversion: 2.1 time: 0.578432 Aug 27 20:50:55.860293 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 217/511] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:55 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:55.865601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:55.866231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:55.875601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.876132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.876566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.877634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:55.878286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:55.878546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:55.884870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:55.896213 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f3d5fdc-da08-4463-a33e-98c8a7c9d48d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.277762 Aug 27 20:50:55.896883 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 295/512] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:55 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:55.990516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.003333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.004855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.010681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9569104f-3c42-49dd-9ce8-786e3c1884cb tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1446 microversion: 2.75 time: 0.149207 Aug 27 20:50:56.012968 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 218/513] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:55 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:56.018924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:56.020651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:56.041493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:56.042757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:56.043595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.044482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.048104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.050321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.050994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.051689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.052294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.053247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.053854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.054429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.063609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.064259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.194746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.245843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f90c3da-6b00-4a2d-89a6-380531915abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1212 microversion: 2.1 time: 0.231526 Aug 27 20:50:56.246443 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 296/514] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:56 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1212 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:56.356978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.370241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.372886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.374342 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae176908-49cc-4121-a32f-62eb60b41cf5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.338889 Aug 27 20:50:56.375505 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 219/515] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:56 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:56.631604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:56.633033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:56.643011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.649653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.651191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.652228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.654456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.655305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.675657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:56.868860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:56.869503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:56.886982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.887542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.887979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.892063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:56.908496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:56.912113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:56.917262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:56.944207 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d5c65887-d04d-4e7e-bcc5-b49a6e204d36 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1477 microversion: 2.1 time: 0.312503 Aug 27 20:50:56.944893 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 297/516] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:56 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:56.966111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:56.976274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:57.009515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.010020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.010563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.018761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.021818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.022324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.293408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.306995 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b7abb8f-0223-455b-8fae-8ef32f0660e2 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1475 microversion: 2.1 time: 0.442453 Aug 27 20:50:57.330860 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 220/517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:56 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:57.340010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:57.342803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:57.361654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.380222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.382527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.382695 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e3a023c-87c7-43cc-a9b6-1a804f1273e7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.436663 Aug 27 20:50:57.384203 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 298/518] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:56 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:57.384637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.386710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.389290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.389988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.401042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:57.403292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:57.413771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.414578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.415202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.416162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.416803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.417410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.518499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.534943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.538866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.551260 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26ccc192-33c3-4796-b1eb-06639a9dc30e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1452 microversion: 2.75 time: 0.218725 Aug 27 20:50:57.552396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 221/519] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:57 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:57.571884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.580234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:57.581214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:57.585652 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27c95dac-71f5-4b40-9f49-fa8f8c0a6a7a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1276 microversion: 2.1 time: 0.199075 Aug 27 20:50:57.601164 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 299/520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:57 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:57.601379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.601379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.601379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.601379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.601825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.601825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.751758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784a6000-e50e-48af-8077-5e0c2442eaa8", "name": "network-vif-deleted", "tag": "8d51f640-821b-46b9-a14f-932bfe1c66c5"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:57.773022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.774961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.775642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.795473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] Creating event network-vif-deleted:8d51f640-821b-46b9-a14f-932bfe1c66c5 for instance 784a6000-e50e-48af-8077-5e0c2442eaa8 on nch1-master-1 Aug 27 20:50:57.802211 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b60d73e3-959d-4c10-bf9d-f01a227249b1 req-ed8291ae-b049-400c-b7ad-0eb2d0a385ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055584 Aug 27 20:50:57.803535 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 300/521] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:57.841786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.854934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.858004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:57.859778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4e673752-b648-4ef4-b124-1d14435b6ac4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.291507 Aug 27 20:50:57.860928 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 222/522] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:57 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:57.973375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:57.974817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:57.983932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.984861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.985512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:57.986842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:57.988198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:57.989271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.223843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.232480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fb87b3-f2e5-4d84-a7e9-d5d2a4860709", "name": "network-vif-plugged", "status": "completed", "tag": "ad523f22-e411-4656-b109-5125c1ccd60b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:58.237381 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef902f3c-3123-4a81-950d-356dfc6f74cb tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1463 microversion: 2.1 time: 0.274285 Aug 27 20:50:58.243441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 301/523] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:57 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1463 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:58.248335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.249060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.249718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.276885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.277846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.286722 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] Creating event network-vif-plugged:ad523f22-e411-4656-b109-5125c1ccd60b for instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 on nch1-master-1 Aug 27 20:50:58.289975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.290869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.291539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.292484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.293688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.294790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.299720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5219c40a-c991-4830-a9b2-e34027f2d7f9 req-e8c15746-b7cd-4ca8-bc75-9ac57be03833 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069631 Aug 27 20:50:58.309008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 223/524] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:50:58.343850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.344592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.360145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.360588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.361043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.363459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.364309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.365170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.488889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.498094 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-798c7062-8e99-4d89-8e76-145d65d2ed1d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1433 microversion: 2.1 time: 0.159220 Aug 27 20:50:58.498950 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 224/525] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1433 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:58.506103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.507125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.519659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.520420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.520867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.521792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.522255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.522746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.582027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.594535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2bf0d9c5-aed8-4883-98ec-19be7c329d16 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1463 microversion: 2.1 time: 0.332781 Aug 27 20:50:58.596606 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 302/526] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1463 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:50:58.606990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.607933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.619391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.624562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.625034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.625776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.626247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.626682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.779776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.808444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.814993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.816605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.825848 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da2ffe05-9909-4391-82ee-0f54963f638d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.325140 Aug 27 20:50:58.827370 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 225/527] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:58.832524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.833200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.839732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.841615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.842324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.843208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.843762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.844160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63ab7109-ef3b-4d23-a442-e680740124ad tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1452 microversion: 2.75 time: 0.246293 Aug 27 20:50:58.844329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.845447 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 303/528] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1452 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:58.851773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:50:58.854980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:58.864791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.865391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.865837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.866748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:58.867419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:58.869116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:58.961272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:58.970687 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5749e5ec-f455-40b2-85c9-76191d58b4a1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1276 microversion: 2.1 time: 0.141701 Aug 27 20:50:58.971856 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 226/529] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:58.992501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:58.993145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.000422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.000930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.001376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.001624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:50:59.002300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.002905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.003196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:50:59.003409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.004252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:50:59.006260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:50:59.006595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:59.007142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:50:59.190700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.206429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.207230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.208403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.209211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.209745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.210248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.299966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c27eb1d7-0d1c-44b7-b6ea-ed38ba491676 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 1067 microversion: 2.1 time: 0.453071 Aug 27 20:50:59.306701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 304/530] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:50:58 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 1067 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 20:50:59.329984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:59.330862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.356925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:59.360350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:59.361984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.362618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.368868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.370875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.371334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.371881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.374959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:59.376878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:59.378562 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac68388b-4302-4dde-87ac-f76eddc4fd9b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.398252 Aug 27 20:50:59.379493 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 227/531] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:58 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:50:59.525068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:59.527552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.577402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.578520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.581104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.582198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.584555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.588746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.675038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.678369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.680470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.681121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid 784a6000-e50e-48af-8077-5e0c2442eaa8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:50:59.703125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:59.719707 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1889d79f-932a-4911-b54e-2890037d4ca0 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.405280 Aug 27 20:50:59.723751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 305/532] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:59 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:59.769843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:50:59.780190 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b2e2c625-9f01-443f-bf91-4e447632e7f4 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1310 microversion: 2.1 time: 0.261634 Aug 27 20:50:59.791483 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 228/533] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:59 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1310 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:50:59.848990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:59.849937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.862845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.867958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.870338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.871896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.872445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.872578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:50:59.873380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:50:59.875247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.884661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.885799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.886249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:50:59.889490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:50:59.891170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:50:59.891692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.043744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.052644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.054301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.056358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:00.061162 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fe2f3e0c-6206-48d5-ba38-3ed6f75990aa tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1452 microversion: 2.75 time: 0.192791 Aug 27 20:51:00.071568 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 229/534] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:50:59 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:00.076446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:00.077150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:00.085667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.086295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.086845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.087642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.088178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.088685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.113798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.123327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5113f30-f139-4c5f-8214-f5bfd04b1f88 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.279372 Aug 27 20:51:00.126646 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 306/535] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:50:59 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:00.160610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.171997 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae611a31-f91b-4a04-a983-ad87084296dd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1274 microversion: 2.1 time: 0.108919 Aug 27 20:51:00.172594 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 230/536] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:00 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:00.406434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:00.407802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:00.417107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.417859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.418660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.419686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.420172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.420910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.486972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-26239915", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "9b46b331-7562-41ca-bc02-1e78612261fd"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:00.559880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] validate_networks() for [('9b46b331-7562-41ca-bc02-1e78612261fd', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:00.674424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.688890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.692955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:00.696444 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-169ac6bf-cb5c-4cd0-9b07-2a0dc32f1906 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.294211 Aug 27 20:51:00.697378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 231/537] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:00 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:00.703206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c35889b-6c0a-4027-ad07-7b3cb8575afe", "name": "network-vif-plugged", "status": "completed", "tag": "6cf9e88d-0cd8-44d3-a58d-c26480ae4cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:00.714114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.714609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.715303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.727833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] Creating event network-vif-plugged:6cf9e88d-0cd8-44d3-a58d-c26480ae4cde for instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe on nch2-master-1 Aug 27 20:51:00.732922 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ff749207-3993-4ca9-8d03-8bd54d5d0c02 req-84ee28b4-7054-4390-ba43-25258addd6a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034206 Aug 27 20:51:00.733556 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 232/538] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:00.747449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:00.748487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:00.756886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.757594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.758226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:00.759505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:00.760125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:00.761106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.057419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.072659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-700ec667-f70d-4a49-b697-2a93dfd6c1c4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.329715 Aug 27 20:51:01.073394 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 233/539] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:00 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:01.078837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.079457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.085786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.086275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.087266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.087471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.087885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.088303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.128510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.129019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.129442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.131434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid 784a6000-e50e-48af-8077-5e0c2442eaa8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:01.202008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.211147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-232056a3-0629-4337-b718-c1f0d42e4e70 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 200 len: 1310 microversion: 2.1 time: 0.136751 Aug 27 20:51:01.230052 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 234/540] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:01.237459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.238043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.247910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.248416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.248868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.249593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.250066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.250494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.264366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:01.265047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:01.265808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:01.266465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:01.266939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:01.277115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.277898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.278408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.279266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.279810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.280425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.298431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:01.303622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for user 43dd6f015403486491e8140062f43bee and project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:01.322643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:01.325097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:01.337818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.347498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.349099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.363431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce4d1543-a6b1-48b8-a36d-763064cc3000 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1452 microversion: 2.75 time: 0.132082 Aug 27 20:51:01.380093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-373ad8fc-1e94-40ea-b8ea-34a5f154a85b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030272 Aug 27 20:51:01.387859 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 307/541] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:51:01.394438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.395241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.395785 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 235/542] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:01.404397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.404967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.405743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.407181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.407940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.409100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.409620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.410154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.415953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.417049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.417659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.418370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.418830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.419254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.667915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:01.701893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:01.716958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.729880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f1aefef-41e1-4367-bd0c-be42a53d57c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.332670 Aug 27 20:51:01.730849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 236/543] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:01.742260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0d27b4e-2c7f-4195-81f3-6dcce1e56f10 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.743080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0d27b4e-2c7f-4195-81f3-6dcce1e56f10 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.758196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.768409 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d257ed2-42cb-47b5-85b5-0fdc77a7de9f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1366 microversion: 2.1 time: 0.385387 Aug 27 20:51:01.769177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 308/544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:01.774590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:01.775204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:01.781726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.783291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.783928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.784826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:01.786076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:01.788172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:01.829845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c0d27b4e-2c7f-4195-81f3-6dcce1e56f10 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.839035 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c0d27b4e-2c7f-4195-81f3-6dcce1e56f10 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1209 microversion: 2.1 time: 0.106907 Aug 27 20:51:01.839768 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 237/545] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:01.964221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.977334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.978996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:01.980376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7afcd70b-838c-4b6f-91e5-1e768b35142b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1362 microversion: 2.25 time: 0.209961 Aug 27 20:51:01.981222 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 309/546] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:01 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:02.096250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:02.096891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:02.105880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.106393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.106843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.109626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.112601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.113865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.239220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:02.240137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:02.260231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.260751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.261214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.262112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.262806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.263515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.302359 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 HTTP/1.1 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:51:02.311519 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:02.312822 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '784a6000-e50e-48af-8077-5e0c2442eaa8'} Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:02.313565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:02.315184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:02.319375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:02.320473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5bfa0ff-a6a7-440f-b8d6-669257661a49 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 404 len: 111 microversion: 2.1 time: 0.086425 Aug 27 20:51:02.321561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 310/547] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:02 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:51:02.384573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:02.391651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:02.392571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:02.396705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eb174a46-07ae-4aae-8359-42c1f5d94514 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.306348 Aug 27 20:51:02.410330 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 238/548] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:02 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:02.410608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.410608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.410608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.410608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.410960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.410960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.500053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-624122260", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:02.518331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:02.528407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:02.529875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:02.545746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba599847-7dc0-4a4e-b308-4d4f3a3c389c tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1437 microversion: 2.75 time: 0.158441 Aug 27 20:51:02.546695 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 311/549] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:02 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:02.563685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:02.741230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:02.758475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:02.776826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.777591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.779722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.782989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.783842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.784488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.909911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:02.911455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:02.912511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:02.913026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:02.913539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:02.954964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:02.955771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:02.956426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:02.956843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:02.957286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:02.974055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.974682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.975130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:02.975910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:02.978535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:02.979602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.001032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:03.005249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Getting quotas for project cd9abafae3214a60a0117480d12d6b06. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:03.010169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Getting quotas for user 83653c8d8f0b4973b8cb91f2375a9b98 and project cd9abafae3214a60a0117480d12d6b06. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:03.027625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.028194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:03.035229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:03.045623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.046232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.046673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.047432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.050396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.052974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.146382 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-54d0a94e-ca6c-42e9-ac76-00890f9b2a0a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649991 Aug 27 20:51:03.153002 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 239/550] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:51:03.153002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.153538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.162078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.162601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.163045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.163793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.164405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.165118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.227786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:03.322890 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf438593-87d4-4f32-b366-77dc8cda8401 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6/action" status: 202 len: 1940 microversion: 2.75 time: 0.754646 Aug 27 20:51:03.340289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 312/551] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:51:02 2022] POST /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6/action => generated 1940 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 20:51:03.340289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.340289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.351573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.352079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.352520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.353239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.353819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.354250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.387936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:03.398720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f9c856fd-af20-45bd-b438-cd8aa5171f56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.250126 Aug 27 20:51:03.399874 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 240/552] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:03.406557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.407675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.417338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.418098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.418918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.420178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.420636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.421198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.547725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:03.558203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c6e5196-470a-48c7-b6fb-2e838f5384a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1261 microversion: 2.1 time: 0.157045 Aug 27 20:51:03.560004 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 241/553] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:03.571117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.573649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.588035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.589468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.590920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.594899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.595755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.596569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.677609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:03.688004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1d9dfc33-338f-4f96-83ae-54a2474c9f6a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1554 microversion: 2.1 time: 0.356255 Aug 27 20:51:03.688595 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 313/554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1554 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:03.703928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6", "tag": "38437cf9-f8b3-4b4f-a48d-03b543f2de87"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:03.741352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:03.744105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:03.744811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:03.773408 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] Creating event network-changed:38437cf9-f8b3-4b4f-a48d-03b543f2de87 for instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 on nch1-master-1 Aug 27 20:51:03.787113 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a0623624-0bbc-4adc-b66d-5f274703b0f4 req-fc498a42-a445-4669-ba6b-1bb112c65ebe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097221 Aug 27 20:51:03.799833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 314/555] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:03.821380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6058102f-0b2b-4ae5-8d7f-c9316750e35c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.825930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6058102f-0b2b-4ae5-8d7f-c9316750e35c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:03.957143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6058102f-0b2b-4ae5-8d7f-c9316750e35c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:03.967431 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6058102f-0b2b-4ae5-8d7f-c9316750e35c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1219 microversion: 2.1 time: 0.165796 Aug 27 20:51:03.971101 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 315/556] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:03.990453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:03.991213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:04.004379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.005924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.019164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.020531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.021196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.021858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.025845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:04.040137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:04.041972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:04.043494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-acf1ccce-6976-4cc6-9930-34da88ebfbeb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1558 microversion: 2.25 time: 0.481657 Aug 27 20:51:04.044650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 242/557] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1558 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:04.050603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:04.051792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:04.063848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.065325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.065950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.066894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.067660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.069006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.151804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:04.178468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-051dd081-fc21-46c6-b9b0-81910fa81062 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.205148 Aug 27 20:51:04.196949 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 316/558] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:03 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:04.205860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:04.207571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:04.215075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.216202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.217222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.218127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.218779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.219380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.300527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:04.311155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19a15b57-bc24-4b84-8312-04719c205dab tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.264997 Aug 27 20:51:04.312439 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 243/559] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:04 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:04.336410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:04.337169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:04.347412 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-88d97959-7696-42e3-85b1-e573479c2894 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149004 Aug 27 20:51:04.355235 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 317/560] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:51:04 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:04.355560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.355560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.355560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.355560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.356048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.356048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.425172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:04.426120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:04.434357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.435373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.436931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:04.438038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:04.438704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:04.439495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.058633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:05.085000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:05.099315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d72429b5-d844-4176-bb99-193e2ab2dc0d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.664689 Aug 27 20:51:05.100662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 318/561] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:04 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:05.105991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.107830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:05.108950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3cd1643-e1b8-49b0-9073-bdeb35c8271a tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 2051 microversion: 2.25 time: 0.784767 Aug 27 20:51:05.112954 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 244/562] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:04 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 2051 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:05.127259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.128883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.129976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:05.130095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.130552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.131293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.131808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.135093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.141262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.149476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.150233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.151057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.151571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.152367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.194633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:05.323166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:05.334351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23650363-061d-418a-aab4-5def39ad589b tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1271 microversion: 2.1 time: 0.218923 Aug 27 20:51:05.335827 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 245/563] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:05.341522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.343424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:05.351828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.352613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.353057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.353777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.354419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.354840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.692811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:05.705834 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c3c00df-5178-4208-80b3-9c55185280b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.603609 Aug 27 20:51:05.707267 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 319/564] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:05.717428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.718291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:05.730849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.731688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.732445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.733233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.733696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.734129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.802752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:05.820666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52552225-7982-4744-a10e-2514f13ced5f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 2051 microversion: 2.25 time: 0.483477 Aug 27 20:51:05.822513 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 246/565] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 2051 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:05.830027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.831525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:05.842355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.843472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.844185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.846256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.847093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.848004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.904809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:05.935030 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8ebe9c5-6b67-4d4c-a8b9-88a2988fd3b4 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.225781 Aug 27 20:51:05.936729 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 320/566] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:05.947445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:05.957900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.957900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.957900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.957900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:05.958386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:05.958386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:05.986279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3da2fb76-1cad-4b8b-b98a-3c3cd2f43be7 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048056 Aug 27 20:51:05.987216 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 321/567] 10.222.0.40 () {60 vars in 1217 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:51:05.991877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5de354-ac96-4d30-a18c-c7f6334f933d", "tag": "e6309230-7340-4487-a237-df1a5e8f1f9c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:06.008589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.011594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.014672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.028678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] Creating event network-changed:e6309230-7340-4487-a237-df1a5e8f1f9c for instance 6a5de354-ac96-4d30-a18c-c7f6334f933d on nch2-master-1 Aug 27 20:51:06.047162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-af91b17c-63b7-45e8-ba56-39e5fa723dce req-dc7c74d1-14eb-4297-b6a5-e8b85a44891e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057277 Aug 27 20:51:06.047162 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 322/568] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:06.057113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:06.058022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.066696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.068054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.068816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.070222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.071131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.072030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.196243 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4430d060-19b4-4658-9642-4d7ec2e6da4e tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709/action" status: 202 len: 0 microversion: 2.25 time: 0.144128 Aug 27 20:51:06.197101 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 323/569] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:51:06 2022] POST /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:06.207430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:06.207922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.216708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.217217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.217670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.218390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.218850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.219292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.231291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:06.243689 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f752a23-e285-476a-8334-04803c644e5a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.419258 Aug 27 20:51:06.244316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 247/570] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:05 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:06.265129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:06.265753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.276476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.277331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.277933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.279147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.279745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.280209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.569719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:06.578818 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d0a6c70-2463-4975-9fc9-72e589c2fecf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.376296 Aug 27 20:51:06.591678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 324/571] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:06 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:06.591678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:06.591678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.597366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.597897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.598341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.599122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.599612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.600043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.610345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:06.627233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1fb33018-345b-43ff-9e82-741445961045 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 2056 microversion: 2.25 time: 0.381512 Aug 27 20:51:06.627740 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 248/572] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:06 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 2056 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:06.684509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:06.692715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-702d0874-0c73-4ea1-8eaf-dc1a815112c3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1271 microversion: 2.1 time: 0.111788 Aug 27 20:51:06.693371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 325/573] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:06 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:06.733614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:06.734719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.742569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.743644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.744694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.745821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.746504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.747159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.966571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:06.968054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:06.975256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.975774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.976201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:06.976901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:06.977507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:06.977952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.086456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:07.105980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70d250fe-1689-4272-b236-1c58d3e06e76 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.143821 Aug 27 20:51:07.106745 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 326/574] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:06 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:07.124716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:07.133373 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58cb4405-243e-4cdb-a934-241ff3e0ba35 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.406241 Aug 27 20:51:07.133960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 249/575] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:06 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:07.230250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c35889b-6c0a-4027-ad07-7b3cb8575afe", "tag": "6cf9e88d-0cd8-44d3-a58d-c26480ae4cde"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:07.241023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.241517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.241985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.253837 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] Creating event network-changed:6cf9e88d-0cd8-44d3-a58d-c26480ae4cde for instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe on nch2-master-1 Aug 27 20:51:07.259001 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fede0cc5-4887-42b0-814e-aacc34ea6b45 req-ebce7b91-b20c-4f26-ad96-6820b84e85a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032677 Aug 27 20:51:07.259616 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 327/576] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:07.271315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:07.272161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:07.278688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.279268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.279825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.280628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.281240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.281927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.462622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:07.475116 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ddd291d-fa31-4803-a1e8-275c05ff0c5f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.208651 Aug 27 20:51:07.476738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 250/577] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:07 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:07.602732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:07.603473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:07.609986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.610711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.611373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.612393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.613069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.613705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.654520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:07.655437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:07.666596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.667115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.668233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.669861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.671074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.672363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.836918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:07.862987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:07.864775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24dc5bdc-9eb3-49f3-b97d-af00dae27e28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.265375 Aug 27 20:51:07.866431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 328/578] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:07 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:07.875876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:07.876954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:07.893611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-926da716-2c5b-4419-8c3e-1e6566db4dae tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 2036 microversion: 2.25 time: 0.245771 Aug 27 20:51:07.907441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 251/579] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:07 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 2036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:07.907667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.907667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.907667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.907667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.908070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.908070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.919215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:07.922736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:07.929782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.930499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.931123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.932259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:07.932878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:07.933470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:07.974973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'flavor' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:07.990753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:07.991984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Going to try to live migrate instance to nch2-master-1 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:51:08.000754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3642ae56-d93a-496b-99f3-f282eb46e0b9 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1277 microversion: 2.1 time: 0.132560 Aug 27 20:51:08.015496 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 329/580] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:07 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:08.130313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:08.131262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:08.139436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.140219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.141342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.142991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.143858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.144591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.154623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:08.246208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:08.265478 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bacb89ba-38e4-4d27-a57f-08245b299b9b tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.139012 Aug 27 20:51:08.266804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 330/581] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:08 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:08.271981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:08.274397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:08.278637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.279206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.280047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.281033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.281568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.282071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.502949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:08.511442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1041f1ad-c5be-4bd2-8895-f0c01de40516 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.243187 Aug 27 20:51:08.513366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 331/582] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:08 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:08.518598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:08.519230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:08.541888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.542396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.542856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.543631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.544092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.544528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.742939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:08.751744 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b88d648f-766b-4a3f-951b-5c0ff1113a7e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.236746 Aug 27 20:51:08.752681 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 332/583] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:08 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:08.887369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:08.888182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:08.895737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.896247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.896682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:08.897404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:08.897854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:08.898283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.085837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:09.094518 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3de02590-8ad8-4f5f-9f5f-b6be9d9ae4d6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.211330 Aug 27 20:51:09.095115 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 333/584] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:08 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:09.100431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:09.101046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:09.120466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.121408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.121408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.122151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.122932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.123056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.405012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:09.415406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95edf7b4-c2cf-4f54-9dec-0cbbf9116edb tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.318905 Aug 27 20:51:09.416134 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 334/585] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:09 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:09.421429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:09.422374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:09.430492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.431563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.432310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.433334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.434027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.434659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.577877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:09.602366 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73664b6b-f9ef-4738-8b71-920347866d3e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.184690 Aug 27 20:51:09.603179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 335/586] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:09 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:09.621188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:09.621916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:09.629501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.630003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.630458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.631201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:09.631731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:09.632211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:09.966671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:09.989254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b32bc0d-3a2c-4afd-baa6-6448f46e50e5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.370698 Aug 27 20:51:10.001627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 336/587] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:09 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:10.011612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:10.011612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:10.014461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:10.019889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.020311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.020755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.021507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.021967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.022400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.091115 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-608fe350-880b-4b6a-a2c7-a27bfa159e9b tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709/action" status: 202 len: 0 microversion: 2.25 time: 2.175346 Aug 27 20:51:10.093181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 252/588] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:51:07 2022] POST /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709/action => generated 0 bytes in 2179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:51:10.100055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04fedaf-2ac1-432d-9f68-efb74b25f522", "tag": "19ce6f93-f11c-46cd-ac7a-0d03b3964a19"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:10.126214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.126763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.127215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.147304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] Creating event network-changed:19ce6f93-f11c-46cd-ac7a-0d03b3964a19 for instance a04fedaf-2ac1-432d-9f68-efb74b25f522 on nch1-master-1 Aug 27 20:51:10.154978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-37a1dc0d-4d2c-484e-bb89-a89b400a3905 req-21c93db2-6e44-49e7-b4f7-1b539866f6cb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059738 Aug 27 20:51:10.155849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 253/589] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:10.164321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:10.165195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:10.175820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.176638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.177736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.178897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.179495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.180146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.191911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.201585 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-208372c9-2ad2-45b1-84ee-41320d4a4f3c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.196267 Aug 27 20:51:10.202989 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 337/590] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:10 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:10.211183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:10.212318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:10.224547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.225420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.233018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.233952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.234435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.234862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.522368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.532681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.534447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.535742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d5930624-4216-4db2-bd21-dbb3dd7f30df tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.378337 Aug 27 20:51:10.552171 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 254/591] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:10 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:10.552966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.557505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:10.558215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:10.566072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.566747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.567283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.568195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.568320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-deb43e67-d7f1-41df-a7cf-30adab92ef78 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.363810 Aug 27 20:51:10.568823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.569340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.569519 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 338/592] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:10 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:10.628523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:10.629167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:10.635705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.636138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.636868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.637776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:10.638223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:10.638648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:10.776053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:10.803234 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-606d2db5-eed7-4559-97cf-922406e6a635 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.178759 Aug 27 20:51:10.803876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 339/593] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:10 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:10.847639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:10.856398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88a7e243-ebce-4409-89b4-7858e4fb6eae tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.302558 Aug 27 20:51:10.857063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 255/594] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:10 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:11.012183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:11.012754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:11.021398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.021927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.022374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.023103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.023601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.024040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.175028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.183610 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa1fd940-107a-4226-90d5-b77a5833cd6a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.175434 Aug 27 20:51:11.184195 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 340/595] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:11 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:11.233217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:11.234512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:11.241348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.241844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.242280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.243066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.244213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.244880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.480966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.489767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48eb6e4c-6205-429c-96f6-fe13c6aa1756 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.265737 Aug 27 20:51:11.490369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 256/596] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:11 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:11.560461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:11.561056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:11.567985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.568566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.569055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.569857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.570317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.570747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.589473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fb87b3-f2e5-4d84-a7e9-d5d2a4860709", "name": "network-vif-unplugged", "status": "completed", "tag": "ad523f22-e411-4656-b109-5125c1ccd60b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:11.600200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.601102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.601786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.614539 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] Creating event network-vif-unplugged:ad523f22-e411-4656-b109-5125c1ccd60b for instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 on nch1-master-1 Aug 27 20:51:11.620252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7a31f70d-5258-4299-9960-bfd339381cf2 req-32ad9b6f-3dce-4f1b-9676-38572bb24df0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035069 Aug 27 20:51:11.621062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 257/597] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:11.627005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:11.627828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:11.634542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.635007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.635577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.636411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.636916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.637422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.884694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.894706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.896529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.897904 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9bdcd05c-c491-4f17-8b96-ca7ba23b6687 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.342286 Aug 27 20:51:11.898453 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 341/598] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:11 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:11.919645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:11.920547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:11.928254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.928740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.929198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.929886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.930539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.930963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:11.943552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:11.952221 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ee94a58-4672-4087-8f15-6cb35409cf70 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.329919 Aug 27 20:51:11.953396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 258/599] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:11 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:11.963866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6", "name": "network-vif-plugged", "status": "completed", "tag": "38437cf9-f8b3-4b4f-a48d-03b543f2de87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:11.983939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:11.985074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:11.987383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.009955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] Creating event network-vif-plugged:38437cf9-f8b3-4b4f-a48d-03b543f2de87 for instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 on nch1-master-1 Aug 27 20:51:12.019100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4f23c2f6-e29f-47b5-8412-846ab94f3e38 req-4aa3214b-97e3-45dd-b4a1-dd0f3d93bd70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063832 Aug 27 20:51:12.020426 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 259/600] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:12.029983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:12.031286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:12.042599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.043501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.044308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.045670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.046479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.047275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.093813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:12.113720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41505df8-3692-46e9-bda8-5fa83b9d8281 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.200245 Aug 27 20:51:12.114881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 342/601] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:11 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:12.204451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:12.205814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:12.211934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.212401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.212852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.213686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.213982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.214429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.216721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:12.219112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:12.228673 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f5a9c45-6384-4ed5-96f4-3a6831dcc7e7 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.206627 Aug 27 20:51:12.229419 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 260/602] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:12 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:12.352922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:12.361301 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1874ff7-b7f8-408b-a2d9-87a5daf3034c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.160754 Aug 27 20:51:12.361879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 343/603] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:12 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:12.512579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:12.513327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:12.520780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.521282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.521703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.522614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.523080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.523661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.672355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:12.680692 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6ecf261-b675-4185-b42d-d58269be0a29 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.172249 Aug 27 20:51:12.681473 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 261/604] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:12 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:12.928344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:12.928933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:12.936181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.936673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.937104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.937813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.938266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.938694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.977456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:12.978248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:12.987566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.988522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.989856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.990764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:12.991446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:12.992727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:12.993318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:13.018794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:13.379070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.388114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.389623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.390835 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e24e4c57-920e-4bd4-9c46-b6cdc99bd256 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.467109 Aug 27 20:51:13.391651 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 344/605] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:12 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:13.411661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:13.412285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:13.412497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.419124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.419653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.420093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.420645 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-600c4603-b028-4825-800f-4c81d4733d3a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.447645 Aug 27 20:51:13.420821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.431785 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 262/606] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:12 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:13.431981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.431981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.432159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:13.432159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:13.435668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.435668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.435668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.435668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.435991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.435991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.442009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:13.520854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:13.538535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9021e5d-f725-4c11-b6ed-53e967127020 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.131318 Aug 27 20:51:13.539455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 345/607] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:13 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:13.543947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:13.544543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:13.550850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.551644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.551783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.552478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.552938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.553384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.582077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.590667 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ee9ab70-58a5-4d49-bd9b-d5cc3b636f24 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.168046 Aug 27 20:51:13.591294 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 263/608] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:13 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:13.636157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fb87b3-f2e5-4d84-a7e9-d5d2a4860709", "tag": "ad523f22-e411-4656-b109-5125c1ccd60b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:13.648180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.648875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.649314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.664742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] Creating event network-changed:ad523f22-e411-4656-b109-5125c1ccd60b for instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 on nch1-master-1 Aug 27 20:51:13.669929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a55d7ebd-2e42-41a7-bad9-29e346794ca2 req-3e82f8bf-b0d6-4cf3-9302-b0bb249edf28 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Aug 27 20:51:13.670724 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 264/609] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:13.702109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.703020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:13.703777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:13.710868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.711050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01fbfa4b-4c68-4fc0-9b5f-557ba8f5ffa0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.170753 Aug 27 20:51:13.711782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.711947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 346/610] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:13 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:13.712222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.718194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:13.719009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:13.719819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:13.860890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:13.869282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27bb9c28-ef9c-4867-aaed-fb857b5754b5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.171754 Aug 27 20:51:13.869819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 265/611] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:13 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:14.034607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5de354-ac96-4d30-a18c-c7f6334f933d", "name": "network-vif-plugged", "status": "completed", "tag": "e6309230-7340-4487-a237-df1a5e8f1f9c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:14.040079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:14.046487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.046962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.047449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.059245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] Creating event network-vif-plugged:e6309230-7340-4487-a237-df1a5e8f1f9c for instance 6a5de354-ac96-4d30-a18c-c7f6334f933d on nch2-master-1 Aug 27 20:51:14.064281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-36304aad-fbbd-462c-94b7-d5b4fd8e160e req-af1c20bf-ca51-4dc6-9818-99e6d6354444 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Aug 27 20:51:14.065427 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 347/612] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:14.414894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.415570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.421965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.422493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.422934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.423841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.424299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.425139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.443700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.444411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.450823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.451304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.451769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.452454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.452897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.453314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.636292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:14.640336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:14.644975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:14.646440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:14.647659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3da83f09-ef26-4826-b29b-7f46d53f482b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.236833 Aug 27 20:51:14.648246 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 266/613] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:14.649030 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4cc8e4f7-c078-4fac-b83e-6bd93ce0cebc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1316 microversion: 2.1 time: 0.209877 Aug 27 20:51:14.662174 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 348/614] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:14.662370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.662459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.662571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.662651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.662651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.662800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.662889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.662966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.663049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.663607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.663846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.664048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.664659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.664767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.665094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.665669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.800267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:14.814906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:14.819885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ee914c1-af1e-4869-81ff-c8c7d5408e53 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.170569 Aug 27 20:51:14.834375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 267/615] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:14.834375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.834375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.839319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.839862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.840302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.840784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:14.841375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.841826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.842251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.852156 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eac07fc9-38f6-463c-90aa-45ef489ce281 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.201505 Aug 27 20:51:14.852785 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 349/616] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:14.892319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:14.893169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:14.904214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.906028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.907392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:14.908146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:14.908612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:14.909306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.032260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.045739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df33d429-2107-4609-8192-81c9e576dd02 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1309 microversion: 2.1 time: 0.223081 Aug 27 20:51:15.046711 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 268/617] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1309 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:15.092440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.103410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0bebb7f-ed7e-4ce9-a3b5-d203dd3afeaa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.216613 Aug 27 20:51:15.104202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 350/618] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:14 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:15.670195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:15.670878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:15.673513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:15.674158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:15.680836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.681040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.681433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.681539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.682094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.682250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.682547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.682708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.682986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.683328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.683892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.684303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.947116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.953776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.958153 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cef9f755-a757-42de-b35a-c7ebd9253f19 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1466 microversion: 2.1 time: 0.291468 Aug 27 20:51:15.958830 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 269/619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:15 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1466 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:15.960564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:15.963628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:15.963937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.964261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:15.965919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:15.967080 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cdbbad7-3dbc-4bae-aa52-20c1ceae6ad0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.297755 Aug 27 20:51:15.970910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.972159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.972842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.974084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.974741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.975561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:15.979791 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 351/620] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:15 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:15.990158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:15.991102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:15.998777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:15.999279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:15.999755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.000457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.000912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.001338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.091507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:16.114244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-540bb173-dbaf-4d99-9566-9a02f0dc9e18 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.154142 Aug 27 20:51:16.115249 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 270/621] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:15 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:16.232418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:16.240822 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f00d9c2f-b405-4b7c-bf69-bdee6694126a tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.260009 Aug 27 20:51:16.241501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 352/622] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:15 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:16.251778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:16.252573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:16.256362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:16.256984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:16.262959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.263235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.263494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.263887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.263980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.264335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.264619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.265069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.265163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.265487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.265605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.266101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.563182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:16.571889 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d8cefda6-34e4-49e5-b32c-3b9662f4bd9b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1492 microversion: 2.1 time: 0.328797 Aug 27 20:51:16.572751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 353/623] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:16 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1492 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:16.596005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:16.597051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:16.603732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.604452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.605081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.605969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.606573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.607162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.842438 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc39d0c7-04f3-472b-b18a-d43960babca9 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1617 microversion: 2.1 time: 0.724941 Aug 27 20:51:16.843961 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 271/624] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:16 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1617 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:16.903036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:16.903681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:16.909876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.910414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.910786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.911551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:16.912030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:16.912420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:16.920528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:16.933108 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-905a3242-91a9-4d06-90f7-8e4c006d6050 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.347746 Aug 27 20:51:16.933938 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 354/625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:16 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:16.938688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: .version_select at 0x7ff84f538a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-312819019", "policies": ["affinity"]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:16.958834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:16.962966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.016182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.020235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.032508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f59d98a0-97ee-4ab5-a5d7-5e87bd7fcafa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.097388 Aug 27 20:51:17.033459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 355/626] 10.222.0.40 () {60 vars in 1174 bytes} [Sat Aug 27 20:51:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:17.038248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.038867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:17.045818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.046945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.047414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.048143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.048597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.049023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.181191 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9392b995-d54a-455e-97b1-d0a62dc4ac6b tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1643 microversion: 2.1 time: 0.335535 Aug 27 20:51:17.181936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 272/627] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:16 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1643 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:17.186616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-266812873", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5489734b-bf2f-416d-a80f-470b2157d6b0"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:17.244324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:17.255524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:17.266834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:17.268641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:17.269824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-703810a6-9e40-4c10-9676-126512522581 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.235355 Aug 27 20:51:17.270710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 356/628] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:17.275289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.275952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:17.290920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.291490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.291936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.292746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.293603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.294151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.409761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:17.432574 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f31e644-aac2-465a-b8f4-f35357a22da7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.160864 Aug 27 20:51:17.434100 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 357/629] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:17.438597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.439198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:17.446105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.446612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.447057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.447794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.448255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.448679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.536967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:17.537409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:17.537849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:17.538283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:17.538695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:17.566910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.567436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.567904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.568649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.569109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.569536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.588087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.592843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.601383 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9cbb131-0822-4d69-8f62-1034db72056d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1643 microversion: 2.1 time: 0.166145 Aug 27 20:51:17.601967 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 358/630] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1643 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:17.604864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 2 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:17.606414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.607030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:17.607286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:17.614001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.614499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.614942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.615671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.616119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.616539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.649369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140433) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 20:51:17.670074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.674196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.722721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.728577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.744415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=87eec846-2882-49dd-9bb2-c672e5810b06,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:17.768118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:17.776885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-23b2eb89-d2bd-4b40-a949-12ca35b8cf37 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.173904 Aug 27 20:51:17.777516 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 359/631] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:17.782388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.788095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.788565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.789002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.789731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.790203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.790823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.798963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.803461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.818029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d493de3b-112c-406b-a9d6-5e19da26055e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039414 Aug 27 20:51:17.819392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 360/632] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:17.831751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:17.834311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:17.841363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.841886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.842341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.843130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.843670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.844299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.848952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:17.854216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:17.890529 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8a44430-7ca6-471c-88aa-3dad998a7681 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.707656 Aug 27 20:51:17.892259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 273/633] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 20:51:17.900302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:17.906435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:17.907282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Searching by: {'deleted': False, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:51:17.926910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lazy-loading 'flavor' on Instance uuid 6a5de354-ac96-4d30-a18c-c7f6334f933d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:17.927399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.927884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.928316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:17.929035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:17.929489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:17.929907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.033247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:51:18.041078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Going to try to live migrate instance to nch1-master-1 {{(pid=140434) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:51:18.105194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d2dd6887-ee9e-41b0-9f82-7378849e457b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.208525 Aug 27 20:51:18.113261 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 274/634] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:51:17 2022] GET /compute/v2.1/servers => generated 1001 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:18.118081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:18.118718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:18.125715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.126127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.126579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.128062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.128062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.128404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.144294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:18.307392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:18.313918 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-929c8bc1-ff0c-4498-bee6-10014bb88d52 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.199226 Aug 27 20:51:18.314331 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 275/635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:18 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:18.331923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04fedaf-2ac1-432d-9f68-efb74b25f522", "name": "network-vif-plugged", "status": "completed", "tag": "19ce6f93-f11c-46cd-ac7a-0d03b3964a19"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:18.342384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.342919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.343301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.356525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] Creating event network-vif-plugged:19ce6f93-f11c-46cd-ac7a-0d03b3964a19 for instance a04fedaf-2ac1-432d-9f68-efb74b25f522 on nch1-master-1 Aug 27 20:51:18.362986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-dc9cb64a-7fba-4443-8613-4d12bfb0bc82 req-de3cbcda-b1ee-40c7-baf2-82a38de35c98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045964 Aug 27 20:51:18.363847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 276/636] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:18.371929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b41f2758-598e-457c-9d09-438ad693a83d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:18.372649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b41f2758-598e-457c-9d09-438ad693a83d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:18.432016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b41f2758-598e-457c-9d09-438ad693a83d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:18.440965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b41f2758-598e-457c-9d09-438ad693a83d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1218 microversion: 2.1 time: 0.073183 Aug 27 20:51:18.451833 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 277/637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:18 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:18.457309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:18.457982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:18.467672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.468156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.468612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.469310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.470491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.470931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.730480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:18.741913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:18.743455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:18.745386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c0dd56a-ee61-4c44-abc7-d5344f602588 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.302707 Aug 27 20:51:18.746094 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 278/638] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:18 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:18.751822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:18.752826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:18.759999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.760498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.761071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.761789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.774818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.775495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.801671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:18.883708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:18.903656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:18.907370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-919c4802-7114-4583-83b9-519af926aac7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.159407 Aug 27 20:51:18.907973 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 279/639] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:18 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:18.913402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:18.914255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:18.926544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.927416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.928071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:18.929088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:18.930021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:18.930834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.079485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:19.089232 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d2a8e18-5b1f-46df-b929-91c99a20ebbd tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.179800 Aug 27 20:51:19.089874 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 280/640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:18 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:19.341593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:19.342622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:19.356709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.357570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.358334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.359795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.360694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.362869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.526529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:19.535279 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19a491ee-34e6-4766-b7dc-a5c7683b3ad2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.199657 Aug 27 20:51:19.535866 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 281/641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:19 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:19.540771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:19.541395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:19.548492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.549057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.549843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.550578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.551043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.551515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.625814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:19.635667 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9754ef40-8583-4f0d-a4b2-fa6495a082d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1270 microversion: 2.1 time: 0.098637 Aug 27 20:51:19.636480 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 282/642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:19 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:19.769734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:19.770362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:19.782078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.782488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.783195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.784150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:19.784949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:19.785404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:19.986176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:19.999877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:20.002690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:20.004168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-979c56c1-aefa-419a-a04e-f017abebab86 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.238813 Aug 27 20:51:20.004735 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 283/643] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:19 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:20.009029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:20.009631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:20.016508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.017004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.017431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.018188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.018735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.019153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.103200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:20.128649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aada8e7a-93ea-475d-a755-f919f7301eb7 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.122894 Aug 27 20:51:20.129221 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 284/644] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:20 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:20.133904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:20.134520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:20.140823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.141333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.141785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.142482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.143101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.143748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.288721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:20.296507 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15942e86-900e-494c-ad6e-c454e29f5d09 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1319 microversion: 2.1 time: 0.166307 Aug 27 20:51:20.297098 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 285/645] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:20 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:20.558302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:20.559054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:20.565428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.565904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.566341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.567076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.567567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.567999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.754212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:20.766042 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5536d17-c6d2-4991-ae66-88060501085a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.211710 Aug 27 20:51:20.766875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 286/646] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:20 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:20.771528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:20.772152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:20.778756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.779256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.779781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.780498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.781165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.782326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.872769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:20.884244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5af978b-0224-41b6-bbad-c5f4d8293991 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1270 microversion: 2.1 time: 0.115828 Aug 27 20:51:20.885079 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 287/647] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:20 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:20.935374 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3eab736-2329-4c1f-b075-f5594e9a2f6d tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d/action" status: 202 len: 0 microversion: 2.1 time: 3.107608 Aug 27 20:51:20.936642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 361/648] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:51:17 2022] POST /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d/action => generated 0 bytes in 3110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:51:20.945158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:20.945798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:20.954862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.956421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.956892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:20.957651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:20.958112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:20.958548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.030181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:21.033134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:21.043061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.043837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.044504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.045637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.046467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.047044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.583678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:21.590055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:21.595118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23b97526-d1aa-4788-9957-8003c0a0cf58 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.653873 Aug 27 20:51:21.602179 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 288/649] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:20 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:21.605086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:21.607059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:21.607514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:21.609252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-53e0b777-b963-493a-ba1d-1a03628c8b1d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1568 microversion: 2.25 time: 0.584574 Aug 27 20:51:21.610723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 362/650] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:21 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1568 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:21.622359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:21.623431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:21.625300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:21.633488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.634292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.635202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.636211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.637104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.637582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.637698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.638032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.638732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.639096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.639586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.640352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.770260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:21.816344 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9e16663-8cdd-4a8d-89a3-2f83600d17b0 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.212929 Aug 27 20:51:21.817367 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 289/651] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:21 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:21.822293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:21.822913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:21.829012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.829515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.829951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.830711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.831170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.831639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.965232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:21.975150 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c904cf51-6326-4dff-928f-fc9173fec8b8 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1469 microversion: 2.1 time: 0.362037 Aug 27 20:51:21.975931 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 363/652] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:21 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:21.981444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:21.982294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:21.989553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.990430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.990974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:21.991809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:21.992501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:21.993302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.087254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:22.095807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3786411f-ecb9-4e7d-8896-7f880d7693c4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1276 microversion: 2.1 time: 0.118322 Aug 27 20:51:22.096805 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 364/653] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:21 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:22.115930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:22.118356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.121525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:22.125500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.126013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.126450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.127652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.127927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.128358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.141956 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9dae1a2-f667-405d-a720-f60922379511 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.323338 Aug 27 20:51:22.145179 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 290/654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:21 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:22.218442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc75315f-a795-49b7-9fbb-4fd83952c87d tempest-DeleteServersAdminTestJSON-1879022723 tempest-DeleteServersAdminTestJSON-1879022723-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522/action" status: 202 len: 0 microversion: 2.1 time: 0.106891 Aug 27 20:51:22.222518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 365/655] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:51:22 2022] POST /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:22.227912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.228648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.234785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.235278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.235784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.236491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.236972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.237484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.270172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.270666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.271100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.271557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid a04fedaf-2ac1-432d-9f68-efb74b25f522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:22.397375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:22.405442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e54abcf-e7fa-4edc-9795-0fa11d065e9c tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1452 microversion: 2.1 time: 0.181427 Aug 27 20:51:22.415394 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 291/656] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:22 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:22.427421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.428018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.434767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.435372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.435986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.436758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.437352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.437982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.470231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:51:22.552681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:22.566431 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5a21dc5-428a-4d07-aa28-fb8458b075b3 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 204 len: 0 microversion: 2.1 time: 0.142824 Aug 27 20:51:22.567740 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 366/657] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:22 2022] DELETE /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:22.576463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.577414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.587903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.589097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.589698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.591005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.591645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.592225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.634932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.635769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.655452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.655974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.656496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.657194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.657648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.658075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.699730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.702331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.716394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.716909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid a04fedaf-2ac1-432d-9f68-efb74b25f522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:22.893966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:22.907162 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-215a2d6b-508e-478b-9433-25f744e19779 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1458 microversion: 2.1 time: 0.335164 Aug 27 20:51:22.907898 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 292/658] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:22 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1458 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:22.909998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:22.916009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.916763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.921258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98a7b627-9935-4a54-89d1-81de604bad01 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.293211 Aug 27 20:51:22.926107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.926911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.927664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.929456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.930146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.931368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.937985 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 367/659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:22 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:22.944442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:22.945310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:22.954002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.954666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.955097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:22.955955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:22.956414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:22.957019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.060905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:23.081420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54daed5d-28b7-4b8d-8086-dd23013d873f tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.141796 Aug 27 20:51:23.082112 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 368/660] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:22 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:23.117966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.118945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:23.126928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:23.137202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:23.138653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:23.139848 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f1e1b0d-d507-473d-b15a-0c0ada4ae86c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1543 microversion: 2.25 time: 0.230715 Aug 27 20:51:23.140415 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 293/661] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:22 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1543 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:23.140673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.141198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.141644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.142761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.142909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.143257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.162175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6264a4ef-a5ac-414c-901b-f78adcda7cb9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '.version_select at 0x7ff84f403430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.165745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6264a4ef-a5ac-414c-901b-f78adcda7cb9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.166921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6264a4ef-a5ac-414c-901b-f78adcda7cb9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.167421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6264a4ef-a5ac-414c-901b-f78adcda7cb9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.187128 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6264a4ef-a5ac-414c-901b-f78adcda7cb9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1766 microversion: 2.25 time: 0.029016 Aug 27 20:51:23.187806 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 294/662] 10.222.0.40 () {60 vars in 1184 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/os-migrations => generated 1766 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:23.193105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.193725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:23.201194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.202552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.203325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.204554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.205424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.206147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.211611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:23.410873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:23.426047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6698fcfd-9dad-445a-a3a2-28522b59f89e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.308471 Aug 27 20:51:23.426661 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 369/663] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:23.446623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:23.448627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.449460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:23.456526 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0dc0e4a8-de97-4388-b905-2ddaf8bdd241 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.266789 Aug 27 20:51:23.457082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.457688 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 295/664] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:23.457970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.458632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.459435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.459999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.460808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.599688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:23.613290 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c77dfe74-eafc-4f74-8b89-147faf8dc911 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 2036 microversion: 2.25 time: 0.185559 Aug 27 20:51:23.614102 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 370/665] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 2036 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:23.642997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f8201578-3ff3-4a73-9b24-74a854a05653 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: .version_select at 0x7ff84ff08c10>, body: {"keypair": {"name": "tempest-keypair-2772792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCja1JU6id/fkYVAr9KugWKH4s4yLPbQZiNUEe3sbEGQtxvlaznT7tnDMkPoQleMtEUiEMMM/U8pvt0Vdi3OpWEdbILxgufIwevQLngF5S4Ay5xejcD7JMD3ZDcKnr7gA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:23.658855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f8201578-3ff3-4a73-9b24-74a854a05653 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for project a5718b7012004d30983db126ff75e348. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:23.664039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f8201578-3ff3-4a73-9b24-74a854a05653 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for user c75d7c2bf734450886113fe48be6c44e and project a5718b7012004d30983db126ff75e348. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:23.687977 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f8201578-3ff3-4a73-9b24-74a854a05653 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.25 time: 0.049003 Aug 27 20:51:23.688714 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 296/666] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 20:51:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 20:51:23.856201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eec846-2882-49dd-9bb2-c672e5810b06", "tag": "7630223a-b7cb-45a1-92fd-86ad8ef3cf51"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:23.871591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.872404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.873010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.892090 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] Creating event network-changed:7630223a-b7cb-45a1-92fd-86ad8ef3cf51 for instance 87eec846-2882-49dd-9bb2-c672e5810b06 on nch2-master-1 Aug 27 20:51:23.898903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-db8534af-8c86-4a51-b777-93f443a32572 req-ef832b26-83b5-401c-a08f-dfb43fa1ab84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047741 Aug 27 20:51:23.900494 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 371/667] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:23.930907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.932028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:23.940596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.940596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.940596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.941149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.941959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.942452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.946639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:23.947727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:23.955758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.956515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.957161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.958168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.958857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.959477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.983557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:23.984199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:23.984737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:23.985333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid a04fedaf-2ac1-432d-9f68-efb74b25f522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:24.203562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:24.205914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:24.214694 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e23fb410-1401-446d-b7a3-46c673b7759d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1458 microversion: 2.1 time: 0.289339 Aug 27 20:51:24.216004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6e08d0f-f05a-4e40-bba8-c67311bbc508 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.272691 Aug 27 20:51:24.228226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 372/669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:24.228226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:24.228226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:24.229252 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 297/669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:23 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1458 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:24.232582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.233087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.233523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.234273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.234728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.235849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.319619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:24.348443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a4aa65a4-9371-45cf-a305-a5738836e722 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.130426 Aug 27 20:51:24.349314 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 373/670] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:24 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:24.424149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:24.424664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:24.430942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.431472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.431916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.432653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.433633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.434069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.450655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:24.451680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:24.462916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.464077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.464703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.466129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.466783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.468024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.472975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:51:24.565011 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f9e8377c-a19d-4aaf-b5fa-411c214e5bfc tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 204 len: 0 microversion: 2.1 time: 0.144161 Aug 27 20:51:24.567428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 298/671] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:24 2022] DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:24.585476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:24.592607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:24.600954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.602147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.602872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.603784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:24.604613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:24.605428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:24.780477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:24.784899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:24.795406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cfa9f83-af15-4197-8948-a56c11b913ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.350886 Aug 27 20:51:24.798478 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 374/672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:24 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:24.806245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-157167429", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "415741767", "adminPass": "***", "networks": [{"uuid": "49a5ad17-518d-4486-b42f-7fe3235e4c3c"}], "security_groups": [{"name": "tempest-securitygroup--385503260"}], "key_name": "tempest-keypair-730360253", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:24.958892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:24.975134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60af0e0d-9be4-4110-93e1-75d5f382a23c tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.404051 Aug 27 20:51:24.976682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 299/673] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:24 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:25.010890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] validate_networks() for [('49a5ad17-518d-4486-b42f-7fe3235e4c3c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:25.239280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:25.240870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:25.249592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.250596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.251265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.252760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.253725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.254333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.597166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:25.620398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-85ccdeaf-36cb-4e10-a4c1-145dccc1834f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.385691 Aug 27 20:51:25.625835 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 300/674] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:25 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:25.634428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:25.639960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:25.654897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.656592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.657178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.660774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.661780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.664733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.749554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.750344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.751525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.753479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lazy-loading 'fault' on Instance uuid a04fedaf-2ac1-432d-9f68-efb74b25f522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:25.842498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83653c8d8f0b4973b8cb91f2375a9b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9abafae3214a60a0117480d12d6b06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:25.851573 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7131734-7ef9-4aa0-a179-9752bb11e8ce tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 200 len: 1416 microversion: 2.1 time: 0.224319 Aug 27 20:51:25.852333 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 301/675] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:25 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 1416 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:25.857189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:25.857812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:25.864077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.864568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.865011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.865712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.866170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.866597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.914769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:25.915839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:25.916508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:25.916990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:25.917743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:25.928169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.928657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.929084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.929801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:25.930249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:25.930806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:25.950741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for project c61874976b164c9581dc6e4287f77389. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:25.955070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Getting quotas for user 2fd3010448cc4d0c8b6da2dd09a55055 and project c61874976b164c9581dc6e4287f77389. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:25.971163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:25.973182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:25.973903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:26.014560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ae27c45-193e-4bee-aaf9-5700c98064e1 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.160807 Aug 27 20:51:26.015329 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 302/676] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:25 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:26.021806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:26.030305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:26.039238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.039980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.040587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.041898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.043121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.043741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.083616 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59cc0ded-cbb3-41e4-b22f-d9ad0cfb7902 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.281606 Aug 27 20:51:26.086088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 375/677] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:51:26.120496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee62d827-38ff-4e34-9b1d-a3526c27a165", "tag": "d040742c-ff11-4d13-be4e-bf8a2ee6a8c2"}, {"server_uuid": "6a5de354-ac96-4d30-a18c-c7f6334f933d", "name": "network-vif-unplugged", "status": "completed", "tag": "e6309230-7340-4487-a237-df1a5e8f1f9c"}, {"server_uuid": "a04fedaf-2ac1-432d-9f68-efb74b25f522", "name": "network-vif-deleted", "tag": "19ce6f93-f11c-46cd-ac7a-0d03b3964a19"}, {"name": "network-changed", "server_uuid": "6a5de354-ac96-4d30-a18c-c7f6334f933d", "tag": "e6309230-7340-4487-a237-df1a5e8f1f9c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:26.139063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.139915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.140596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.161554 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Creating event network-changed:d040742c-ff11-4d13-be4e-bf8a2ee6a8c2 for instance ee62d827-38ff-4e34-9b1d-a3526c27a165 on nch2-master-1 Aug 27 20:51:26.162239 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Creating event network-vif-unplugged:e6309230-7340-4487-a237-df1a5e8f1f9c for instance 6a5de354-ac96-4d30-a18c-c7f6334f933d on nch2-master-1 Aug 27 20:51:26.162926 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Creating event network-vif-deleted:19ce6f93-f11c-46cd-ac7a-0d03b3964a19 for instance a04fedaf-2ac1-432d-9f68-efb74b25f522 on nch1-master-1 Aug 27 20:51:26.163603 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] Creating event network-changed:e6309230-7340-4487-a237-df1a5e8f1f9c for instance 6a5de354-ac96-4d30-a18c-c7f6334f933d on nch2-master-1 Aug 27 20:51:26.178329 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-60f11983-3b27-4946-9327-5c0a35a96492 req-20ea8483-2a52-46ce-9d04-ce81c8e38c90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 690 microversion: 2.1 time: 0.081929 Aug 27 20:51:26.180748 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 376/678] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 690 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:26.188346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:26.189232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:26.198807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.199531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.200724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.201624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.202088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.202521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.662261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:26.670581 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-640794e7-9c8b-4a2a-8dd2-04874b5db3a2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.653942 Aug 27 20:51:26.671266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 303/679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:26 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:26.676586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:26.677200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:26.684032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.684611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.685121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.685908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.686441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.686700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:26.686997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.695799 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42087b81-aebe-4b55-beb3-6c0d9940e6da tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.513472 Aug 27 20:51:26.696393 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 377/680] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:26 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:26.714805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-784510341", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "50ac8041-95db-40cf-b7b5-1165467e4b65"}], "security_groups": [{"name": "tempest-securitygroup--1293169414"}], "key_name": "tempest-keypair-2772792", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:26.762533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:26.771757 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36675369-1a28-43ea-91c7-2c0f2d46005a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1265 microversion: 2.1 time: 0.099373 Aug 27 20:51:26.772622 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 304/681] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:26 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:26.777325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:26.777981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:26.783954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.784433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.784859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.785607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:26.785976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:26.786394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:26.844286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] validate_networks() for [('50ac8041-95db-40cf-b7b5-1165467e4b65', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:27.020449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:27.031452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbc8ed3c-480b-4963-9d08-f3cee39cceee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.257310 Aug 27 20:51:27.032118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 305/682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:26 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:27.039986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.040912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.049451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.050300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.050775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.051572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.052239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.052694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.069778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 HTTP/1.1 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:27.071477 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.072861 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a04fedaf-2ac1-432d-9f68-efb74b25f522'} Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:27.073640 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.074921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.077531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:27.077531 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d5f3833d-8aed-4311-83d6-7b0f84c48757 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 404 len: 111 microversion: 2.1 time: 0.039399 Aug 27 20:51:27.077531 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 306/683] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:51:27.082678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.083293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.089764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.090908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.091373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.092643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.092857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.093458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.211184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:27.228831 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4409f94-bdfb-45e7-9bd9-f0bed778b994 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.154434 Aug 27 20:51:27.229423 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 307/684] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:27.234071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.234572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.240524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.241046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.241503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.242150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.242603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.243032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.257272 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 HTTP/1.1 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:27.258885 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.260326 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a04fedaf-2ac1-432d-9f68-efb74b25f522'} Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:27.261021 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.262122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.263506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:27.263506 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50e8abb8-1f28-4b51-a06e-fc17c6bb00d5 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 404 len: 111 microversion: 2.1 time: 0.029932 Aug 27 20:51:27.263506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 308/685] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:27 2022] DELETE /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:51:27.269113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.269716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: a04fedaf-2ac1-432d-9f68-efb74b25f522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.276044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.276528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.276973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.277663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.278132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.278550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.292347 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 HTTP/1.1 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:27.293828 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.295187 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a04fedaf-2ac1-432d-9f68-efb74b25f522'} Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:27.296068 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. Aug 27 20:51:27.297205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.298282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance a04fedaf-2ac1-432d-9f68-efb74b25f522 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:27.298282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-382f2741-e80c-4d8d-911e-9268d4b5ee11 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522" status: 404 len: 111 microversion: 2.1 time: 0.029941 Aug 27 20:51:27.298282 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 309/686] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/a04fedaf-2ac1-432d-9f68-efb74b25f522 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:51:27.304043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.304517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.310541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.311030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.311706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.312602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.313033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.313488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.329244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 HTTP/1.1 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:27.331194 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.332913 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '784a6000-e50e-48af-8077-5e0c2442eaa8'} Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:27.333717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.335126 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.336914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:27.337019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:27.337478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c21609f6-9e49-40af-b14c-1509a1a79293 tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "DELETE /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 404 len: 111 microversion: 2.1 time: 0.032616 Aug 27 20:51:27.337478 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 310/687] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:27 2022] DELETE /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:51:27.337641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:27.337641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:27.337641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:27.337641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:27.341488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.342487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] [instance: 784a6000-e50e-48af-8077-5e0c2442eaa8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.347432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.347939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.348449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.348906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.349355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.349464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.349814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.349924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.350279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.350687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.351227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.351823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.366321 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] HTTP exception thrown: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Request method failure captured: Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 HTTP/1.1 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOZ1TBT_pU0wH1_awjlPxafXnj7VCiien6Ef_QAAAgXt5_da7EU9KAxWEJkO-G4GM389cE4ED5SeFYaO4cNRdLyIpScGmjm6z9880vDnm3MMFn2nOmM-6g6zHnRsgdL5dUpWSqjfFRmbRyy732BnV2m6nAZOL7Ji_Tq25xrPmi2p34 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:27.367889 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cd9abafae3214a60a0117480d12d6b06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cd9abafae3214a60a0117480d12d6b06", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cd9abafae3214a60a0117480d12d6b06"}]}] Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: cd9abafae3214a60a0117480d12d6b06 Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1640622996 Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 83653c8d8f0b4973b8cb91f2375a9b98 Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersAdminTestJSON-1640622996-project Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.369461 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '784a6000-e50e-48af-8077-5e0c2442eaa8'} Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:27.370235 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. Aug 27 20:51:27.372125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:27.374062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] Returning 404 to user: Instance 784a6000-e50e-48af-8077-5e0c2442eaa8 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:27.374062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e6c98d9-6c03-4814-b57e-8556af5c863d tempest-DeleteServersAdminTestJSON-1640622996 tempest-DeleteServersAdminTestJSON-1640622996-project] 10.222.0.40 "GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8" status: 404 len: 111 microversion: 2.1 time: 0.031781 Aug 27 20:51:27.374062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 311/688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/784a6000-e50e-48af-8077-5e0c2442eaa8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:51:27.376136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:27.381458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for user c75d7c2bf734450886113fe48be6c44e and project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:27.392994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:27.395611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:27.444144 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5e4e31b-38b5-47a0-99f2-43c345f155e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.733193 Aug 27 20:51:27.445053 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 378/689] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:51:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:51:27.456256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.457026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.524912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:27.540709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:27.542684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:27.544022 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eeb6305a-c350-491a-8cb2-5229f6464a3f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1282 microversion: 2.25 time: 0.092214 Aug 27 20:51:27.545162 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 312/690] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:27.697691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.698467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.718496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:27.719191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:27.721682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:27.727612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.728115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.728553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.729267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.729714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.730139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.741241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.741951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.742176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.742892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:27.743403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:27.743935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:27.962751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:28.050272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.070163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-46d44e3a-1d48-4539-8e84-39d804524587 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.377521 Aug 27 20:51:28.070945 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 379/691] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:28.075765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:28.076448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:28.083654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.084223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.084609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.085312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.085743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.086159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.087602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.097770 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90c46879-b4a2-4b71-ac4d-fb8b24a20492 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.384050 Aug 27 20:51:28.098361 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 313/692] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:27 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:28.103200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:28.104015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:28.110728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.111671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.112486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.113251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.113714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.114513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.119630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:28.238751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.247549 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd01a4fa-015a-460a-a6ce-a2b67ed6b57f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1319 microversion: 2.1 time: 0.175341 Aug 27 20:51:28.248134 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 380/693] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:28 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:28.254654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:28.255871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:28.262805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.263414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.264061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.265030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.265737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.266383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.378459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.386921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d1b72cf-5073-40c9-9f44-2b426c5c9182 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.287248 Aug 27 20:51:28.387701 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 314/694] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:28 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:28.406021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:28.436073 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a49437f1-6297-40c5-9972-65ab83b72cfc tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.185855 Aug 27 20:51:28.436666 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 381/695] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:28 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:28.566208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:28.567074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:28.574417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.574757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.575397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.576297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:28.576750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:28.577350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:28.649822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.661638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.663072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:28.664215 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-036b08c1-b80c-487c-84ba-6f16b9fd5b72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1334 microversion: 2.25 time: 0.102237 Aug 27 20:51:28.664965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 315/696] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:28 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:29.095852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.097169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.104088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.104500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.104984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.105657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.106071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.106493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.129301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.130969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.159629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.160152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.160595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.164360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.164911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.165353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.332094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.343500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29a023ef-01f4-4343-b471-e4fb9bcae3ba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.251579 Aug 27 20:51:29.345668 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 382/697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:29.357674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.358690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.376877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.377690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.379287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.380057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.380522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.380956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.411924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.423294 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-943b0895-1c01-441f-8d19-60e3e9879dea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.307086 Aug 27 20:51:29.424599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 316/698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:29.447744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.448737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.463361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.464329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.466734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.467687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.468185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.468842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.615642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.637202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e974618-2c6f-4fe7-b2d3-c6f4815367fe tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.289414 Aug 27 20:51:29.638187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 383/699] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:29.643740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.644847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.652799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.653304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.653743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.654473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.655098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.655712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.659585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.669317 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-203835be-31f0-4f29-bc09-a73e80c65260 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.243464 Aug 27 20:51:29.671065 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 317/700] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:29.677648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02e2a34-e1a3-4782-8faa-0af7c8a57b35", "tag": "4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:29.690946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.691651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.692470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.719144 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] Creating event network-changed:4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd for instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 on nch1-master-1 Aug 27 20:51:29.726034 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a84bb1a0-367b-41bd-8631-b63ce4bcb63e req-4ae15074-382f-4812-a9a5-4a81f2fbdcf2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053717 Aug 27 20:51:29.728224 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 318/701] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:29.736244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:29.736980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:29.743845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.744577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.745175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.746039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:29.746654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:29.747083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:29.817331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:29.829166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.839008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.841273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:29.842592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-792bd293-c934-47ce-924f-91344214717a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1340 microversion: 2.25 time: 0.112729 Aug 27 20:51:29.856335 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 319/702] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1340 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:29.865464 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19daf483-a9c0-4d5e-a7fd-ea1024402661 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.225916 Aug 27 20:51:29.872489 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 384/703] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:29 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:30.366777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:30.368168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:30.375519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.376008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.376476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.378148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.378820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.379565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.445077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:30.445960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:30.453219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.453731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.454213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.455008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.455772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.456470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.674014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:30.687765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96858e1c-6877-48e3-bcfd-9a7d93977233 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.325101 Aug 27 20:51:30.690855 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 320/704] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:30 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:30.701048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:30.704529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:30.722928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.725031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.725922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.728533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.729227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.731935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.775380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:30.788872 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cde5ccd4-afd2-4e2a-8ace-819fc429e38b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.347504 Aug 27 20:51:30.789465 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 385/705] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:30 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:30.799773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:30.803884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:30.815635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.816992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.817673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:30.818525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:30.819121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:30.819737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.104085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:31.104700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:31.120896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75b06e78-a908-43eb-a978-4aaa1f54b8bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.326443 Aug 27 20:51:31.121497 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 386/706] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:30 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:31.132447 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d535d88d-f542-467b-a0e6-9b43d37459b8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.433702 Aug 27 20:51:31.132447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 321/707] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:30 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:31.132804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.137502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:31.138024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.138862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:31.146423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.147531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.148192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.149137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.149806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.150442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.150600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.151383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.152048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.153456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.155583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.156227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.225697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:31.234573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:31.236040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:31.238019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b7de675-8703-4c82-a0c9-16ceb3edefe6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1340 microversion: 2.25 time: 0.115579 Aug 27 20:51:31.238600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 387/708] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:31.243240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696e2116-4af3-4fa5-8e68-37bdf89f1a7f", "name": "network-vif-unplugged", "status": "completed", "tag": "353ee501-5b6c-4545-aa2c-f5c566028c7e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:31.257231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.257707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.258364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.258479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:31.270640 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] Creating event network-vif-unplugged:353ee501-5b6c-4545-aa2c-f5c566028c7e for instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f on nch2-master-1 Aug 27 20:51:31.276319 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c1a30e96-1a17-4e35-b550-ccb6ba8c1c1c req-4136fdb4-4266-4228-915a-f1260a90af6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036364 Aug 27 20:51:31.277132 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 388/709] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:31.277314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-229865ef-52c9-4728-b901-e3e096a02992 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.148839 Aug 27 20:51:31.291415 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 322/710] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:31.447663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8909f1f9-508f-47c9-a2e3-b1a8aecd9c7e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-300213487", "id": 1728787099, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:31.473138 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8909f1f9-508f-47c9-a2e3-b1a8aecd9c7e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.190987 Aug 27 20:51:31.473955 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 389/711] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:31 2022] POST /compute/v2.1/flavors => generated 429 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:31.487671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6571b2a-2526-4402-be9f-14377657247c tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.520400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6571b2a-2526-4402-be9f-14377657247c tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1728787099" status: 202 len: 0 microversion: 2.1 time: 0.036905 Aug 27 20:51:31.521458 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 323/712] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:51:31 2022] DELETE /compute/v2.1/flavors/1728787099 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:31.529383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10ed583f-4e0c-47dd-9823-94e707a693c2 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.555825 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10ed583f-4e0c-47dd-9823-94e707a693c2 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.029980 Aug 27 20:51:31.556508 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 390/713] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:31.577169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5f6cdf7-52ca-44b2-94cb-8837ac0d75ca tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-754938075", "id": 835250125, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:31.607888 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5f6cdf7-52ca-44b2-94cb-8837ac0d75ca tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.034641 Aug 27 20:51:31.609991 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 324/714] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:31 2022] POST /compute/v2.1/flavors => generated 413 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:51:31.621657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-51d88a1b-a793-4a7f-a4b6-bd8e05730ca1 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.679771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-51d88a1b-a793-4a7f-a4b6-bd8e05730ca1 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.054926 Aug 27 20:51:31.680767 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 391/715] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:31.698825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17a21320-7dac-4281-84b9-c2fc367bb2b1 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.713334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.714534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:31.730918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.734118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.735065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.735880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17a21320-7dac-4281-84b9-c2fc367bb2b1 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/835250125" status: 202 len: 0 microversion: 2.1 time: 0.040636 Aug 27 20:51:31.741677 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 325/716] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:51:31 2022] DELETE /compute/v2.1/flavors/835250125 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:31.748179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ae90888-f67e-40b9-9d81-3f9bdccf878e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.750595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.751280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.751757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.772329 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ae90888-f67e-40b9-9d81-3f9bdccf878e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028828 Aug 27 20:51:31.788311 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 326/717] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:31.794207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee9ece9c-7e12-4675-995b-ad5337236159 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-404601244", "id": 467953341, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:31.822569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee9ece9c-7e12-4675-995b-ad5337236159 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.031595 Aug 27 20:51:31.829978 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 327/718] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:31 2022] POST /compute/v2.1/flavors => generated 425 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:31.840612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:31.841755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:31.861252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.862114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.863024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:31.865573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:31.866370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:31.868671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.045546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.070523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-345d6948-e8de-4b6e-86e9-9ba643b75e38 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.359683 Aug 27 20:51:32.080192 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 392/719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:32.087279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1f67dd6-a187-4588-a294-c7a66eb5ed75 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.097507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:32.110868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.116502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1f67dd6-a187-4588-a294-c7a66eb5ed75 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/467953341" status: 202 len: 0 microversion: 2.1 time: 0.034526 Aug 27 20:51:32.117384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 393/720] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:51:32 2022] DELETE /compute/v2.1/flavors/467953341 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:32.120320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4fdafb30-3429-443a-865e-c4be4a17b24d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1472 microversion: 2.1 time: 0.286434 Aug 27 20:51:32.125786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696e2116-4af3-4fa5-8e68-37bdf89f1a7f", "name": "network-vif-deleted", "tag": "353ee501-5b6c-4545-aa2c-f5c566028c7e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:32.136035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.136849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.137259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 328/721] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:31 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1472 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:32.138235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.144218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0ed8f2b-fca4-41ef-b194-5df3c0954480 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.154424 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] Creating event network-vif-deleted:353ee501-5b6c-4545-aa2c-f5c566028c7e for instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f on nch2-master-1 Aug 27 20:51:32.161068 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-65855eeb-73ff-4428-acfc-2c43682d686c req-1c33dd3c-2652-4d63-8c6d-b9b3ddcfb4f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038370 Aug 27 20:51:32.161745 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 394/722] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:32.167628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.168318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:32.173198 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c0ed8f2b-fca4-41ef-b194-5df3c0954480 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034585 Aug 27 20:51:32.174722 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 329/723] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:32.177592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.178029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.178521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.179232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.179719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.180152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.195112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.196030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:32.202470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.203210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.203858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.204745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.205855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.206463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.382014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.390485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f22e1344-2a4c-4af6-81c7-62f519c54313 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.227351 Aug 27 20:51:32.391755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 395/724] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:32.401922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec6faa17-1648-43b5-a070-2eaaff2ef3a7 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-383816461", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:32.423754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec6faa17-1648-43b5-a070-2eaaff2ef3a7 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.031641 Aug 27 20:51:32.431232 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 396/725] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:32 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:32.434478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.441881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.442495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:32.445080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-69b130b1-827e-4d40-a2e6-c1190893921e tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.268948 Aug 27 20:51:32.447101 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 330/726] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:32.453749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.454252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.454806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.455088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.456049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.456711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:32.456840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.457533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.467224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.467883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.468382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.469186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:32.469717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:32.470202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:32.577496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:32.600340 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c2c86ccb-54ea-40ff-a12e-6ea4c4ed4a6a tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.151640 Aug 27 20:51:32.615667 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 331/727] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:32.621406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9c9011d-448e-49ab-b404-b4d7da4972f0 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.644002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.674700 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9c9011d-448e-49ab-b404-b4d7da4972f0 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/719bdb78-7283-453f-a927-87ef3e96a83a" status: 202 len: 0 microversion: 2.1 time: 0.071837 Aug 27 20:51:32.675355 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 332/728] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:32 2022] DELETE /compute/v2.1/flavors/719bdb78-7283-453f-a927-87ef3e96a83a => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:32.679225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.681111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:32.682531 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4961da73-a210-4f92-8abe-e978b945d339 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.257015 Aug 27 20:51:32.685705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcf7d766-f58c-4f74-837f-9a13d8db5457 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.696311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 397/729] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:32.710904 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fcf7d766-f58c-4f74-837f-9a13d8db5457 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031014 Aug 27 20:51:32.715636 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 333/730] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:32.731980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbc1b36d-844f-4f2d-b375-93c386f07bd8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1046786752", "id": "54ddb334-d809-4fab-ba24-eaa2f922260a", "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:32.753898 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbc1b36d-844f-4f2d-b375-93c386f07bd8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.025646 Aug 27 20:51:32.755806 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 398/731] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:32 2022] POST /compute/v2.1/flavors => generated 507 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:32.766076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec272f31-c453-485c-8175-36fdb8f7bdd9 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.786009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec272f31-c453-485c-8175-36fdb8f7bdd9 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/54ddb334-d809-4fab-ba24-eaa2f922260a" status: 202 len: 0 microversion: 2.1 time: 0.023672 Aug 27 20:51:32.786891 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 334/732] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:32 2022] DELETE /compute/v2.1/flavors/54ddb334-d809-4fab-ba24-eaa2f922260a => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:51:32.794836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6430b5e9-64b1-4ba6-a497-0b5bb32ac18e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.816293 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6430b5e9-64b1-4ba6-a497-0b5bb32ac18e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025196 Aug 27 20:51:32.817355 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 399/733] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:32.836774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f51b5fb-8ba9-4711-aa52-f6bfb4a03791 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1365877858", "id": 961361951, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:32.858020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f51b5fb-8ba9-4711-aa52-f6bfb4a03791 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.025102 Aug 27 20:51:32.859480 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 335/734] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:32.870892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9bf4b5f0-09fc-4130-951a-c51273301e7f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:32.879043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9bf4b5f0-09fc-4130-951a-c51273301e7f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/961361951" status: 200 len: 411 microversion: 2.1 time: 0.011861 Aug 27 20:51:32.879873 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 400/735] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/flavors/961361951 => generated 411 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:32.998475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0edee784-d7ad-4c5b-8475-4809215f07d9 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.022204 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0edee784-d7ad-4c5b-8475-4809215f07d9 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6215 microversion: 2.1 time: 0.134127 Aug 27 20:51:33.022991 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 336/736] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 6215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:33.041354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0832471c-a1e0-4007-b402-c4d59709dccd tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.059357 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0832471c-a1e0-4007-b402-c4d59709dccd tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/961361951" status: 202 len: 0 microversion: 2.1 time: 0.021494 Aug 27 20:51:33.060040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 401/737] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:51:33 2022] DELETE /compute/v2.1/flavors/961361951 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:51:33.069219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4608cf24-ccdf-4789-a779-c49362577ceb tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.095556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4608cf24-ccdf-4789-a779-c49362577ceb tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030761 Aug 27 20:51:33.097046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 337/738] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:33.105143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.105781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.115670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.116177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.116866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.117814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.118336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.118767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.121447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8081b1ea-0dca-4b27-87a6-999e45fcf190 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-47202600", "id": 1651789605, "os-flavor-access:is_public": "False"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:33.171874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8081b1ea-0dca-4b27-87a6-999e45fcf190 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.054114 Aug 27 20:51:33.172950 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 338/739] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:51:33.183569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.184195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.190679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.191201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.191790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.195018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.196101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.196361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.344257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.357312 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73875c88-2726-45ee-b319-eeb49a8d8815 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.262460 Aug 27 20:51:33.366297 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 402/740] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:33.379709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.386109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bf7daf5-5940-489f-a340-27b39245d1b2 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "1651789605"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:33.391842 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1085d2a-a0e4-474c-a5de-89cd68915271 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1490 microversion: 2.1 time: 0.217633 Aug 27 20:51:33.392771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 339/741] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1490 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:33.402906 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6bf7daf5-5940-489f-a340-27b39245d1b2 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] HTTP exception thrown: Flavor 1651789605 could not be found. Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bf7daf5-5940-489f-a340-27b39245d1b2 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Request method failure captured: Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 107 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoPSTEGrN4JZdC02TeORw51nRLLQddpMjfku1TC36vAIwpNwRckRDWldvu-uJbIXcTzBhWV5y51llTZes7UxoJva7XSK1P9TEpF5WMKtt0SOhOYrGCeAUoQ2xp5kEXa-4zg2DY5Nx6xKDwupJL8pqH6bp3VyMsl4QzxTLmF4CowVf40 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4ee0b88f431c4c99b2ed7002dadc22ff Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FlavorsAdminTestJSON-1961085213 Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:51:33.405382 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ee0b88f431c4c99b2ed7002dadc22ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4ee0b88f431c4c99b2ed7002dadc22ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4ee0b88f431c4c99b2ed7002dadc22ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4ee0b88f431c4c99b2ed7002dadc22ff"}]}] Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FlavorsAdminTestJSON-1961085213 Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4ee0b88f431c4c99b2ed7002dadc22ff Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1961085213 Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FlavorsAdminTestJSON-1961085213-project Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: badd217cbb08494fabaf79c46d45642c Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FlavorsAdminTestJSON-1961085213-project Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "test", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "1651789605"}} Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:51:33.406684 ncdv-master-1 devstack@n-api.service[140434]: exception: Flavor 1651789605 could not be found. Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '1651789605'}}} Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1651789605 could not be found. Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:33.407518 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1651789605 could not be found. Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:33.410420 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1651789605 could not be found. Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bf7daf5-5940-489f-a340-27b39245d1b2 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Returning 400 to user: Flavor 1651789605 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:33.414235 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6bf7daf5-5940-489f-a340-27b39245d1b2 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.039175 Aug 27 20:51:33.416413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.416604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.418575 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 403/742] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:33 2022] POST /compute/v2.1/servers => generated 81 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:51:33.428177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.429050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.429167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f372aef-5e34-4aff-8ab0-79f28d67932a tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.429801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.430757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.431515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.432177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.450235 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f372aef-5e34-4aff-8ab0-79f28d67932a tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1651789605" status: 202 len: 0 microversion: 2.1 time: 0.027257 Aug 27 20:51:33.451681 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 404/743] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:51:33 2022] DELETE /compute/v2.1/flavors/1651789605 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:33.461756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ce627fb2-65c2-4846-afbc-02660c59617d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.487999 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ce627fb2-65c2-4846-afbc-02660c59617d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.031798 Aug 27 20:51:33.489615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 405/744] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:33.494145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.494956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.503830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.504449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.505039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.505843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.506397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.507042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.513156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:33.656727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.667428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24bc369b-bfc5-430a-ae48-6d1ace17a558 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.257050 Aug 27 20:51:33.682741 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 340/745] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:33.689619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d7842e5-9da0-46a8-9d07-56751e10de6d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-134001829", "id": 423435395, "os-flavor-access:is_public": "False"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:33.712207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.712756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2d7842e5-9da0-46a8-9d07-56751e10de6d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.027981 Aug 27 20:51:33.714266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 341/746] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:33 2022] POST /compute/v2.1/flavors => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:33.727297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.728064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.734635 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9af21c0-9450-4f92-addf-3c472baeeb31 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.244015 Aug 27 20:51:33.735177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.735303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 406/747] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:33.735900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.737273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.738238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.738735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.739255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.743608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.744233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:33.752924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.753340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.753962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.754681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.755137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.755593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.855871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:33.874334 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4047b63-4362-46cf-8ac9-3a9cd85f55bd tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.158758 Aug 27 20:51:33.883496 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 342/748] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:33.890791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eec846-2882-49dd-9bb2-c672e5810b06", "name": "network-vif-plugged", "status": "completed", "tag": "7630223a-b7cb-45a1-92fd-86ad8ef3cf51"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:33.901979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:33.902790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:33.903241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:33.915692 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] Creating event network-vif-plugged:7630223a-b7cb-45a1-92fd-86ad8ef3cf51 for instance 87eec846-2882-49dd-9bb2-c672e5810b06 on nch2-master-1 Aug 27 20:51:33.920023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.921191 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6cfc2b57-16f2-4ece-a231-8ac55744629c req-9e93d5e0-1df9-475a-9483-c150a6301654 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035113 Aug 27 20:51:33.922072 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 343/749] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:33.927948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c9e5c7e-7bb7-489d-9213-17808511db4d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-322399795", "id": 1163172429, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:33.931677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.933127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:33.934267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-717a42d1-da63-40ca-8e12-b0ecc33c277d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.197923 Aug 27 20:51:33.935202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 407/750] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:33.952527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:33.959282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c9e5c7e-7bb7-489d-9213-17808511db4d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.036291 Aug 27 20:51:33.959910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 344/751] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:33.971978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc6b0787-9932-4363-9053-bd578c9bce9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:33.990962 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc6b0787-9932-4363-9053-bd578c9bce9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.022807 Aug 27 20:51:33.991842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 408/752] 10.222.0.40 () {58 vars in 1169 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:34.004719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a56cb130-b6db-4d95-b823-2fbd79aaecf8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.023756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a56cb130-b6db-4d95-b823-2fbd79aaecf8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.023870 Aug 27 20:51:34.024316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 345/753] 10.222.0.40 () {58 vars in 1177 bytes} [Sat Aug 27 20:51:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:34.036680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5439aa0a-be9d-40c6-9785-d5706cc8ed0e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.046468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5439aa0a-be9d-40c6-9785-d5706cc8ed0e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.013466 Aug 27 20:51:34.047035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 409/754] 10.222.0.40 () {58 vars in 1171 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:34.059005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3213c359-c2af-4da3-b34f-b57c7f7317c6 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.069206 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3213c359-c2af-4da3-b34f-b57c7f7317c6 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.013928 Aug 27 20:51:34.069791 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 346/755] 10.222.0.40 () {58 vars in 1169 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:34.083923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-544953e4-9d06-4f18-92f8-e047c37dcb8d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.105986 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-544953e4-9d06-4f18-92f8-e047c37dcb8d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.027799 Aug 27 20:51:34.106838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 410/756] 10.222.0.40 () {58 vars in 1169 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.124413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50d83af8-3bbc-48b1-8cbb-4019f86ef224 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.146117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50d83af8-3bbc-48b1-8cbb-4019f86ef224 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.025388 Aug 27 20:51:34.146768 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 347/757] 10.222.0.40 () {58 vars in 1175 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.165620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7558356-9cdc-44e8-9717-9a0a6502b97f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.187695 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7558356-9cdc-44e8-9717-9a0a6502b97f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.025625 Aug 27 20:51:34.188624 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 411/758] 10.222.0.40 () {58 vars in 1173 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.208200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5c9e366-bcd1-4447-8954-b14178c5527a tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.232020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d5c9e366-bcd1-4447-8954-b14178c5527a tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.028097 Aug 27 20:51:34.232649 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 348/759] 10.222.0.40 () {58 vars in 1169 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.251767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0a583283-50e7-48f7-a0dd-9efc5e019fde tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.272591 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0a583283-50e7-48f7-a0dd-9efc5e019fde tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1163172429" status: 202 len: 0 microversion: 2.1 time: 0.024803 Aug 27 20:51:34.273318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 412/760] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:51:34 2022] DELETE /compute/v2.1/flavors/1163172429 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:34.281821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7162d3a7-56da-47bf-b1b2-b02b7a0a9a10 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.304527 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7162d3a7-56da-47bf-b1b2-b02b7a0a9a10 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026395 Aug 27 20:51:34.305415 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 349/761] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:34.328072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45d0a068-4a13-4db5-97a3-78ce0e0bae9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.351796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-45d0a068-4a13-4db5-97a3-78ce0e0bae9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/423435395" status: 202 len: 0 microversion: 2.1 time: 0.029977 Aug 27 20:51:34.352485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 413/762] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:51:34 2022] DELETE /compute/v2.1/flavors/423435395 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:34.360572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d886d082-de57-4e0f-bfb8-4a9ff7910164 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.383154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.383462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d886d082-de57-4e0f-bfb8-4a9ff7910164 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026128 Aug 27 20:51:34.384112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 350/763] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.384257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:34.390988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.391514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.391951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.392735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.393186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.393805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.404377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d79f03df-0524-4fba-a7d1-033157e0a288 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1972764787", "id": 497449324, "os-flavor-access:is_public": "False"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:34.428592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d79f03df-0524-4fba-a7d1-033157e0a288 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.027886 Aug 27 20:51:34.429470 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 351/764] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:34 2022] POST /compute/v2.1/flavors => generated 412 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:34.442056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.442762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:34.452405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.452916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.453356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.454095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.454699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.455418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.600342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:34.617640 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0afb5f9-29fe-42e3-b9c4-fecf7d20e309 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.235479 Aug 27 20:51:34.632360 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 414/765] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.640164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-775b4a73-2e0b-4b8b-92b0-457f972fd63f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.646860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:34.655520 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d67e52b-f911-4dab-b752-6e9cc0cbf4a8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1490 microversion: 2.1 time: 0.218457 Aug 27 20:51:34.656244 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 352/766] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1490 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.663822 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-775b4a73-2e0b-4b8b-92b0-457f972fd63f tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030160 Aug 27 20:51:34.664535 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 415/767] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.682002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fe75ff64-125f-4c5f-9c63-00d06122e280 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.688121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.688753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:34.695089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.695625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.696065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.696769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.697225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.697647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.718365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fe75ff64-125f-4c5f-9c63-00d06122e280 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040023 Aug 27 20:51:34.719208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 353/768] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:34.737458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-967b6bae-9e97-488e-adb4-ebca62939dcb tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.755172 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-967b6bae-9e97-488e-adb4-ebca62939dcb tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/497449324" status: 202 len: 0 microversion: 2.1 time: 0.021370 Aug 27 20:51:34.755893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 354/769] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:51:34 2022] DELETE /compute/v2.1/flavors/497449324 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:51:34.760589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:34.762367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:34.769578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.770769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.771218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.771974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:34.772607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:34.774167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:34.786731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:35.026896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.038047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14add9f4-df82-4392-8cce-b0c6c6a81a4b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.353554 Aug 27 20:51:35.038903 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 416/770] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:35.044079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb504b36-1a16-4a14-ac60-e32903b4f59c tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.083758 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb504b36-1a16-4a14-ac60-e32903b4f59c tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.043217 Aug 27 20:51:35.084318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 417/771] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.089303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.090693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.091542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:35.100537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0b2c2e9c-be7d-4cd8-a45e-8e70ed38b523 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.343553 Aug 27 20:51:35.103578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 355/772] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:34 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.108636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.109526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.110064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.113060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.113842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.116781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:35.119766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.121014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.126809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.129625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.130073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.139723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.140206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.140656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.251138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:35.279164 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c924e7f-c9ec-4aaf-9796-33e4cd44b54e tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1927 microversion: 2.75 time: 0.192495 Aug 27 20:51:35.281016 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 418/773] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1927 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:35.290718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ba40434-b5a9-426a-bf26-af82fc10854d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1511212762", "id": 1441104959, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:35.311960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.324238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.327304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ba40434-b5a9-426a-bf26-af82fc10854d tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.044497 Aug 27 20:51:35.327869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.328407 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 419/774] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:35.329037 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3124af04-3909-4504-8af9-4d374767f659 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.224283 Aug 27 20:51:35.329604 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 356/775] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:35.346938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8eef4a81-6dc6-42d9-a970-03b56da905e5 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.369254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8eef4a81-6dc6-42d9-a970-03b56da905e5 tempest-FlavorsAdminTestJSON-1961085213 tempest-FlavorsAdminTestJSON-1961085213-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.026246 Aug 27 20:51:35.369845 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 420/776] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.388250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df0ba057-62c2-4e69-9d5d-8023a79a9a9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.409624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df0ba057-62c2-4e69-9d5d-8023a79a9a9e tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1441104959" status: 202 len: 0 microversion: 2.1 time: 0.024970 Aug 27 20:51:35.410289 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 357/777] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:51:35 2022] DELETE /compute/v2.1/flavors/1441104959 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:35.419185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a78c78b0-9d5a-4dea-bd1f-64749d7757d8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.443247 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a78c78b0-9d5a-4dea-bd1f-64749d7757d8 tempest-FlavorsAdminTestJSON-1298049110 tempest-FlavorsAdminTestJSON-1298049110-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028296 Aug 27 20:51:35.443883 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 421/778] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.646578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.647379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:35.654998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.655539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.656107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.656813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.657261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.657683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.679572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:35.680556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:35.687860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.689285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.690175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.691119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.691809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.692479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.887926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.898866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40bd5ac7-fc47-443b-a22e-47bfbce9f1e9 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.258178 Aug 27 20:51:35.899805 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 358/779] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.911980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:35.926523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:35.927007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:35.927743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:35.939982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:35.943045 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] Creating event network-changed:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch1-master-1 Aug 27 20:51:35.950677 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b54ab17b-fef4-4e47-af01-8d4963fd6967 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.276034 Aug 27 20:51:35.952073 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 422/780] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:35 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:35.957236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f201b5b7-5ad7-401f-bc54-c024bd50f02d req-b3585560-b055-4fc2-beaa-e75b60315f00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055119 Aug 27 20:51:35.957841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 359/781] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:36.065911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.066915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.075886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.076684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.077093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.079028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.079715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.080373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.126212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.127495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.135406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.136434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.137031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.138986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.139648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.140253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.277507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:36.288771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c9c382a-10e4-4ac8-833b-a89cb265e41e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.227999 Aug 27 20:51:36.290047 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 423/782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:36.318444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.319080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.330120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.330619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.331132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.332763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.333546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.334332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.338408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:36.364750 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3e472a2-795d-4450-a162-cb3d636c25de tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.242819 Aug 27 20:51:36.376092 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 360/783] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:36.376288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.378549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.390300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.391189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.392020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.394218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.395080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.395872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.479235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:36.502617 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f237326-c7a6-49f4-b8c0-401858a8104c tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1945 microversion: 2.75 time: 0.198286 Aug 27 20:51:36.508705 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 424/784] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1945 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:36.577818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:36.591678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:36.593717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:36.595787 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19956ab4-55d4-4e7a-b288-2359c18daef4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.227213 Aug 27 20:51:36.611890 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 361/785] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:36.921920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.922636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.930895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.931567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.932244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.933166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.933738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.934251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.973660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:36.974463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:36.981842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.982701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.983682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:36.984903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:36.987045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:36.988023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.178680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.186591 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbaffd20-9bb1-4372-9400-0fc4dc1527f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.269310 Aug 27 20:51:37.187181 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 425/786] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:37.245372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.256690 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-589e403d-7275-4ac1-9190-8d8462331169 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.287338 Aug 27 20:51:37.272167 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 362/787] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:36 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:37.310218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:37.311575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:37.318662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.319125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.319877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.320702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.321264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.321762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.357788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:37.389715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=20 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:37.404597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:37.405479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:37.420920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.421567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.422016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.422794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.423257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.423917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.486850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.504402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e32965e4-fd7b-4c9d-9043-206353db24db tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.197989 Aug 27 20:51:37.505046 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 426/788] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:37 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:37.511555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "name": "network-vif-unplugged", "status": "completed", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:37.515996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=13,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:37.525321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.525808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.526240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.539515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] Creating event network-vif-unplugged:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:51:37.540202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=30 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:37.549478 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-65fd42e0-6772-48b5-ba93-148fa78bbf27 req-fac7109d-0992-4771-8fb5-f69fe2e518eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043168 Aug 27 20:51:37.550104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 427/789] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:37.555055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:37.555787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:37.562080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.562572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.563014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.563750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.564208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.564760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.667160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.673450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:37.677779 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2708c580-b875-42a3-a2f4-dac838b6d77b tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.277773 Aug 27 20:51:37.691384 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 363/790] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:37 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:37.691384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:37.691384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:37.698635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.699136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.699876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.701083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:37.702767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94f86651-65ae-433c-9db0-88ad4425d0b6 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1933 microversion: 2.75 time: 0.150489 Aug 27 20:51:37.702894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:37.702894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:37.716211 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 428/791] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:37 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1933 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:37.863713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.872894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.874405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:37.875673 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf82dd46-d2d5-40b6-8027-6444a155c540 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.195315 Aug 27 20:51:37.876299 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 364/792] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:37 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:38.208151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.208834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.216259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.216742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.217179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.217886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.218327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.218757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.281397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.282213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.293126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.295323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.295839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.298107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.298768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.302824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.406106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:38.423535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5c9cbbe9-742b-4478-b2d3-0d3efea5bae2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.219273 Aug 27 20:51:38.437192 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 429/793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:38.465071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:38.473326 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89077b83-e8ba-47e2-9806-271f010fabea tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.196054 Aug 27 20:51:38.473889 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 365/794] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:38.527576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.528190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.534362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.534847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.535276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.535999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.536449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.536865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.671379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:38.680027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bae996ab-cf0c-436b-85c2-17bc7a813d30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.156450 Aug 27 20:51:38.680621 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 430/795] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:38.702182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.702807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.709160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.709683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.710158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.713635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.713635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.713635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.728706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.736665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.747727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.748310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.748893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.749847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.750598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.751585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.842789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:38.862607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a72aacd-a7dd-4095-9802-30ca025eba60 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1933 microversion: 2.75 time: 0.137576 Aug 27 20:51:38.863270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 431/796] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1933 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:38.904147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:38.904703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:38.911972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.912944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.913372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.914170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:38.914607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:38.915013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:38.924211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:38.932976 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4fda491c-d581-469b-aefa-c41d93a96444 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.234698 Aug 27 20:51:38.933562 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 366/797] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:39.054171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:39.061237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef20717f-2a32-4ce7-8013-bba6472b51e2 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1292966672", "id": 557359873, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:39.064006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:39.065550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:39.066695 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fde51f97-9dbf-404e-95bf-94947e7fd6fe tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.170966 Aug 27 20:51:39.067912 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 432/798] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:38 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:39.101141 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef20717f-2a32-4ce7-8013-bba6472b51e2 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.166296 Aug 27 20:51:39.103685 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 367/799] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:51:38 2022] POST /compute/v2.1/flavors => generated 468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:51:39.117393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2e0b9d8f-8f90-4772-8a62-b79bd3ac6acb tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:39.300479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2e0b9d8f-8f90-4772-8a62-b79bd3ac6acb tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors/557359873/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.187748 Aug 27 20:51:39.301117 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 433/800] 10.222.0.40 () {62 vars in 1262 bytes} [Sat Aug 27 20:51:39 2022] POST /compute/v2.1/flavors/557359873/os-extra_specs => generated 62 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:39.311334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d5ab6ca-b4b6-4e46-95be-de4be6411845 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:39.333924 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d5ab6ca-b4b6-4e46-95be-de4be6411845 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/557359873" status: 202 len: 0 microversion: 2.86 time: 0.026407 Aug 27 20:51:39.334484 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 368/801] 10.222.0.40 () {60 vars in 1199 bytes} [Sat Aug 27 20:51:39 2022] DELETE /compute/v2.1/flavors/557359873 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:39.343863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fede3607-7c7a-4f1f-85a2-5714364f5ee5 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:39.368132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fede3607-7c7a-4f1f-85a2-5714364f5ee5 tempest-FlavorMetadataValidation-763481857 tempest-FlavorMetadataValidation-763481857-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.028591 Aug 27 20:51:39.368686 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 434/802] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:51:39 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:39.445675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:39.446576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:39.454553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.455187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.456092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.456821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.457279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.457705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.494065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:39.494957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:39.528311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.529609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.531868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.537130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.543127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.546255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.564778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:39.649401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:39.663587 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-468ab116-7a3c-4205-8642-8f7510e622b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.221081 Aug 27 20:51:39.683064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 369/803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:39 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:39.695476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02e2a34-e1a3-4782-8faa-0af7c8a57b35", "name": "network-vif-plugged", "status": "completed", "tag": "4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:39.714619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.721689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.722281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.751112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] Creating event network-vif-plugged:4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd for instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 on nch1-master-1 Aug 27 20:51:39.763601 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4e6c8a0b-8dbe-45ab-adc1-05a79760a9a8 req-6935ecd4-6282-49de-a5d5-2f5636e89dc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078352 Aug 27 20:51:39.766981 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 370/804] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:39.777436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:39.781134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:39.797641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.798429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.799517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:39.800611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:39.801466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:39.806875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.182697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.192130 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a5981fea-8bf2-4cf9-8387-dc39d35ce706 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.701747 Aug 27 20:51:40.205875 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 435/805] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:39 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:40.210672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:40.211271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:40.218048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.218550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.218987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.219940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.220400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.220891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.230229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.238557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7df92fe4-8b58-42d5-a2ad-34d4f2e349f2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.469600 Aug 27 20:51:40.239115 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 371/806] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:39 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:40.270965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:40.275032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:40.284670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.285358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.287101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.288856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.289357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.289973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.322608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:40.349942 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c67c6c8c-3667-4a61-aca6-3f2fc211cd3d tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1933 microversion: 2.75 time: 0.142781 Aug 27 20:51:40.350565 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 436/807] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:40 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1933 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:40.356070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:40.357017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:40.364374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.366352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.367050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.368214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.369845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.370518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.486617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.495380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50c49b5d-ad1d-47b5-bfa4-2569df7cc27f tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.241302 Aug 27 20:51:40.496304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 372/808] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:40 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:40.532956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.541804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.543240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.544448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28f18765-dc8c-42dc-8fbb-25093de53216 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.192154 Aug 27 20:51:40.545006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 437/809] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:40 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:40.689986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:40.690605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:40.697799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.698307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.698750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.699503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:40.699965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:40.700390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:40.892908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:40.907050 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afc5560e-d829-429b-9872-6fbc84133a81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.221063 Aug 27 20:51:40.907758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 373/810] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:40 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:41.213591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.214215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.221088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.221589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.222031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.222773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.223199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.223659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.263271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.264174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.270710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.271206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.271675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.272501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.272966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.273398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.504034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.513927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14844f17-97d1-4083-adec-ea1b7df8b09a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.304237 Aug 27 20:51:41.514518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 438/811] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:41.520027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.520868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.535254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.536526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.537012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.537766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.538236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.538923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.539378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.550958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d72dd8bf-9b6c-457e-ad55-91ea608aed59 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.291844 Aug 27 20:51:41.552327 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 374/812] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:41.570488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.571298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.579847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.581376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.582002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.583152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.583795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.584395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.625096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:41.647744 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8a6558d-ff3e-452b-b2b2-452c9d751ec3 tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1933 microversion: 2.75 time: 0.131638 Aug 27 20:51:41.648946 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 439/813] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1933 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:41.654406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.655232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.663398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.663860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.664301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.665199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.665817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.666278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.785164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.794316 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cd8e223-2022-4fc2-b332-7c7089444797 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.240817 Aug 27 20:51:41.794918 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 375/814] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:41.813511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee62d827-38ff-4e34-9b1d-a3526c27a165", "name": "network-vif-plugged", "status": "completed", "tag": "d040742c-ff11-4d13-be4e-bf8a2ee6a8c2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:41.824349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.825139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.825758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.830624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:41.840771 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] Creating event network-vif-plugged:d040742c-ff11-4d13-be4e-bf8a2ee6a8c2 for instance ee62d827-38ff-4e34-9b1d-a3526c27a165 on nch2-master-1 Aug 27 20:51:41.847428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9913d6c1-74cf-4408-b2f1-aefa26fef778 req-346ca477-c335-4c99-a1c1-43c9fee7273d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037626 Aug 27 20:51:41.848330 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 376/815] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:41.864389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.875126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.877168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:41.878509 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6d33bc2-a4fd-49eb-aed8-5e0c0530c945 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.228075 Aug 27 20:51:41.879264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 440/816] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:41.929389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:41.930411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:41.939281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.940114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.941692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:41.942762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:41.943456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:41.944933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.096921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:42.104998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c86602a-e938-4518-b1a1-59bef2b643cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.180095 Aug 27 20:51:42.105634 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 377/817] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:41 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:42.536207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:42.536824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:42.543946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.544442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.544883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.545780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.546397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.546833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.576532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:42.577050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:42.584110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.584604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.585043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.585959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.586426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.586852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.747246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:42.756983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6dc5fd8-ee74-4eb1-8642-3ace14246046 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.225331 Aug 27 20:51:42.757943 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 441/818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:42 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:42.767056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:42.768341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:42.774841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.775500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.776027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.776618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:42.776945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.777488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.778023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.785127 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e685451f-0303-48e2-8d93-f3b40bd5dd8d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.212559 Aug 27 20:51:42.786038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 378/819] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:42 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:42.816043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:42.816659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:42.825694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.826681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.827306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.828221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.828822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.829401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.887094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] Lazy-loading 'services' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:42.907110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-172e9ceb-4ee3-4cc1-8cb7-0b1dfa6b06cf tempest-ServersAdmin275Test-1205482679 tempest-ServersAdmin275Test-1205482679-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1918 microversion: 2.75 time: 0.148451 Aug 27 20:51:42.908091 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 442/820] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:42 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1918 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:42.919397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:42.920330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:42.927303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.928040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.928636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:42.930144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:42.930757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:42.931355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.054712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.063808 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-38f71fbe-90b9-4ee0-b936-2c9f0c535dad tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.252024 Aug 27 20:51:43.064470 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 379/821] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:42 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:43.082504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.082928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:43.088975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.089458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.089890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.090928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.091439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.091862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.114457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.117863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:51:43.123208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.124959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.126103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f2c23c74-6157-4ccd-9ba1-77915bf6eeba tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.216875 Aug 27 20:51:43.127020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 443/822] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:42 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:43.131907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.132741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:43.139464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.140331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.141245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.142171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.143017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.143733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.205301 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29f7ce05-f5ea-4ad7-9bcc-6773226d7e24 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 204 len: 0 microversion: 2.75 time: 0.126958 Aug 27 20:51:43.206016 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 380/823] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:51:43 2022] DELETE /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:51:43.281165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.290168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b25a3d54-3cd4-44a1-8456-2a198363848c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1318 microversion: 2.1 time: 0.161928 Aug 27 20:51:43.290754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 444/824] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:43.295524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.296364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:43.302392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.303073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.303539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.304396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.304855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.305281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.336910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-985f0f3a-821c-4905-aa46-4cd66ac1889c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Action: 'create', calling method: .version_select at 0x7ff84f8ca8b0>, body: {"keypair": {"name": "tempest-keypair-1542937068", "type": "ssh", "user_id": "5c5c13176e2e4948943624381ff90dac", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/rV+afIX3L0Wb040A3EVWDlWF7iZzCMOzvL0mwy3q6mRwGjpoD8oSGYunXdIgiqHJ1A+bK9F2evptBXO9i6z77KYuKAgOxdzznykPg5RjdaI1cThEwxiPIlhikIUmAcA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:43.343555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:43.355121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-985f0f3a-821c-4905-aa46-4cd66ac1889c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:43.359787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-985f0f3a-821c-4905-aa46-4cd66ac1889c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for user 2793c86097b5459f82b328eda32c9872 and project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:43.377965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.384731 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-985f0f3a-821c-4905-aa46-4cd66ac1889c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.177543 Aug 27 20:51:43.385342 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 381/825] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 20:51:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 20:51:43.387638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.389154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:43.394306 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32b1dd4d-867d-4042-898e-8beb7edc6907 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1443 microversion: 2.75 time: 0.102593 Aug 27 20:51:43.394878 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 445/826] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:43.399486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aed1d144-c84b-4d0c-9035-5ee9a5a147e2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Action: 'create', calling method: .version_select at 0x7ff84f3501f0>, body: {"keypair": {"name": "tempest-keypair-1985041027", "type": "ssh", "user_id": "5c5c13176e2e4948943624381ff90dac", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR2zzQDBLr3c3zcx38ZYk3Rn8tbN/2DpvUg3dwmgZorCiqATvIuztO/NDN5fuII0XUgliEyHikLlt5+pFuTY/yj1zQfcB2qA42Ssyf9WrAbamAdyVHVi6BUwJSvlawr/w=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:43.416472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-aed1d144-c84b-4d0c-9035-5ee9a5a147e2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:43.420780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-aed1d144-c84b-4d0c-9035-5ee9a5a147e2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for user 2793c86097b5459f82b328eda32c9872 and project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:43.444966 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aed1d144-c84b-4d0c-9035-5ee9a5a147e2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.049209 Aug 27 20:51:43.445569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 382/827] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 20:51:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 20:51:43.456060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff1fa38e-b759-41c8-806c-280854ce144c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Calling method '.version_select at 0x7ff84f360430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.464840 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff1fa38e-b759-41c8-806c-280854ce144c tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1542937068?user_id=5c5c13176e2e4948943624381ff90dac" status: 200 len: 512 microversion: 2.10 time: 0.012594 Aug 27 20:51:43.465730 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 446/828] 10.222.0.40 () {60 vars in 1340 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1542937068?user_id=5c5c13176e2e4948943624381ff90dac => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:51:43.479568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c860bf29-83d8-431e-9401-0b0bc018d8c2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Action: 'create', calling method: .version_select at 0x7ff84f3a05e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-770935061", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH++Oy3Zjb+OIbaFbW800HB1XGyvS4ufqX56FwWRP6jbDW5pZvbVLG4f5IM4Fjp+xrlNpVNpN5YTU8EwfauXAzYAbpGVH8Y6oSWlbKg+FZa89TQivJSJxnqc8UgfKVowQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:43.497142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c860bf29-83d8-431e-9401-0b0bc018d8c2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:43.502617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c860bf29-83d8-431e-9401-0b0bc018d8c2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Getting quotas for user 2793c86097b5459f82b328eda32c9872 and project c2a0f27744b346ef862befdec4c0cccb. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:43.528748 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c860bf29-83d8-431e-9401-0b0bc018d8c2 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.052916 Aug 27 20:51:43.529375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 383/829] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 20:51:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 20:51:43.542880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-35727d44-a59c-443e-b853-c4633346f4c3 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Calling method '.version_select at 0x7ff84f3e8b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.548485 ncdv-master-1 devstack@n-api.service[140434]: WARNING oslo_db.sqlalchemy.utils [None req-35727d44-a59c-443e-b853-c4633346f4c3 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 20:51:43.557617 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-35727d44-a59c-443e-b853-c4633346f4c3 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "GET /compute/v2.1/os-keypairs?user_id=5c5c13176e2e4948943624381ff90dac" status: 200 len: 726 microversion: 2.10 time: 0.020876 Aug 27 20:51:43.558130 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 447/830] 10.222.0.40 () {60 vars in 1259 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/os-keypairs?user_id=5c5c13176e2e4948943624381ff90dac => generated 726 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:51:43.569187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0166345-5cd7-4b4e-9672-301680fc6278 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Calling method '.version_select at 0x7ff84f350af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.591961 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0166345-5cd7-4b4e-9672-301680fc6278 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-770935061" status: 204 len: 0 microversion: 2.10 time: 0.026468 Aug 27 20:51:43.592571 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 384/831] 10.222.0.40 () {60 vars in 1322 bytes} [Sat Aug 27 20:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-770935061 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:51:43.604150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d805549-66c6-421a-930c-0fc082c27bd6 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Calling method '.version_select at 0x7ff84f4134c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.627916 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d805549-66c6-421a-930c-0fc082c27bd6 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985041027?user_id=5c5c13176e2e4948943624381ff90dac" status: 204 len: 0 microversion: 2.10 time: 0.029553 Aug 27 20:51:43.628492 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 448/832] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985041027?user_id=5c5c13176e2e4948943624381ff90dac => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:51:43.637057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80a948b5-a9ca-4fea-a730-ae4694ec2219 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] Calling method '.version_select at 0x7ff84f47d4c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.657755 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80a948b5-a9ca-4fea-a730-ae4694ec2219 tempest-KeyPairsV210TestJSON-1024064893 tempest-KeyPairsV210TestJSON-1024064893-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542937068?user_id=5c5c13176e2e4948943624381ff90dac" status: 204 len: 0 microversion: 2.10 time: 0.024460 Aug 27 20:51:43.658324 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 385/833] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542937068?user_id=5c5c13176e2e4948943624381ff90dac => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:51:43.779755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.780567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:43.788508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.788990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.789606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.790525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.790989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.791444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.809105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:43.811141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:43.821678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.822175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.824589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:43.827145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:43.827879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:43.828809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.005277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.015129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3585b2b-2814-42c6-9425-837028e85aef tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.240734 Aug 27 20:51:44.015954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 449/834] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:44.024799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "name": "network-vif-plugged", "status": "completed", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:44.038860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.039526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.040260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.054215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] Creating event network-vif-plugged:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:51:44.059532 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3a869245-c1e7-42c2-b1ef-c4bab30033ad req-5294634e-c219-4cbb-80ef-153918d0e32a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040735 Aug 27 20:51:44.060379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 450/835] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:44.072035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.079988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34741d4f-5d6f-4759-a70d-2d38401a309e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.276910 Aug 27 20:51:44.080455 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 386/836] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:43 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:44.085996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.086705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:44.094092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.094854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.095296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.096209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.096672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.097099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.150863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.152463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:44.159983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.161500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.161980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.162850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.163995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.164515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.337916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.347729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af7f7678-dd77-468c-9736-274d59ead2ed tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.265754 Aug 27 20:51:44.348808 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 451/837] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:44.353843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.354504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:44.361300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.362051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.362832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.363832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.364465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.365070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.405606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.414149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.415609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.416821 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e308b68-57e7-44bc-a0cd-9afcca8a996a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.271317 Aug 27 20:51:44.417377 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 387/838] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:44.421768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.422362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:44.428880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.429464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.429958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.430721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.431238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.431745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.520121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.528726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.530185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.535570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82bceec9-289d-43c2-b8d0-fe110f14859d tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1443 microversion: 2.75 time: 0.117155 Aug 27 20:51:44.536155 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 388/839] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1443 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:44.568617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.577777 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4945cbe3-9b9b-4bd3-9945-6f090524aa7d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1468 microversion: 2.1 time: 0.227564 Aug 27 20:51:44.578365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 452/840] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1468 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:44.598947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.599659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:44.606440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.606937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.607448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.608165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.608716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.609156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.755150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.763351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56d73679-9ee2-4acb-99f5-539aeca03931 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1468 microversion: 2.1 time: 0.168334 Aug 27 20:51:44.763926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 389/841] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:44.783913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:44.789105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:44.790251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Searching by: {'reservation_id': 'r-98q7nt8j', 'deleted': False, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:51:44.797657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.798224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.798857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:44.800293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:44.800745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:44.801157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.018485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:51:45.043288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.043963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.051008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.051553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.052049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.052758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.053492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.053976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.109413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.116801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.117339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.117709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.120901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:45.261905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.271733 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0dcc990c-18c3-4491-b47e-87ce9eb0e017 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1478 microversion: 2.1 time: 0.232933 Aug 27 20:51:45.272554 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 390/842] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1478 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:45.277373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.278216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.285155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.285916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.286656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.287610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.288333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.288764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.299057 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0c12cb41-b291-46ad-b97d-01d15df00172 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-98q7nt8j" status: 200 len: 2929 microversion: 2.1 time: 0.519072 Aug 27 20:51:45.311918 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 453/843] 10.222.0.40 () {58 vars in 1197 bytes} [Sat Aug 27 20:51:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-98q7nt8j => generated 2929 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:45.321514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.348560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.server_groups [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Querying cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) for 2 instances {{(pid=140434) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 20:51:45.349284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.349764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.350194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.381780 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd502a5b-2ad2-4f01-a9d6-9e6b18133521 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/5489734b-bf2f-416d-a80f-470b2157d6b0" status: 200 len: 265 microversion: 2.1 time: 0.064014 Aug 27 20:51:45.382373 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 454/844] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/os-server-groups/5489734b-bf2f-416d-a80f-470b2157d6b0 => generated 265 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:51:45.388103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.388103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.393597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.394081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.394536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.395209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.395668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.396080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.474937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.496515 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63126a2e-b33c-4a0f-ba20-8c71f37e2657 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.222497 Aug 27 20:51:45.510794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 391/845] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:45.510794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.510794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.522721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.523677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.524165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.524935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.525391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.526012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.567140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.575760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a4f4d8a-a7a5-4493-9fe3-14e661f52af8 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1386 microversion: 2.1 time: 0.192354 Aug 27 20:51:45.576377 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 455/846] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:45.581069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.581687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.587650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.588143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.588582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.589285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.589736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.590516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.727869 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f18937f3-4a9c-4fff-800f-5d253f3e6c09 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1619 microversion: 2.1 time: 0.228030 Aug 27 20:51:45.728692 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 392/847] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1619 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:45.750988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.751806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.761256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.762047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.767613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.768402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.768908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.769348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.845109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.859325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.864483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.865939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49bdf9a3-e176-4708-a1d7-9b0f5a227fa6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.288667 Aug 27 20:51:45.868250 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 456/848] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:45.888896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.889378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:45.889994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:45.896396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.896853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.897288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:45.897988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:45.898464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:45.898643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.900421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:45.906068 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e945c851-e0b5-4486-9522-bfab28f9db8a tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1443 microversion: 2.75 time: 0.172266 Aug 27 20:51:45.906975 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 393/849] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:45.907998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.075989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bfbfc13c-d27a-488c-818c-7cc49ac78ae5 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 200 len: 1619 microversion: 2.1 time: 0.189856 Aug 27 20:51:46.076953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 457/850] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:45 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 1619 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:46.104952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: .version_select at 0x7ff84f3a0f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-689219051", "policies": ["anti-affinity"]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:46.129568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.134108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.191964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.196230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.208632 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc036792-5f73-4b0f-9e58-1cecfbc6d098 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.107855 Aug 27 20:51:46.210143 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 394/851] 10.222.0.40 () {60 vars in 1174 bytes} [Sat Aug 27 20:51:46 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:46.295459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:46.296321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:46.313974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.317344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.318030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.318937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.319598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.320179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.338834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2080016520", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "737f21a1-042b-441a-bef2-cd6e92955251"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:46.400868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:46.562082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:46.570844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-927e18ba-bb41-42bc-9dba-68f954a8892b tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1463 microversion: 2.1 time: 0.279206 Aug 27 20:51:46.571612 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 458/852] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:46 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1463 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:46.576710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:46.577349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:46.584787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.585596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.586188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.587055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.587698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.588274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.723717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:46.724624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:46.725208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:46.725754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:46.726267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:46.741528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.742228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.742727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.743571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.744269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.744977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.764376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.771961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.775049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:46.775488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:46.783736 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d552e27a-1600-4d2c-b8d9-1d1c0828c2e0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1502 microversion: 2.1 time: 0.210524 Aug 27 20:51:46.788743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 2 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:46.791559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:46.798137 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 459/853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:46 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:46.803316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:46.803956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:46.810780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.811605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.812066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.812755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:46.813199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:46.813619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:46.849927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.857811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.894175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.898140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.911969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=5b31b082-a78d-469f-a66f-1c9bbe90eb3f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:46.971424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:46.975678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:46.977589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:46.988456 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a13aecbc-6abc-4a6c-9fe1-46aaf6d9db2a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1584 microversion: 2.1 time: 0.188732 Aug 27 20:51:47.002000 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 460/854] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:46 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1584 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:47.002000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:47.002000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.002000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.002703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.003185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.004145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.004745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.005213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.021782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:47.025618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:47.060602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb3dd85a-0e9e-4026-a8aa-a6682f31b54c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.727481 Aug 27 20:51:47.064572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 395/855] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 20:51:47.069737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.070524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.076794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.077281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.077714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.078438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.078846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.079268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.089046 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f660f320-4be7-4595-a8ca-a47cfdde5561 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 0 microversion: 2.1 time: 0.098576 Aug 27 20:51:47.093145 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 461/856] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:51:46 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:47.095056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.096165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.103512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.104015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.104490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.105202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.105662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.106121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.182775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.194251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.195768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.198876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=93,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:47.202005 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-40f98483-3b07-4909-a068-dcd9aecb5f85 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1443 microversion: 2.75 time: 0.110811 Aug 27 20:51:47.202579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 462/857] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:47.258577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.269096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.271323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.272966 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1edd04b-266b-413d-afea-5dca080417a4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.207119 Aug 27 20:51:47.275827 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 396/858] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:47.281426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.282260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.296037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.297911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.299620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.300803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.301392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.301854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.364575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1657777440", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:47.397513 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-245e2ddb-e31f-48bc-a742-30aefa1e3e44 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121668 Aug 27 20:51:47.398852 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 397/859] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:47.407860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.415317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.416263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Searching by: {'deleted': False, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:51:47.436043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.436543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.436986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.440368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.440887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.441780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.460012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:47.491965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:51:47.498382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:47.528194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd34cab7-2dc0-4836-94cc-aa4019f66bb5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.128352 Aug 27 20:51:47.529162 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 398/860] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers => generated 1663 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:47.541257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.542277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.550890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.551415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.551872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.553273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.553865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.554292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.592399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.592888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.593330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.593920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lazy-loading 'fault' on Instance uuid ef14e11f-a30d-4cc5-96a3-98cd978d619a {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:47.766316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:47.767814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:47.768314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:47.768734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:47.769148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:47.784157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.785036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.785672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.786638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.796475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.799359 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc42ad1f-b096-4acd-86ce-c35039adef2e tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1597 microversion: 2.1 time: 0.262631 Aug 27 20:51:47.800476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.805105 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 399/861] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1597 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:47.810740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4237d4ea-6ab5-4aac-898e-c70435ab566d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.811370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4237d4ea-6ab5-4aac-898e-c70435ab566d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.837966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:47.842988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:47.859152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:47.880295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:47.891520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4237d4ea-6ab5-4aac-898e-c70435ab566d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:47.900682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4237d4ea-6ab5-4aac-898e-c70435ab566d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1219 microversion: 2.1 time: 0.094168 Aug 27 20:51:47.902350 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 400/862] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:47.908423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:47.909396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:47.916898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.917717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.918409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.919443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:47.920117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:47.920771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:47.997781 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bea3655a-925c-47d4-a5d0-8e18f680ad91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793960 Aug 27 20:51:48.002683 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 463/863] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:51:48.012664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:48.015193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.030705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.031568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.036012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.037240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.038025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.038784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.259997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.263738 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d68f1734-1688-4d7d-b238-d4eb2d1d806b tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action" status: 202 len: 0 microversion: 2.1 time: 0.259204 Aug 27 20:51:48.270136 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 464/864] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:51:48 2022] POST /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:51:48.271265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79722199-adf8-4f5b-aff9-bea7559e8694 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1492 microversion: 2.1 time: 0.367653 Aug 27 20:51:48.272017 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 401/865] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:47 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1492 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:48.277899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.278904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.286901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.287770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.288474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.289976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.290729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.291457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.296871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a3e1ae0-ed15-4d79-8e3b-e3cf7f73808e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.304322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a3e1ae0-ed15-4d79-8e3b-e3cf7f73808e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.404830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.406246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.407694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.410113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lazy-loading 'fault' on Instance uuid 8f716859-b3bd-4496-afa6-fad0dbe406a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:48.530107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a3e1ae0-ed15-4d79-8e3b-e3cf7f73808e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.544243 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a3e1ae0-ed15-4d79-8e3b-e3cf7f73808e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1213 microversion: 2.1 time: 0.267893 Aug 27 20:51:48.559416 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 465/866] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:48.574471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.577412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.579284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.597980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.602542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.603213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.603548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.605000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.605198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7f4bb27e9d7415eab81877c4c3748a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8f13c7b0c04f2d8edc472d032d5973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.608012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.608747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.615316 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d35e615b-36af-4ce0-ae23-c927ae25659e tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 200 len: 1448 microversion: 2.75 time: 0.341907 Aug 27 20:51:48.635898 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 402/867] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 1448 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:48.642393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e830c66d-205a-485c-8acc-6bffa376ba77 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '.version_select at 0x7ff84f3505e0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.646181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e830c66d-205a-485c-8acc-6bffa376ba77 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.646639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e830c66d-205a-485c-8acc-6bffa376ba77 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.647088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e830c66d-205a-485c-8acc-6bffa376ba77 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.656619 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e830c66d-205a-485c-8acc-6bffa376ba77 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.019364 Aug 27 20:51:48.671642 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 403/868] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:48.685793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.687029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.707022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.707914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.708598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.709503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.710147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.711421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.862193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06486092-26ea-40f8-85f8-210a695bd977 tempest-ServersAdminTestJSON-2115018767 tempest-ServersAdminTestJSON-2115018767-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1614 microversion: 2.1 time: 0.311771 Aug 27 20:51:48.862584 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 466/869] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1614 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:48.868115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:48.868718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:48.885065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.886519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.887190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.888923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:48.890579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:48.891077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:48.959184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.973733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.977260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:48.979247 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-71f0cdda-a764-4a41-8e97-e2cf02a01a92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.306494 Aug 27 20:51:48.992220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 404/870] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:49.001580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:49.002593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:49.020321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.022366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.024322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.027463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.028007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.028553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.075056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4064599-c384-41f4-86ce-d60e790e1672 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1643 microversion: 2.1 time: 0.211651 Aug 27 20:51:49.075678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 467/871] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:48 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1643 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:49.087799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:51:49.096130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:49.096130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:49.108023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.111514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.113386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.116513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.118931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.119612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.270140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:49.287280 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eae0ae35-9b69-475e-be7a-0456528ff4e3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1271 microversion: 2.1 time: 0.209928 Aug 27 20:51:49.291508 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 468/872] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:49 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:49.329618 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3f81c65-0be3-4984-a34a-7764e1ab0d90 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 204 len: 0 microversion: 2.1 time: 0.334875 Aug 27 20:51:49.330873 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 405/873] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:48 2022] DELETE /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:49.341473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:49.343087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:49.352636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.353555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.354256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.355450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.357243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.357866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.383660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:49.420303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-609109620", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "9b46b331-7562-41ca-bc02-1e78612261fd"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:49.506765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] validate_networks() for [('9b46b331-7562-41ca-bc02-1e78612261fd', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:51:49.537465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:49.546461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2ea2f18-4ee5-4a7d-8ce0-182545a5b611 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1470 microversion: 2.1 time: 0.211096 Aug 27 20:51:49.560261 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 469/874] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:49 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:49.560261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:49.560261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:49.565691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.566179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.566611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.567314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.568926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.568926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.788444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:49.804036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a8808ec-080f-4bd4-ae37-0eda80f6f12c tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1584 microversion: 2.1 time: 0.254919 Aug 27 20:51:49.819366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 470/875] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:49 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1584 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:49.819366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02e2a34-e1a3-4782-8faa-0af7c8a57b35", "tag": "4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:49.834928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.835441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.835877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.849880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] Creating event network-changed:4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd for instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 on nch1-master-1 Aug 27 20:51:49.857321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a9120155-8036-47f2-82ef-88f567edbcd7 req-2720156c-d2f6-4d70-b079-75d09e0ef288 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048550 Aug 27 20:51:49.861146 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 471/876] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:49.867089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:49.868551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:49.876310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.877447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.877896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:49.879902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:49.880380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:49.880812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.005325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.013623 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64d866a5-26d6-4bbd-bb3d-17b5cc0e11a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1265 microversion: 2.1 time: 0.150642 Aug 27 20:51:50.016675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 472/877] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:49 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:50.021726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:50.022353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] [instance: 8f716859-b3bd-4496-afa6-fad0dbe406a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:50.037741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.038250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.045741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.047083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.047615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.049611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.078473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] HTTP exception thrown: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Request method failure captured: Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 HTTP/1.1 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOEv5aSgtYc7mDlXvDpdCLgFsKqgBx6mUh4fL-j2xGQDb6hrPppmvJNNiOS5ieoW0mvGjDOPuFT0N_7eyngPfc1kZlJRYYK3nEXNzNLKdwDf-_lK5mfcmqINRfyYv6bM1NwiqVyNKDISt0Fj0Sy5o3hpQvL1Imtr5RpJEJ4JbFV028 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9b8f13c7b0c04f2d8edc472d032d5973 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersAdmin275Test-1622117541 Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:51:50.080567 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b8f13c7b0c04f2d8edc472d032d5973"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9b8f13c7b0c04f2d8edc472d032d5973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9b8f13c7b0c04f2d8edc472d032d5973", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9b8f13c7b0c04f2d8edc472d032d5973"}]}] Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersAdmin275Test-1622117541 Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9b8f13c7b0c04f2d8edc472d032d5973 Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersAdmin275Test-1622117541 Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersAdmin275Test-1622117541-project Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d7f4bb27e9d7415eab81877c4c3748a1 Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersAdmin275Test-1622117541-project Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. Aug 27 20:51:50.081986 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '8f716859-b3bd-4496-afa6-fad0dbe406a6'} Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:50.082779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. Aug 27 20:51:50.084558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:50.086395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] Returning 404 to user: Instance 8f716859-b3bd-4496-afa6-fad0dbe406a6 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:50.086395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a0b2209-f011-43ff-b826-c348017882d5 tempest-ServersAdmin275Test-1622117541 tempest-ServersAdmin275Test-1622117541-project] 10.222.0.40 "GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6" status: 404 len: 111 microversion: 2.75 time: 0.064119 Aug 27 20:51:50.086395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 473/878] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:50 2022] GET /compute/v2.1/servers/8f716859-b3bd-4496-afa6-fad0dbe406a6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:51:50.109748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:50.110396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:50.128251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.128764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.129218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.137002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.137759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.138229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.194127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:51:50.195167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:51:50.195834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:51:50.196400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:51:50.197182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:51:50.211833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.213285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.213917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.215705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.216253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.216691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.244913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:51:50.251207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for user 43dd6f015403486491e8140062f43bee and project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:51:50.257194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:50.286237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:51:50.289785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:51:50.352718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27855f35-b546-472c-88f6-2543889794f3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944274 Aug 27 20:51:50.354841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 406/879] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 20:51:50.369066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:50.376992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:50.386552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.387375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.388088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.388947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.389341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.389771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.541871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.553620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.563024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.564684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8deb15c-d4e4-429d-aee5-bb7908a5b14e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1271 microversion: 2.1 time: 0.201751 Aug 27 20:51:50.564849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.566169 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-256b8b50-f6ed-426b-ad5e-f2e83f313e9a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.482697 Aug 27 20:51:50.566731 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 474/880] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:50 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:50.571432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbf008fa-91ec-4136-a437-175fd6b4ba9d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:50.572041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbf008fa-91ec-4136-a437-175fd6b4ba9d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:50.582065 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 407/881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:50 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:50.608145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:50.608924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:50.632816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.638481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.639867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.640659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.641337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.641912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.737492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fbf008fa-91ec-4136-a437-175fd6b4ba9d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:50.777605 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbf008fa-91ec-4136-a437-175fd6b4ba9d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1210 microversion: 2.1 time: 0.209592 Aug 27 20:51:50.778230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 475/882] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:50 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1210 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:50.784841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "name": "network-vif-plugged", "status": "completed", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:50.814262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:50.826885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:50.827875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:50.863536 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] Creating event network-vif-plugged:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch1-master-1 Aug 27 20:51:50.869557 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-dffe1f88-eb14-4d22-aacd-6a501f72d46f req-ae2c47ee-86a4-4f09-a143-eb7797a724dd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089545 Aug 27 20:51:50.881026 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 476/883] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:50.991680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.014494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ae3055f-5db8-412c-b097-517575b9dd8f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1470 microversion: 2.1 time: 0.427147 Aug 27 20:51:51.015260 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 408/884] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:50 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:51.047516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:51.050304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:51.070858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.071411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.071877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.072609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.077591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.078282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.204694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.216266 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75763d74-1627-486b-9d5a-3abdc675ecbd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1283 microversion: 2.1 time: 0.182313 Aug 27 20:51:51.218077 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 477/885] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:51 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:51.608697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:51.609277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:51.613516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:51.614157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:51.625459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.632490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.632986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.633423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.634130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.634581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.634998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.636646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.637107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.637848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.638307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.638733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.789820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.801047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25394110-54d9-4633-a7b5-223620817002 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1271 microversion: 2.1 time: 0.197622 Aug 27 20:51:51.801897 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 409/886] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:51 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:51.820053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:51.820704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:51.826923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.827471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.827917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.828631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:51.829092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:51.830686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:51.885915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.904031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.907233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:51.911769 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-99031cb0-4d84-41df-99f4-d1a1cba639f5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.304302 Aug 27 20:51:51.915325 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 478/887] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:51 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:51.987729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:52.002109 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7131b26e-5024-4099-8b11-49afbfa1e428 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1262 microversion: 2.1 time: 0.198977 Aug 27 20:51:52.004556 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 410/888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:51 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1262 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:52.039251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:52.039904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:52.050760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.052989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.053451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.054977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.055509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.055949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.239799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:52.241340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:52.248331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.248823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.249442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.250148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.250603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.251297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.269581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:52.281599 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19c72a80-b850-4a75-8e84-6a3fe5bfd52e tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1470 microversion: 2.1 time: 0.248091 Aug 27 20:51:52.282552 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 479/889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:52 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1470 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:52.355858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:52.365706 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d71435dd-8f44-4951-8058-179021151b07 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1271 microversion: 2.1 time: 0.131230 Aug 27 20:51:52.366600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 411/890] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:52 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:52.822522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:52.823111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:52.830609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.831116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.831591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.832339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.832801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.833227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.942843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:52.943481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:52.952574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.953396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.954062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:52.955312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:52.956190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:52.956817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.134284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.147648 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c97a83f6-e82b-48e9-86d2-32bf06e93f2d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1277 microversion: 2.1 time: 0.328905 Aug 27 20:51:53.148911 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 480/891] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:52 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:53.158126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:53.159124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:53.170091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.170987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.171621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.172474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.173795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.174433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.386742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.396232 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-993ce788-f66e-4fe7-bdcf-52da29a63538 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1262 microversion: 2.1 time: 0.245730 Aug 27 20:51:53.396834 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 481/892] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:53 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1262 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:53.418012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:53.418924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:53.431388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.433657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.435779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.438362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.446157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.446958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.447487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.448219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.449536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.452343 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-13aee270-0f2a-4799-aab1-0194a48ef838 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1408 microversion: 2.25 time: 0.515975 Aug 27 20:51:53.457963 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 412/893] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:52 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1408 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:51:53.476288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:53.477274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:53.487103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.488000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.492090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.493172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.493920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.494673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.592584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.605026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b68fd6c-db51-4e5a-a59a-3a42757539a5 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1428 microversion: 2.1 time: 0.207128 Aug 27 20:51:53.605788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 482/894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:53 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1428 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:53.644389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:53.653176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae9492f1-91af-4661-83a2-aa988dd41c68 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1271 microversion: 2.1 time: 0.193421 Aug 27 20:51:53.665631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 413/895] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:53 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:53.725854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f791e927-8e41-4728-89d3-3c267b9742bf", "name": "network-vif-deleted", "tag": "137ce93d-2cf3-4c18-9644-36698cbeb55d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:53.751122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:53.751635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:53.752082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:53.775748 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] Creating event network-vif-deleted:137ce93d-2cf3-4c18-9644-36698cbeb55d for instance f791e927-8e41-4728-89d3-3c267b9742bf on nch2-master-1 Aug 27 20:51:53.781391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3a64903d-6b92-4b84-afef-375ee7915660 req-a97fed5b-3125-4f16-a58e-679aeaf83d5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059413 Aug 27 20:51:53.782321 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 483/896] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:54.170759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.171584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.178812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.179632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.180247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.181428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.182174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.183075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.287550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.302884 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d17098f-a6eb-422e-ae7e-ebfec0da3d56 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1277 microversion: 2.1 time: 0.136281 Aug 27 20:51:54.304551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 414/897] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:54.419086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.419831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.428838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.429687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.430762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.431914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.432881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.433489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.486801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.487792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.496982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.497836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.498916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.500541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.501833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.502767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.509261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:54.510347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.520353 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa6948c7-5dfc-4a93-b120-fd47705933c3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1268 microversion: 2.1 time: 0.106570 Aug 27 20:51:54.521504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 484/898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1268 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:54.631496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.632374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.642138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.643745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.644370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.645677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.646295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.646890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.685956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.694780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.696266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.697491 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fb27181d-de4f-4271-999c-59984a5f24a5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1605 microversion: 2.25 time: 0.216901 Aug 27 20:51:54.700816 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 415/899] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:51:54.707472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.708167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.708758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.709349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lazy-loading 'fault' on Instance uuid f791e927-8e41-4728-89d3-3c267b9742bf {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:51:54.711834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.712826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.722447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.723799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.724460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.725333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.725946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.726447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.764657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.773418 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-edbe94d0-e11a-4c77-83ab-c09474b4d696 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 200 len: 1304 microversion: 2.1 time: 0.147951 Aug 27 20:51:54.774208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 485/900] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:54.779609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:54.780293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:54.786809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.787597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.788217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.789155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:54.789788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:54.790390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:54.852288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:54.868293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8babcef4-f4bc-49a0-9e9e-27e6a789b3a5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1271 microversion: 2.1 time: 0.165234 Aug 27 20:51:54.883499 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 416/901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:54.941053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b2e5f66a-2b3b-4e70-b340-f9d2d9d8beb5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.165417 Aug 27 20:51:54.942045 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 486/902] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 20:51:54 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:51:55.326325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.327766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:55.343939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.345637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.346482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.347435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.348534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.350551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.544018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.545058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:55.556897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.557395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.557827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.559600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.560242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.561148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.683074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:55.696240 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a47b1ab9-685a-489a-ade7-d0e609b6bf30 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1268 microversion: 2.1 time: 0.156924 Aug 27 20:51:55.697205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 487/903] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:55 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:55.718181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:55.727934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9f58cb8-eaad-48a1-ae04-2c11db56d824 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.406424 Aug 27 20:51:55.740109 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 417/904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:55 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:55.796974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.797717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: f791e927-8e41-4728-89d3-3c267b9742bf] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:55.807826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.808622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.809079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.810234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.811226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.813070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.834517 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] HTTP exception thrown: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Request method failure captured: Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf HTTP/1.1 Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNcYlZQzBnRztBxW0JjGsrjyc6VMJlEkUSNrKtKJLdz-Yj67Vsty9KBxtu9-QX96aBUYpVtCjZRaped-mbH3_ThD4AHoB0OC1WUDXvVQcL5yR2sz0xO1eF4PjrxEBahlY17S8WP8fVYhzE-PPmr7P19VUW60seshnAvDQgzuNkF2AQ Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:51:55.837080 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51f5f4f721bb419693f552f7aba3effd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}] Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7a345ebf9ea846089ee8e5d8eac1b47d Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. Aug 27 20:51:55.838604 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f791e927-8e41-4728-89d3-3c267b9742bf'} Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:55.839425 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. Aug 27 20:51:55.840880 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:51:55.842194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Returning 404 to user: Instance f791e927-8e41-4728-89d3-3c267b9742bf could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:55.842194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2690b106-f461-4a6d-94f4-d714591fc4fd tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf" status: 404 len: 111 microversion: 2.1 time: 0.049792 Aug 27 20:51:55.842194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 418/905] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:55 2022] GET /compute/v2.1/servers/f791e927-8e41-4728-89d3-3c267b9742bf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:51:55.850917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.853346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:55.864669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.865174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.865723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.866828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.868534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.869969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.882177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.888958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.889947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.890884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.891954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.892602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.893284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.911045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:51:55.944646 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af1c0bbd-4df6-4dff-ab7b-f4dfb605d1b5 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.226728 Aug 27 20:51:55.945579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 488/906] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:51:55 2022] GET /compute/v2.1/os-services => generated 947 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:55.953082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:55.954240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:55.965507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.966229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.966837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:55.967795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:55.968907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:55.969491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.053477 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be97fdb6-63ca-469d-bafb-66becf45c995 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 204 len: 0 microversion: 2.1 time: 0.205511 Aug 27 20:51:56.054474 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 419/907] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:51:55 2022] DELETE /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:51:56.060057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.066294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.066788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.067240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.068011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.069111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.069554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.118076 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36be3ee3-cfdd-4843-b114-4ed26a759999 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.062201 Aug 27 20:51:56.124055 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 420/908] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:56.124055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.124337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:56.134986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.135770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.136222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.136945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.137407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.137979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.323843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:56.345014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac3a6e0c-d81f-46dc-a45b-c1ee36fbac21 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.396689 Aug 27 20:51:56.347879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 489/909] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:55 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:56.364152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.378555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.379051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.379697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.380974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.381496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.381918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.418948 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84c2c61b-af7a-4a86-bcb7-c4882a4a984e tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.069692 Aug 27 20:51:56.419620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 490/910] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:56.433888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.438582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.439518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.440333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.441491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.442168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.442955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.443885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:56.456622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1af18f09-9fd5-4ae3-bf8d-4ad2c4c7ced2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1468 microversion: 2.1 time: 0.336472 Aug 27 20:51:56.457903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:56.461474 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 421/911] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1468 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:56.482555 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49463520-d076-4e27-8047-ef41c3181b67 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.054235 Aug 27 20:51:56.483612 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 491/912] 10.222.0.40 () {58 vars in 1196 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:51:56.497532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.502434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.502963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.503442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.504464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.505128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.506300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.540261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b412f1e-6eb3-4601-b52c-900737a15f8a tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.047749 Aug 27 20:51:56.548879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 422/913] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:56.555384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.560119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.560694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.562593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.564449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.566594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.567152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.618734 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6cd0526e-b9a8-4df0-b08d-fb983ed811f3 tempest-ServicesAdminNegativeTestJSON-2058075093 tempest-ServicesAdminNegativeTestJSON-2058075093-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.068863 Aug 27 20:51:56.619710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 492/914] 10.222.0.40 () {58 vars in 1198 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:51:56.633655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:56.644609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.645311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.645812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.660077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] Creating event network-changed:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch1-master-1 Aug 27 20:51:56.666242 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f015a950-7181-4794-966d-778e245a34e0 req-e17647cd-4814-44c6-82d4-0eea757ff783 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038337 Aug 27 20:51:56.666795 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 423/915] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:51:56.720142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.721302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:56.729630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.730179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.730674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.731485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.732128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.732864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.784530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4954e5f2-080a-450c-b6de-615cf6ef4549 tempest-ServicesAdminNegativeTestJSON-2046469611 tempest-ServicesAdminNegativeTestJSON-2046469611-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.790534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4954e5f2-080a-450c-b6de-615cf6ef4549 tempest-ServicesAdminNegativeTestJSON-2046469611 tempest-ServicesAdminNegativeTestJSON-2046469611-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e91c465352904e23b87bd72dfa6186b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03dc331359f40e39658bd9315aa9e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4954e5f2-080a-450c-b6de-615cf6ef4549 tempest-ServicesAdminNegativeTestJSON-2046469611 tempest-ServicesAdminNegativeTestJSON-2046469611-project] Request method failure captured: Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoPqfrT9VTwOk5uZ2VBOoHrZa4WsObfkU4Yl3Z6ewgYH_IupwIwiFCWGWvPVZcNPmTbNzRUEIqkDruuyCkorfpTYrLiyP_W4C1XD7GWdSya0yKfiMtYe3oMbtlZREgWoJmIey6TbEA06FWzFItm9gztYq16n5-T0F18HWJ37UuI5wqo Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f03dc331359f40e39658bd9315aa9e7f Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2046469611 Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:51:56.793620 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f03dc331359f40e39658bd9315aa9e7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f03dc331359f40e39658bd9315aa9e7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f03dc331359f40e39658bd9315aa9e7f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f03dc331359f40e39658bd9315aa9e7f"}]}] Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2046469611 Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f03dc331359f40e39658bd9315aa9e7f Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2046469611 Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServicesAdminNegativeTestJSON-2046469611-project Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: e91c465352904e23b87bd72dfa6186b2 Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2046469611-project Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:51:56.795049 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:51:56.795863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 20:51:56.797020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:51:56.800856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4954e5f2-080a-450c-b6de-615cf6ef4549 tempest-ServicesAdminNegativeTestJSON-2046469611 tempest-ServicesAdminNegativeTestJSON-2046469611-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:51:56.801846 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4954e5f2-080a-450c-b6de-615cf6ef4549 tempest-ServicesAdminNegativeTestJSON-2046469611 tempest-ServicesAdminNegativeTestJSON-2046469611-project] 10.222.0.40 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.168499 Aug 27 20:51:56.807753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 493/916] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:51:56.814721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:56.815804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:56.825391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.826662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.828368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.829561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:56.831661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:56.832428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:56.994216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:57.011874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e30d1495-4d1e-4dab-960a-883458f6b0fa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.297043 Aug 27 20:51:57.013645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 424/917] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:57.022679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b31b082-a78d-469f-a66f-1c9bbe90eb3f", "tag": "56d396e9-4d65-4d5e-a190-b5f8729970d5"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:57.037734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:57.039744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:57.040356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:57.058334 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] Creating event network-changed:56d396e9-4d65-4d5e-a190-b5f8729970d5 for instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f on nch1-master-1 Aug 27 20:51:57.066527 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e238a7ed-f14c-44d3-a9bb-7a55434314df req-b36a146a-a17a-4642-96c2-5d71456b2ab0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050663 Aug 27 20:51:57.068651 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 425/918] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:57.082899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:57.100773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3afbc32-d030-4281-8ce4-39d3b6fd0f01 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.290965 Aug 27 20:51:57.101566 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 494/919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:56 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:57.368334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:57.369049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:57.376083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:57.376644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:57.377076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:57.378192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:57.379403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:57.380016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:57.482694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:57.483387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:57.496322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:57.497363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:57.498039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:57.498767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:57.499241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:57.499687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:57.556722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:57.566766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fc15b28-248d-49ba-921c-d6247e8e31fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.203366 Aug 27 20:51:57.567965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 426/920] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:57 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:57.705527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:57.713914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-87fdfa6f-b564-481a-b67f-b450bd75ecc2 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1468 microversion: 2.1 time: 0.235379 Aug 27 20:51:57.715493 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 495/921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:57 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:58.034968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:58.035627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:58.041954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.042699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.043778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.044707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.045572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.046232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.124524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:58.125993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:58.136002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.136503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.137164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.140705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.141228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.141678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.505920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:58.516057 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d863144-1cc6-4a64-a61d-20e6c008c10f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.485589 Aug 27 20:51:58.529134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 427/922] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:58 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:58.530962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:58.541388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-291caadd-7b3d-4f92-8479-4e05ccbd9abd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.421084 Aug 27 20:51:58.542361 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 496/923] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:58 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:51:58.592399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:58.593241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:58.604984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.605499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.606598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.612861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.612861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.612861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.737275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:58.737907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:58.747284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.748090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.749835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.754471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:58.755197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:58.757317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:58.819798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:51:59.179652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:59.190390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8d0d336f-5285-406d-8461-7eb29c9bb27a tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1426 microversion: 2.1 time: 0.455963 Aug 27 20:51:59.205809 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 497/924] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:58 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1426 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:59.209381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d005c5-6ff4-4aa3-a2e8-40489377f369", "tag": "3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:59.213829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:59.228359 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9eb05d3a-ec93-4495-a9eb-280714f8813a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.640115 Aug 27 20:51:59.229275 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 428/925] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:58 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:59.235507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.236334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.237056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.246512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272b2dad-d15e-4482-a9aa-23ee074f95b6", "name": "network-vif-deleted", "tag": "76a3278b-aa64-4f20-a838-ccc4fd0437e4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:51:59.258593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.259452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.260058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.272362 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] Creating event network-changed:3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59 for instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 on nch2-master-1 Aug 27 20:51:59.274240 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] Creating event network-vif-deleted:76a3278b-aa64-4f20-a838-ccc4fd0437e4 for instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 on nch1-master-1 Aug 27 20:51:59.277945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-26f215f4-ece4-45a6-b0d2-2ed8b4c5a951 req-c7c2ab80-0dcd-4c7d-8252-675a8ab75321 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085220 Aug 27 20:51:59.279245 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 498/926] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:59.284344 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2e5ac5cd-9844-4629-bc89-cafa452b22d3 req-4f0a85ca-1538-4c8e-b816-e011a0516798 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053328 Aug 27 20:51:59.287753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 429/927] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:51:59.541435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:59.542329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:59.551002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.551808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.552248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.553103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.553964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.554697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.566896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:51:59.568056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:51:59.575614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.576252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.576843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.578589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:51:59.579434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:51:59.580469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:51:59.783834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:59.790734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:51:59.797314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f47d472b-8b27-4f9b-9075-ac88ad758466 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.260673 Aug 27 20:51:59.797901 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 499/928] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:59 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:51:59.800900 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4d8782e-18f4-4877-857a-b98e3282ee10 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.241018 Aug 27 20:51:59.801667 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 430/929] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:51:59 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:00.220407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:00.221165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:00.228606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.229431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.230106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.231053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.231751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.232388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.250213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:00.251231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:00.264687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.265290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.265799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.266589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.267219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.267744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.292198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.293084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.293759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.294546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lazy-loading 'fault' on Instance uuid 272b2dad-d15e-4482-a9aa-23ee074f95b6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:52:00.341272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=50 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:00.382558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:00.392911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f6dc165-bcb8-4006-84e3-c75c2e743d4f tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 200 len: 1303 microversion: 2.1 time: 0.179013 Aug 27 20:52:00.407133 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 500/930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:00 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:00.532645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:00.541541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be619a10-e734-46aa-803b-7118a44485c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.295504 Aug 27 20:52:00.542907 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 431/931] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:00 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:00.819856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:00.820501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:00.822324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:00.822936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:00.823322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:00.832111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.832888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.833002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.833095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.833467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.833639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.834177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.834312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:00.834646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.835045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:00.835438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:00.836792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.064675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:01.067448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:01.073974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6f162e68-c384-45d2-b727-e29b84db0fff tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.259826 Aug 27 20:52:01.075214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 501/932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:00 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:01.075480 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a2b95c2-93bd-4278-a69a-bc87ab60b2b4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.257340 Aug 27 20:52:01.076304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 432/933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:00 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:01.315981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}, {"name": "network-changed", "server_uuid": "9213b4f8-a682-44bb-8771-1ae451404522", "tag": "4b85e86e-e432-48b9-9f1d-674b5f3deddb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:01.328307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.329390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.330146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.346867 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Creating event network-changed:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch1-master-1 Aug 27 20:52:01.358783 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] Creating event network-changed:4b85e86e-e432-48b9-9f1d-674b5f3deddb for instance 9213b4f8-a682-44bb-8771-1ae451404522 on nch1-master-1 Aug 27 20:52:01.369118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1187f09c-b335-44c0-9769-28dae50ccec0 req-7e968106-1f5d-41d4-99b2-d86932ce7e4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057029 Aug 27 20:52:01.369758 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 502/934] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:01.414250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:01.414860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: 272b2dad-d15e-4482-a9aa-23ee074f95b6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:01.420964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.421455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.421931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.422660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.423863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.424331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.439649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] HTTP exception thrown: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Request method failure captured: Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 HTTP/1.1 Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNcYlZQzBnRztBxW0JjGsrjyc6VMJlEkUSNrKtKJLdz-Yj67Vsty9KBxtu9-QX96aBUYpVtCjZRaped-mbH3_ThD4AHoB0OC1WUDXvVQcL5yR2sz0xO1eF4PjrxEBahlY17S8WP8fVYhzE-PPmr7P19VUW60seshnAvDQgzuNkF2AQ Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:01.441332 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51f5f4f721bb419693f552f7aba3effd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}] Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7a345ebf9ea846089ee8e5d8eac1b47d Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. Aug 27 20:52:01.442881 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '272b2dad-d15e-4482-a9aa-23ee074f95b6'} Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:01.446789 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. Aug 27 20:52:01.448008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:01.449078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Returning 404 to user: Instance 272b2dad-d15e-4482-a9aa-23ee074f95b6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:01.449078 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f29da8d8-81a0-4870-b4e7-a947914cd523 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6" status: 404 len: 111 microversion: 2.1 time: 0.032506 Aug 27 20:52:01.449078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 433/935] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:01 2022] GET /compute/v2.1/servers/272b2dad-d15e-4482-a9aa-23ee074f95b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:52:01.455980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:01.456766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:01.463875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.464395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.464929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.466073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.466561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.466997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.506282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:52:01.562879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:01.563498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:01.570710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.572306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.573404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.574402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.575227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.576100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.617964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3815b36c-7529-4e33-90d4-c6aca21558d8 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 204 len: 0 microversion: 2.1 time: 0.166423 Aug 27 20:52:01.618579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 503/936] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:52:01 2022] DELETE /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:52:01.627950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:01.628754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:01.635174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.635723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.636170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.636910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:01.637512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:01.637934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:01.881615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:01.883991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:01.890659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3eafcc6-c46d-42ed-9db8-44cd091a46da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.332098 Aug 27 20:52:01.891279 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 434/937] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:01 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:01.917141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:01.926789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6aaa1ee1-5461-48f6-9865-43c24b0cc5a6 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1469 microversion: 2.1 time: 0.303638 Aug 27 20:52:01.927637 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 504/938] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:01 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:02.102939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:02.103576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:02.109579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:02.110242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:02.122309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.122785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.123239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:02.123964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.124412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.124825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:02.130715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.131496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.132109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:02.132836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.133299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.133718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:02.512571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:02.522348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:02.523078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4adb64c4-c387-4560-8423-c44aadffedcf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.427299 Aug 27 20:52:02.533784 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4586e074-d867-48a0-b2c3-4609ef8a7173 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.435676 Aug 27 20:52:02.538728 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 505/939] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:02 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:02.542976 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 435/940] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:02 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:02.912184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:02.912818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:02.927188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.928345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.928998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:02.929899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:02.930826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d005c5-6ff4-4aa3-a2e8-40489377f369", "name": "network-vif-plugged", "status": "completed", "tag": "3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:02.936071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:02.936734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.004040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.004550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.005178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.026602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] Creating event network-vif-plugged:3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59 for instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 on nch2-master-1 Aug 27 20:52:03.036170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6e6cfea3-a217-4b95-bbd8-b9813501d254 req-6698d9d1-0e1b-4ca3-830c-2846e2082411 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111845 Aug 27 20:52:03.038880 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 436/941] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:03.047656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:03.049520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:03.057972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.059531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.060058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.060863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.061405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.061914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.345063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:03.354501 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d532ad0-1132-432c-bc35-6a07afe2531f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.446212 Aug 27 20:52:03.355272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 506/942] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:02 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:03.404370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:03.420758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1583947-1d7b-49d8-b0f4-5cb1acb9b1a4 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1469 microversion: 2.1 time: 0.380182 Aug 27 20:52:03.436875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 437/943] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:03 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:03.545456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:03.546081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:03.552586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.554946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.555617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.556509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.556967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.557737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.565256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:03.565888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:03.574518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.575427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.576028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:03.577066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:03.577691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:03.578120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:04.114253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:04.130249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:04.135513 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aeeb3f9c-2214-4bdb-9e0f-aafd33a742fb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.579804 Aug 27 20:52:04.136215 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 438/944] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:03 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:04.149500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65cb1bf6-8917-423c-ad56-57f7aa99d6ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1319 microversion: 2.1 time: 0.607921 Aug 27 20:52:04.153205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 507/945] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:03 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:04.377359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:04.378577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:04.385710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:04.386903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:04.387581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:04.388501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:04.389157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:04.389944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:04.446600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:04.447254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:04.453602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:04.454173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:04.454778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:04.455705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:04.456170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:04.456607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:04.786757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:04.795754 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9dc6174-834a-4543-947f-d9a025a396fa tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.423592 Aug 27 20:52:04.804526 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 439/946] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:04 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:04.810501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:04.829530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69be14d3-9447-42ac-a30f-480da7ba12fa tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1469 microversion: 2.1 time: 0.386336 Aug 27 20:52:04.830890 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 508/947] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:04 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:05.162022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:05.162652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:05.171791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:05.172552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:05.183604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.184135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.186105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.188269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.188836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.189649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.190804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.191858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.191987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.192838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.193453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.194156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.236368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:05.572017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:05.582039 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7a28f2e-f47f-4f72-9d1b-43977f61cd92 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.428270 Aug 27 20:52:05.588189 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 440/948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:05 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:05.609006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef14e11f-a30d-4cc5-96a3-98cd978d619a", "name": "network-vif-deleted", "tag": "e01efec0-3533-47ef-a484-8c1374d6a60f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:05.619750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:05.628445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-489ae04b-9814-4099-9620-aac730c7448b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1469 microversion: 2.1 time: 0.462218 Aug 27 20:52:05.635135 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 509/949] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:05 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:05.645715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.646501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.647097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.659107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:05.660038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:05.669886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.672181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.674478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.675461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.679191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.679875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.680753 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] Creating event network-vif-deleted:e01efec0-3533-47ef-a484-8c1374d6a60f for instance ef14e11f-a30d-4cc5-96a3-98cd978d619a on nch2-master-1 Aug 27 20:52:05.693001 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d011a054-2e26-48d5-8e3f-34a933f5c645 req-35adbf7e-4923-430f-905a-bab490a596da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087782 Aug 27 20:52:05.699386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 441/950] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:05.834527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:05.836840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:05.857166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.861390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.861797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:05.864523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:05.867619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:05.868283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.063734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:06.079910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71f6065f-d17d-4b55-9f38-4a6a2e564c52 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1319 microversion: 2.1 time: 0.424594 Aug 27 20:52:06.084545 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 510/951] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:05 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:06.090607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:06.091247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:06.106240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:06.107085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:06.107578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.108342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:06.108795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:06.109384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.146314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:06.146901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:06.147644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.148143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lazy-loading 'fault' on Instance uuid ef14e11f-a30d-4cc5-96a3-98cd978d619a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:52:06.199567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:06.209288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47355b3c-1d71-451a-ba19-89cbde761e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.384129 Aug 27 20:52:06.223736 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 442/952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:05 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:06.228360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a345ebf9ea846089ee8e5d8eac1b47d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f5f4f721bb419693f552f7aba3effd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:06.237788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6429993-54b4-4090-b37d-406527569345 tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 200 len: 1304 microversion: 2.1 time: 0.152061 Aug 27 20:52:06.238818 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 511/953] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:06 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:06.608693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:06.609312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:06.611775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:06.619559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:06.620054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:06.620846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.621723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:06.622200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:06.622658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:06.848430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:06.857351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-410771ca-ef64-4cc0-8bda-f1f6c5e397cf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.252448 Aug 27 20:52:06.861472 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 443/954] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:06 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:07.089828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:07.101531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.102046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:07.108102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.108780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.109409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.110434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.111086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.111644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.246612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-87ea50f2-d182-4152-86ca-8301ded82c54 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Calling method '.version_select at 0x7ff84f1c90d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.327245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-87ea50f2-d182-4152-86ca-8301ded82c54 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.241421 Aug 27 20:52:07.328075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 512/955] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:52:07 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:07.335225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.335835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:07.338523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:07.345571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.346061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.346780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.347450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.348003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.348453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.353862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afc3121d-11f4-4ea4-bc90-378288f75c6a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1319 microversion: 2.1 time: 0.256339 Aug 27 20:52:07.354983 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 444/956] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:07 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:07.360698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.361629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] [instance: ef14e11f-a30d-4cc5-96a3-98cd978d619a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:07.368058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.368596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.369067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.370120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.370588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.371003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.385442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] HTTP exception thrown: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Request method failure captured: Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a HTTP/1.1 Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNcYlZQzBnRztBxW0JjGsrjyc6VMJlEkUSNrKtKJLdz-Yj67Vsty9KBxtu9-QX96aBUYpVtCjZRaped-mbH3_ThD4AHoB0OC1WUDXvVQcL5yR2sz0xO1eF4PjrxEBahlY17S8WP8fVYhzE-PPmr7P19VUW60seshnAvDQgzuNkF2AQ Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:07.387187 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/51f5f4f721bb419693f552f7aba3effd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_51f5f4f721bb419693f552f7aba3effd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/51f5f4f721bb419693f552f7aba3effd"}]}] Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 51f5f4f721bb419693f552f7aba3effd Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminTestJSON-1425662006 Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7a345ebf9ea846089ee8e5d8eac1b47d Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminTestJSON-1425662006-project Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. Aug 27 20:52:07.388680 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ef14e11f-a30d-4cc5-96a3-98cd978d619a'} Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:07.389440 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. Aug 27 20:52:07.391170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.393256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] Returning 404 to user: Instance ef14e11f-a30d-4cc5-96a3-98cd978d619a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:07.393256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-95b7ff3f-3665-450f-8108-7bbe583ec37d tempest-ServersAdminTestJSON-1425662006 tempest-ServersAdminTestJSON-1425662006-project] 10.222.0.40 "GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a" status: 404 len: 111 microversion: 2.1 time: 0.032403 Aug 27 20:52:07.393256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 445/957] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:07 2022] GET /compute/v2.1/servers/ef14e11f-a30d-4cc5-96a3-98cd978d619a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:52:07.394359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31b082-a78d-469f-a66f-1c9bbe90eb3f", "name": "network-vif-plugged", "status": "completed", "tag": "56d396e9-4d65-4d5e-a190-b5f8729970d5"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:07.404431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.405226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.405680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.421009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] Creating event network-vif-plugged:56d396e9-4d65-4d5e-a190-b5f8729970d5 for instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f on nch1-master-1 Aug 27 20:52:07.428417 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e2d56f87-7ea9-4b52-a6ab-e72a8b5d63bb req-88492c68-cf0c-44e4-909c-18d0b113483e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037542 Aug 27 20:52:07.429540 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 446/958] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:07.436964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-235e557e-da0a-4c06-a17e-502e05fabd50 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Action: 'create', calling method: .version_select at 0x7ff84f373280>, body: {"pool": "non_exist_pool"} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:07.495922 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-235e557e-da0a-4c06-a17e-502e05fabd50 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] HTTP exception thrown: Floating IP pool not found. Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-235e557e-da0a-4c06-a17e-502e05fabd50 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Request method failure captured: Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 26 Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoP3n76cY8tyVjL6sQCBqJyZi56RY-4PYQoOFbUJ7lCoXM-1HdZBpwf6-rKS0oMuL2gXsNNcoYJBhtln7ySszETLKB8HVxYSAwQ9LtxGsTMKEcXdAM1iWc-BivgLhfykqMV04IuGJFwMJWOGzoCCzvNB7e5oN8m-kYM9MYeAujxMKZc Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 065c9c11343d4eeb8d6ff31a48e526bb Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:07.501341 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/065c9c11343d4eeb8d6ff31a48e526bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/065c9c11343d4eeb8d6ff31a48e526bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_065c9c11343d4eeb8d6ff31a48e526bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/065c9c11343d4eeb8d6ff31a48e526bb"}]}] Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 065c9c11343d4eeb8d6ff31a48e526bb Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsNegativeTestJSON-366837808-project Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 040400effd494ae89e3256a28170fefd Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-366837808-project Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: {"pool": "non_exist_pool"} Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP pool not found. Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 20:52:07.504026 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:07.505352 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 20:52:07.506923 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.510096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-235e557e-da0a-4c06-a17e-502e05fabd50 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Returning 404 to user: Floating IP pool not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:07.511313 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-235e557e-da0a-4c06-a17e-502e05fabd50 tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.080368 Aug 27 20:52:07.517508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 447/959] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:52:07 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:52:07.525656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Calling method '.version_select at 0x7ff84f2d9940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.539374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:07.548537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-062174a0-6c89-4a21-980b-91072b1e27f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.218029 Aug 27 20:52:07.549504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 513/960] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:07 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:07.579934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d59fee0f-9ca6-46a4-a226-18bca4a6a999 could not be found", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:52:07.581156 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] HTTP exception thrown: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Request method failure captured: Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-floating-ips/d59fee0f-9ca6-46a4-a226-18bca4a6a999 HTTP/1.1 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoP3n76cY8tyVjL6sQCBqJyZi56RY-4PYQoOFbUJ7lCoXM-1HdZBpwf6-rKS0oMuL2gXsNNcoYJBhtln7ySszETLKB8HVxYSAwQ9LtxGsTMKEcXdAM1iWc-BivgLhfykqMV04IuGJFwMJWOGzoCCzvNB7e5oN8m-kYM9MYeAujxMKZc Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 065c9c11343d4eeb8d6ff31a48e526bb Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:07.592291 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/065c9c11343d4eeb8d6ff31a48e526bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/065c9c11343d4eeb8d6ff31a48e526bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_065c9c11343d4eeb8d6ff31a48e526bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/065c9c11343d4eeb8d6ff31a48e526bb"}]}] Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 065c9c11343d4eeb8d6ff31a48e526bb Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-366837808 Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsNegativeTestJSON-366837808-project Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 040400effd494ae89e3256a28170fefd Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-366837808-project Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999 Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'd59fee0f-9ca6-46a4-a226-18bca4a6a999'} Aug 27 20:52:07.595692 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:52:07.599475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d59fee0f-9ca6-46a4-a226-18bca4a6a999 could not be found Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-634f4907-8995-42df-a0f3-72280e291ef3'] Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999. Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.609829 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999 Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:07.612588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:07.615460 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999 Aug 27 20:52:07.615460 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:07.615460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] Returning 404 to user: Floating IP not found for ID d59fee0f-9ca6-46a4-a226-18bca4a6a999 {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:07.615460 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b513f9b0-f1f6-4463-b2df-caff4f90e34b tempest-FloatingIPsNegativeTestJSON-366837808 tempest-FloatingIPsNegativeTestJSON-366837808-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/d59fee0f-9ca6-46a4-a226-18bca4a6a999" status: 404 len: 111 microversion: 2.1 time: 0.077996 Aug 27 20:52:07.615460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 448/961] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:52:07 2022] DELETE /compute/v2.1/os-floating-ips/d59fee0f-9ca6-46a4-a226-18bca4a6a999 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:52:07.883164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:07.884330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:07.895429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.896150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.896693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:07.897524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:07.903104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:07.903793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:08.340615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:08.350410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba2eeaf1-2c06-4d3a-aed4-6495e8870528 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.471802 Aug 27 20:52:08.364594 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 514/962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:07 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:08.379051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:08.380029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:08.386696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:08.389588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:08.390333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:08.390930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:08.392441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:08.394444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:08.395303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:08.573945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:08.574905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:08.588191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:08.588955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:08.589553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:08.590971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:08.591676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:08.592268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:08.778293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:08.786925 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e706842-e523-4f7c-8534-8afdd075fc62 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1319 microversion: 2.1 time: 0.413436 Aug 27 20:52:08.791908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 449/963] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:08 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:08.918192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:08.926458 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3390994a-1aaa-48b7-80eb-110967e7bde5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.357051 Aug 27 20:52:08.939866 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 515/964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:08 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:09.378980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:09.379937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:09.395782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.397525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.398247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:09.399525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.400268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.401313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:09.692759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:09.705161 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a408187-d527-49ae-8422-e25462793e85 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.331379 Aug 27 20:52:09.707029 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 450/965] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:09 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:09.809523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:09.810618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:09.820121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.821530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.822385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:09.823560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.825260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.825960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:09.929108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb6a8822-22d5-469f-aea9-5d13eb415b35 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:09.937810 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb6a8822-22d5-469f-aea9-5d13eb415b35 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.241097 Aug 27 20:52:09.938708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 516/966] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:09.949319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:09.949982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:09.957346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.957929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.958373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:09.959726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:09.960196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:09.960627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:10.171557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:10.182314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d2c7992-dcc1-4898-b72f-30172ff5c2f0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1319 microversion: 2.1 time: 0.376792 Aug 27 20:52:10.182922 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 451/967] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:09 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:10.195470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6acb607-2264-4a3c-8094-9dc5d52af53b tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.218086 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6acb607-2264-4a3c-8094-9dc5d52af53b tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.027265 Aug 27 20:52:10.218792 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 452/968] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.235307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d8abef2-0b0e-4eb9-aa87-34992eee6314 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.247073 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d8abef2-0b0e-4eb9-aa87-34992eee6314 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016138 Aug 27 20:52:10.248564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 453/969] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:10.262760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee353d9c-97d0-4614-aa8a-86b55493f119 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.266840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:10.272484 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee353d9c-97d0-4614-aa8a-86b55493f119 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015051 Aug 27 20:52:10.273617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 454/970] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:10.279823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-570b0997-a595-4ead-beba-375cdc64bb66 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.335224 Aug 27 20:52:10.287652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 517/971] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:09 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.292175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df3eb8e1-08f5-4733-8fd5-2e3d825e584a tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.330722 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df3eb8e1-08f5-4733-8fd5-2e3d825e584a tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.048984 Aug 27 20:52:10.331727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 455/972] 10.222.0.40 () {58 vars in 1165 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:10.349122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f4e1b68-9e95-49e6-9598-27393b55ec26 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.359420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f4e1b68-9e95-49e6-9598-27393b55ec26 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014321 Aug 27 20:52:10.367525 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 518/973] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.372819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f9898ca-84b5-4940-9b73-337581f45c95 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.405590 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f9898ca-84b5-4940-9b73-337581f45c95 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036436 Aug 27 20:52:10.407567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 456/974] 10.222.0.40 () {58 vars in 1169 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.423699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b802c258-6533-48a8-a4f7-ee69669a45c3 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.438702 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b802c258-6533-48a8-a4f7-ee69669a45c3 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019081 Aug 27 20:52:10.439602 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 519/975] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.454686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3d16d03-c2ee-46ce-8710-b76c92d24520 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.471370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3d16d03-c2ee-46ce-8710-b76c92d24520 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020257 Aug 27 20:52:10.475839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 457/976] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.486782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8fc3b757-8166-43ca-b557-b8f946bb5de1 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.545826 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8fc3b757-8166-43ca-b557-b8f946bb5de1 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.064065 Aug 27 20:52:10.546969 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 520/977] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.565295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3736e06-2373-4ea5-97f3-3d4704f5076c tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.576488 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3736e06-2373-4ea5-97f3-3d4704f5076c tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016251 Aug 27 20:52:10.586678 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 458/978] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.590679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b99911e9-6551-4008-bbd8-8f37ce37f31c tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.657723 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b99911e9-6551-4008-bbd8-8f37ce37f31c tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.071608 Aug 27 20:52:10.658695 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 521/979] 10.222.0.40 () {58 vars in 1144 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.681030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59b099e3-e06f-46ea-add5-dfc3a4ecea19 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.701852 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59b099e3-e06f-46ea-add5-dfc3a4ecea19 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024804 Aug 27 20:52:10.706510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 459/980] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.718105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a423775d-a0f9-421d-8194-df6d1176789d tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.730149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.732562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:10.752226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:10.753239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:10.754433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:10.755364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:10.756403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:10.757062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:10.793441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a423775d-a0f9-421d-8194-df6d1176789d tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.080819 Aug 27 20:52:10.795400 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 522/981] 10.222.0.40 () {58 vars in 1148 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.811397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-654a90f7-c297-4989-ad6a-7c72ddd19cf5 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.855729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-654a90f7-c297-4989-ad6a-7c72ddd19cf5 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.050883 Aug 27 20:52:10.863543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 523/982] 10.222.0.40 () {58 vars in 1140 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:10.871604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a6b636d-805f-470b-b038-1b96dd041e72 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.885856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a6b636d-805f-470b-b038-1b96dd041e72 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018537 Aug 27 20:52:10.889040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 524/983] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:10.900267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c439b7da-6c09-4330-af66-898420e188ee tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.928345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c439b7da-6c09-4330-af66-898420e188ee tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.032782 Aug 27 20:52:10.928962 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 525/984] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:10.947649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f00daaf-d6fa-4888-b726-1f8912f13107 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:10.993321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f00daaf-d6fa-4888-b726-1f8912f13107 tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.048658 Aug 27 20:52:10.996347 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 526/985] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:11.015963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb954160-2ae4-420a-8779-cdd027de210d tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:11.030225 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb954160-2ae4-420a-8779-cdd027de210d tempest-FlavorsV2TestJSON-1004983466 tempest-FlavorsV2TestJSON-1004983466-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019425 Aug 27 20:52:11.039947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 527/986] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:52:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:11.203605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:11.204336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:11.215396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.215710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.221416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.222472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.223706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.224339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.246028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:11.256358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12d0aaba-eef0-4764-9fc3-d711185f27ce tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.531594 Aug 27 20:52:11.256944 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 460/987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:10 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:11.311050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:11.312521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:11.327911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.328489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.329120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.330138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.330818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.331301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.431392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:11.442917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c0b7383-95cc-43e1-b4d3-dd06a162ea2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1468 microversion: 2.1 time: 0.243627 Aug 27 20:52:11.446340 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 528/988] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:11 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:11.469131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:11.480999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:11.482293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Searching by: {'reservation_id': 'r-msuvwexc', 'deleted': False, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:52:11.491329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.492151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.492977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.493996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.494707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.496315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:11.637218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:11.659752 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e6260bf-647c-4b3d-99e3-54f3025891a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.353439 Aug 27 20:52:11.671760 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 461/989] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:11 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:11.760144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:52:11.924910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:11.933385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:11.933790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:11.934266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.119405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfd948bb-d6c1-4498-9a00-e3fa64e8a7d4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?reservation_id=r-msuvwexc" status: 200 len: 2930 microversion: 2.1 time: 0.654972 Aug 27 20:52:12.132275 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 529/990] 10.222.0.40 () {58 vars in 1197 bytes} [Sat Aug 27 20:52:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-msuvwexc => generated 2930 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:12.152470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:12.170297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9213b4f8-a682-44bb-8771-1ae451404522", "name": "network-vif-plugged", "status": "completed", "tag": "4b85e86e-e432-48b9-9f1d-674b5f3deddb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:12.185826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.compute.server_groups [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Querying cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) for 2 instances {{(pid=140433) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 20:52:12.189317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.191248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.192134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.193078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.196830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.197588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.234356 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] Creating event network-vif-plugged:4b85e86e-e432-48b9-9f1d-674b5f3deddb for instance 9213b4f8-a682-44bb-8771-1ae451404522 on nch1-master-1 Aug 27 20:52:12.242289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb6d5003-70a4-4a55-b625-d6da3e47476f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/737f21a1-042b-441a-bef2-cd6e92955251" status: 200 len: 270 microversion: 2.1 time: 0.095003 Aug 27 20:52:12.243198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 462/991] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:52:12 2022] GET /compute/v2.1/os-server-groups/737f21a1-042b-441a-bef2-cd6e92955251 => generated 270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:12.248866 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-030b78b9-eed4-44f4-a635-b2419824e0ae req-4289d4a0-45c9-4e48-a55d-c3d66ce491a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083050 Aug 27 20:52:12.250488 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 530/992] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:12.254941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:12.255873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:12.262497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.263249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.263943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.264851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.265538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.266451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.280396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:12.281106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:12.291807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.292300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.292734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.293472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.293928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.294374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.580263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:12.581292 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d90fbb5d-de62-45ac-9bc7-38cb0f17173e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1619 microversion: 2.1 time: 0.331056 Aug 27 20:52:12.586566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 463/993] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:12 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1619 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:12.590691 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd64c67b-9206-4a2b-ae88-84b97a0f315d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.314535 Aug 27 20:52:12.591918 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 531/994] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:12 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:12.608128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:12.608670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:12.615555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.616392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.617043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.618055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.618750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.619447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.635377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:12.698815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:12.699659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:12.710517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.711049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.711532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.713027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:12.715163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:12.715798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:12.791021 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdefd5f3-5a92-4408-8379-5eb94e3d1754 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1620 microversion: 2.1 time: 0.190861 Aug 27 20:52:12.805637 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 464/995] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:12 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1620 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:13.024882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:13.030483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2021917041", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:13.048620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a9f8618-f2eb-4666-8db3-2970f25c5bde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.354074 Aug 27 20:52:13.052007 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 532/996] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:12 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:13.111777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:13.446572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:13.448602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:13.449294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:13.450480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:13.451609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:13.474501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:13.490647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:13.491713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:13.493346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:13.495324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:13.497880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:13.523194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:13.534031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:13.552734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:13.556536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:13.613737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:13.614411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:13.624283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:13.624793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:13.625232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:13.626441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-45f46b2e-ab37-4b3e-8b71-008037a14aed tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606272 Aug 27 20:52:13.626585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:13.627039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:13.627300 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 465/997] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:13.630043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:13.640443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afcc50ba-847b-4116-b6da-5bd80c6ff62d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:13.641747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afcc50ba-847b-4116-b6da-5bd80c6ff62d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:13.788672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afcc50ba-847b-4116-b6da-5bd80c6ff62d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:13.801544 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afcc50ba-847b-4116-b6da-5bd80c6ff62d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1217 microversion: 2.1 time: 0.166605 Aug 27 20:52:13.803993 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 466/998] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:13 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:13.942663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:13.953284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-058829d5-3327-481f-aa41-e3b5cf4110b3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1310 microversion: 2.1 time: 0.343877 Aug 27 20:52:13.973787 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 533/999] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:13 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:14.074294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:14.075271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:14.082833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:14.083193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:14.084040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:14.084789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:14.085216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:14.085836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:14.256101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:14.268830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdc9f5a6-dacc-4a65-bc63-e9bb7b6691fb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.198392 Aug 27 20:52:14.271334 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 467/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:14 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:14.824239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:14.825457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:14.844314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:14.845476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:14.846158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:14.848513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:14.862204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:14.862995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:14.980048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:14.981901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:15.011069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.011975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.022221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.040783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.042200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.044102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.115925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:15.131798 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de3e8963-63c8-4200-b262-6d4856495f81 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1269 microversion: 2.1 time: 0.311207 Aug 27 20:52:15.133843 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 534/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:14 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1269 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:15.151966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:15.165511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.166663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.167423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.192436 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] Creating event network-vif-plugged:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch1-master-1 Aug 27 20:52:15.206674 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-bbe378d6-3494-4001-a333-27a24e64c6e4 req-3c56384e-df2e-4f85-9615-44fd08472aa5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071456 Aug 27 20:52:15.208963 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 535/1002] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:15.297344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:15.298778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:15.307279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:15.308082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.308938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.309636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.310572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.311376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.312015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.336059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3a04bd6-1480-47e0-8caf-1cdc00106a38 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1493 microversion: 2.1 time: 0.362602 Aug 27 20:52:15.339474 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 468/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:14 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1493 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:15.357781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:15.358828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:15.370446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.372470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.377976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.379062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.379785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.380284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.557505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:15.574373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6560ba0f-33fc-4567-8088-986b610940d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.282187 Aug 27 20:52:15.575284 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 536/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:15 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:15.643290 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23faedec-a394-4de4-8a54-831f4c9dadb0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1644 microversion: 2.1 time: 0.289129 Aug 27 20:52:15.662370 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 469/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:15 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1644 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:15.666829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:15.667574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:15.676740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.679592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.681577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.682415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.685540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.686111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.864622 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ebd8739e-ad9d-4bdf-af88-d2f04652bc8f tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1644 microversion: 2.1 time: 0.201749 Aug 27 20:52:15.865770 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 537/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:15 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1644 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:15.885159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:15.889446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.890148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.890743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.891921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.892594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.893177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.922262 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07798c03-f4cb-4e12-bd74-044054868af4 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040593 Aug 27 20:52:15.936632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:15.937719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:15.946697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 470/1007] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:52:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:15.948782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.949552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.950237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.951174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:15.951916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:15.952556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:15.972826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:16.050462 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ddf94376-6515-4380-bb78-a13840759a42 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522/action" status: 202 len: 0 microversion: 2.1 time: 0.117156 Aug 27 20:52:16.055238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 538/1008] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:15 2022] POST /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:52:16.062317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:16.064153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:16.073298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.075115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.076064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.077137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.077844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.078380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.155451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:16.156931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:16.186507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.192333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.193084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.194241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.194959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.195664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.373441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:16.387047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ed82365-e29c-47e6-97c7-8d51f56619a3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1275 microversion: 2.1 time: 0.236636 Aug 27 20:52:16.401348 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 539/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:16 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:16.431620 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bdc4c550-a5bf-4a4d-b80d-13524862f09e tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1649 microversion: 2.1 time: 0.374749 Aug 27 20:52:16.445004 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 471/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:16 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1649 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:16.598027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:16.598640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:16.602428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:16.610918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.611773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.612567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.613932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:16.615169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:16.615860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:16.813920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:16.831468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a68fe69-e205-43f2-b2cc-64049ded590c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1313 microversion: 2.1 time: 0.237167 Aug 27 20:52:16.841678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 540/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:16 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:17.066105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ab81f69-7ce4-4e6a-a237-2331548446d9 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f20d700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:17.122473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ab81f69-7ce4-4e6a-a237-2331548446d9 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff" status: 200 len: 637 microversion: 2.1 time: 0.061030 Aug 27 20:52:17.123416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 472/1012] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:17 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff => generated 637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:17.137607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-901f730a-ad11-4d29-a6ec-8da625a527c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f207ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:17.219231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-901f730a-ad11-4d29-a6ec-8da625a527c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:17.224536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-901f730a-ad11-4d29-a6ec-8da625a527c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:17.409999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:17.410688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:17.417707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.419727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.420261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.421095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.422792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.423515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.510075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:17.519293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c22b8d1-b400-47be-839e-31d256c9c07b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1275 microversion: 2.1 time: 0.114791 Aug 27 20:52:17.519936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 473/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:17 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:17.526244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:17.527934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:17.535562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.536519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.537442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.538242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.538774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.539290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.578007 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-901f730a-ad11-4d29-a6ec-8da625a527c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.444314 Aug 27 20:52:17.583838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 541/1014] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:17 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:17.590329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5a35af5-6496-4249-ba9e-500b295e3507 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f37aa60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:17.725868 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4db15e7-343c-4f85-87c4-3221c0302644 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1629 microversion: 2.1 time: 0.204615 Aug 27 20:52:17.727159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 474/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:17 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1629 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:17.751541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:17.760541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:17.786808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.787611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.790289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.791304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:17.792376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:17.793947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:17.838455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lazy-loading 'flavor' on Instance uuid 9213b4f8-a682-44bb-8771-1ae451404522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:52:17.876917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Going to try to live migrate instance to nch2-master-1 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:52:18.038947 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5a35af5-6496-4249-ba9e-500b295e3507 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "DELETE /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.453462 Aug 27 20:52:18.040461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 542/1016] 10.222.0.40 () {58 vars in 1296 bytes} [Sat Aug 27 20:52:17 2022] DELETE /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_version => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:52:18.047877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:18.048620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:18.055312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:18.055850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:18.056299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:18.057016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:18.057479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:18.057909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:18.259609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:18.289266 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5fb5db9a-054c-4fb5-ac53-6a2abd6699d3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1463 microversion: 2.1 time: 0.246115 Aug 27 20:52:18.292998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 543/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:18 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1463 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:18.301640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8c679e5-228f-4fc5-a6ba-0390c7cf9b5f tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f186820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:18.366969 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8c679e5-228f-4fc5-a6ba-0390c7cf9b5f tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 37 microversion: 2.1 time: 0.072443 Aug 27 20:52:18.368172 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 544/1018] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:52:18 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:18.678037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:18.679097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:18.692681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:18.693126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:18.693597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:18.698254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:18.700738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:18.701079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:19.201193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7b07dee-b9b4-4fb7-8be8-fb2b696f807b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1614 microversion: 2.1 time: 0.823719 Aug 27 20:52:19.202035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 545/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:18 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1614 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:19.230944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c188d047-19b0-437f-bd9f-f759c65dd0a2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f186ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:19.320276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c188d047-19b0-437f-bd9f-f759c65dd0a2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:19.325528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c188d047-19b0-437f-bd9f-f759c65dd0a2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:19.684642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c188d047-19b0-437f-bd9f-f759c65dd0a2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.480052 Aug 27 20:52:19.685233 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 546/1020] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:19 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:19.690736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:19.691375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:19.704699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:19.705064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:19.705609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:19.708455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:19.708934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:19.709390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:19.956199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:19.966198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-482d872c-bec0-408c-baa5-425106179742 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.279615 Aug 27 20:52:19.979441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 547/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:19 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:19.979441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:19.979441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:19.981432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:19.981930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:19.982367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:19.983085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:19.983579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:19.984005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.087833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2347ae915fad4b4faaf73d02bac8d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3656ebdac94b4796c8750cb68dc686', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:20.088439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] flavor_id is None. Assuming migration. {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 20:52:20.089573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 20:52:20.224533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-042c2473-05d8-46d7-9706-5fad8f4afe65 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522/action" status: 202 len: 0 microversion: 2.1 time: 2.477363 Aug 27 20:52:20.225881 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 475/1022] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:17 2022] POST /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522/action => generated 0 bytes in 2480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:52:20.233382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d292f22-0da9-42d4-9578-42ea33ad6e68 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f34caf0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:20.323647 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d292f22-0da9-42d4-9578-42ea33ad6e68 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.095714 Aug 27 20:52:20.325164 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 476/1023] 10.222.0.40 () {58 vars in 1290 bytes} [Sat Aug 27 20:52:20 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_distro => generated 33 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:20.337403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba52b75-cc52-4020-90d1-88de79056aa5", "tag": "03939b32-256f-4490-bfe1-6d0078277650"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:20.354004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:20.354571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:20.355118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.384741 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] Creating event network-changed:03939b32-256f-4490-bfe1-6d0078277650 for instance 5ba52b75-cc52-4020-90d1-88de79056aa5 on nch2-master-1 Aug 27 20:52:20.395304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-11efe674-513d-4e74-8a6d-6e52fba9a2f9 req-da2d5942-e3f7-417c-9821-96a923c3db3b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068450 Aug 27 20:52:20.396384 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 477/1024] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:20.404847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:20.405606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:20.418634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:20.419143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:20.419617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.420348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:20.421150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:20.421581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.579875 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77eff3b3-5c82-48af-a0fd-aebcfa8b1bbf tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2/action" status: 202 len: 0 microversion: 2.1 time: 0.610515 Aug 27 20:52:20.581546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 548/1025] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:19 2022] POST /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:52:20.587903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7bc339bb-7a87-48e8-9d79-08c965a4d716 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f04eee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:20.682127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:20.691716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7bc339bb-7a87-48e8-9d79-08c965a4d716 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:20.697645 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f272e9f9-9be3-4410-8155-358d96b421c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.299923 Aug 27 20:52:20.700515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7bc339bb-7a87-48e8-9d79-08c965a4d716 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:20.719015 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 478/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:20 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:20.737317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:20.738081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:20.755643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:20.756511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:20.759403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.760371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:20.761009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:20.767420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:20.914903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7bc339bb-7a87-48e8-9d79-08c965a4d716 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.332043 Aug 27 20:52:20.921430 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 549/1027] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:20 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:20.927690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc7d61a2-3668-4740-83e7-f3625794e13d tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f1c9af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:20.978248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc7d61a2-3668-4740-83e7-f3625794e13d tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.054509 Aug 27 20:52:20.984666 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 550/1028] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:52:20 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:20.990402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2dae67a-503e-42ec-83f4-ed0e801ad81e tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f2078b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:21.042366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:21.053759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b2470a2-25bc-46a6-9da2-2e009dca62a6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.331888 Aug 27 20:52:21.054690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 479/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:20 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:21.070054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c2dae67a-503e-42ec-83f4-ed0e801ad81e tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:21.074011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:21.075383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:21.075708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c2dae67a-503e-42ec-83f4-ed0e801ad81e tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:21.083575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:21.084597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:21.085744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:21.087315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:21.088376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:21.089345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:21.292621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:21.327637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de821694-29a6-485d-9252-9ef1c1e65b6e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.271190 Aug 27 20:52:21.339671 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 480/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:21 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:21.355609 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2dae67a-503e-42ec-83f4-ed0e801ad81e tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.369621 Aug 27 20:52:21.361202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 551/1031] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:20 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:21.366811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef300473-fd63-488e-b34d-ab05bbb2f0c0 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f204b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:21.426358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ef300473-fd63-488e-b34d-ab05bbb2f0c0 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:21.431067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ef300473-fd63-488e-b34d-ab05bbb2f0c0 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:21.723609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:21.731467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:21.732774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:21.747821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:21.753542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:21.755417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:21.756185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:21.756654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:21.760317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:21.790473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef300473-fd63-488e-b34d-ab05bbb2f0c0 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 64 microversion: 2.1 time: 0.427711 Aug 27 20:52:21.791091 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 481/1032] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:21 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 64 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:21.800646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eab444ea-051b-479c-a4f7-bac8f15e5500 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f1c2040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:21.864871 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eab444ea-051b-479c-a4f7-bac8f15e5500 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068031 Aug 27 20:52:21.866619 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 482/1033] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:52:21 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 64 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:52:21.894826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3da478c8-9f4e-4785-9e6e-171d00c429ed tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f239310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:21.974029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3da478c8-9f4e-4785-9e6e-171d00c429ed tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:21.978231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3da478c8-9f4e-4785-9e6e-171d00c429ed tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:21.992688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:22.002942 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07d8caca-3eff-4188-b5e8-07910466a0a0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.279826 Aug 27 20:52:22.003574 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 552/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:21 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:22.075675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:22.076418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:22.084571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:22.085086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:22.085531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:22.086256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:22.086723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:22.087161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:22.282820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:22.293449 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef4a75e9-ec7e-4d84-a243-3ce57b90a05d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.223088 Aug 27 20:52:22.294036 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 553/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:22 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:22.350510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:22.365887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:22.372626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:22.373625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:22.374308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:22.376895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:22.377692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:22.378441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:22.393249 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3da478c8-9f4e-4785-9e6e-171d00c429ed tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.517715 Aug 27 20:52:22.394024 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 483/1036] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:21 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:22.403276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed7177d1-1969-4145-9e73-7997cf7497c2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update', calling method: .version_select at 0x7ff84f239940>, body: {"meta": {"os_version": "alt"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:22.468053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ed7177d1-1969-4145-9e73-7997cf7497c2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:22.472756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:22.476302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ed7177d1-1969-4145-9e73-7997cf7497c2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:22.597565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:22.606818 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf63867a-4a93-41bc-b508-30e6b03bf8ad tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.260458 Aug 27 20:52:22.607776 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 554/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:22 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:22.796341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed7177d1-1969-4145-9e73-7997cf7497c2 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.396651 Aug 27 20:52:22.796711 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 484/1038] 10.222.0.40 () {60 vars in 1313 bytes} [Sat Aug 27 20:52:22 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata/os_version => generated 31 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:22.806566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ea142db-fc8d-4c84-8951-5d2ac595f359 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f2bcaf0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:22.861992 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ea142db-fc8d-4c84-8951-5d2ac595f359 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 58 microversion: 2.1 time: 0.059270 Aug 27 20:52:22.862810 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 555/1039] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:52:22 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 58 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:22.874067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3f6d349-0494-4b41-a9d9-6117646e6611 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'update_all', calling method: .version_select at 0x7ff84f1c2af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:22.970791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d3f6d349-0494-4b41-a9d9-6117646e6611 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:22.984529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d3f6d349-0494-4b41-a9d9-6117646e6611 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:23.024746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:23.025645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:23.053362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.053862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.054325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:23.063700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.064199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.064638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:23.315535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:23.340112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0483b42d-ce79-46ef-a48e-43304c088eca tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.318107 Aug 27 20:52:23.342080 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 556/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:23 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:23.356262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:23.358488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:23.381014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.381685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.382649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:23.383935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.387205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.387832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:23.452758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3f6d349-0494-4b41-a9d9-6117646e6611 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 61 microversion: 2.1 time: 0.583455 Aug 27 20:52:23.453357 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 485/1041] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:52:22 2022] PUT /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 61 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:23.462858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf9dcaaa-8ec9-4be3-a3dd-c98db744c7c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Action: 'create', calling method: .version_select at 0x7ff84f2395e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:23.527932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cf9dcaaa-8ec9-4be3-a3dd-c98db744c7c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:23.534362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cf9dcaaa-8ec9-4be3-a3dd-c98db744c7c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Getting quotas for user 01e6def9937a4a208d4d75319872d38d and project c16d28b7d50b412daa5ce3f7990f7048. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:23.620180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:23.637074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22813f4e-6312-409d-9bf5-c51def7a5517 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.291669 Aug 27 20:52:23.639836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 557/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:23 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:23.710313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1178357327", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "9c58eb9b-edd7-4932-8b75-d271f5f1d195"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:23.796298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] validate_networks() for [('9c58eb9b-edd7-4932-8b75-d271f5f1d195', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:23.919593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf9dcaaa-8ec9-4be3-a3dd-c98db744c7c3 tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "POST /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 85 microversion: 2.1 time: 0.456347 Aug 27 20:52:23.920605 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 486/1043] 10.222.0.40 () {60 vars in 1281 bytes} [Sat Aug 27 20:52:23 2022] POST /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 85 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:23.938322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:23.939138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:23.946394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.947151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.948642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:23.949356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:23.949817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:23.950259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.196466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:24.207921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72d5a352-cc8f-49ac-9ebc-66543cb22d94 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.285937 Aug 27 20:52:24.208777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 487/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:23 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:24.214293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-84714987-1678-4555-823f-bc35dded7b7f tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] Calling method '.version_select at 0x7ff84f1933a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:24.290053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-84714987-1678-4555-823f-bc35dded7b7f tempest-ImagesMetadataTestJSON-657317409 tempest-ImagesMetadataTestJSON-657317409-project] 10.222.0.40 "GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata" status: 200 len: 85 microversion: 2.1 time: 0.079972 Aug 27 20:52:24.290976 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 488/1045] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:52:24 2022] GET /compute/v2.1/images/a32f6b3d-c0d9-4b2c-a9f8-0ecc3f0c88ff/metadata => generated 85 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:24.367590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:24.368593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:24.379808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.382908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.385718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.389935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.391511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.392701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.415302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:24.415794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:24.416274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:24.417008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:24.417520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:24.430442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.431296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.431980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.448797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.449436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.453350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.516554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:24.522670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for user 0bdbed202cad4f2bbc0c299bf9442986 and project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:24.541271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:24.546269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:24.677752 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72300e91-3eea-41aa-a66f-1d6158f68f2d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036268 Aug 27 20:52:24.692848 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 558/1046] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:24.699601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:24.706484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:24.708985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:24.717832 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-71e7a89d-da2d-4c3f-be11-2c04cdb4072a tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.350801 Aug 27 20:52:24.719087 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 489/1047] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:24 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:24.725159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-952789cc-12a7-4118-804d-49cb1d7b1b94 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:24.730492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-952789cc-12a7-4118-804d-49cb1d7b1b94 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:24.745814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.751535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.754678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.774706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:24.783191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:24.784431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:24.858013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-952789cc-12a7-4118-804d-49cb1d7b1b94 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:24.868915 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-952789cc-12a7-4118-804d-49cb1d7b1b94 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1225 microversion: 2.1 time: 0.148312 Aug 27 20:52:24.869555 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 490/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:24 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:25.026527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e15136f4-31eb-40f1-9622-697a3f2e4960"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:25.029089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:25.064026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.066716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.072317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.076997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.077510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.079964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.247377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:25.257927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1a91796-8714-4812-8267-4a8533996b7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.559485 Aug 27 20:52:25.258571 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 559/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:24 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:25.284419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:25.285038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:25.296931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.297697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.298273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.299180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.303424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.310808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.530697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:25.646059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:25.668874 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84f449cc-1b56-4fb1-b1a5-0a43a3bb781a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.406779 Aug 27 20:52:25.673072 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 560/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:25 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:25.749429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:25.750740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:25.769401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.773014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.774863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.776404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:25.779900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:25.780590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:25.790730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:25.901774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:25.981034 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "POST /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.958501 Aug 27 20:52:25.987777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 491/1051] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 20:52:25 2022] POST /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments => generated 194 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:25.995378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:26.004403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:26.014443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.024161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.024829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.025696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.026406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.027101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.064786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:26.076883 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4afdf51-875a-4c92-8f03-5fdc62668b5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.334560 Aug 27 20:52:26.078690 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 561/1052] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:25 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:26.146314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:26.155235 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5fae949-4343-41a9-a0da-18fe77da5235 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1229 microversion: 2.1 time: 0.165843 Aug 27 20:52:26.167739 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 492/1053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:25 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:26.213093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9213b4f8-a682-44bb-8771-1ae451404522", "name": "network-vif-unplugged", "status": "completed", "tag": "4b85e86e-e432-48b9-9f1d-674b5f3deddb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:26.225062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.225975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.226749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.248796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] Creating event network-vif-unplugged:4b85e86e-e432-48b9-9f1d-674b5f3deddb for instance 9213b4f8-a682-44bb-8771-1ae451404522 on nch1-master-1 Aug 27 20:52:26.268894 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2438c9c4-c958-491d-bd6f-ac2a9d6e8344 req-0c40c3a4-ed69-4dda-ab07-0ac7904e3260 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059716 Aug 27 20:52:26.270081 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 562/1054] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:26.281900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:26.285003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:26.296587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.297465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.298121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.300964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.301509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.303019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.464290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:26.476182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06e79fb5-5188-4aa6-a041-b12a20ea7564 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.198039 Aug 27 20:52:26.477319 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 493/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:26 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:26.696650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:26.697574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:26.710302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.710909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.712772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:26.715962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:26.720907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:26.721484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.018994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:27.029815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7736343c-3da3-4b6f-88af-544b0c8a52cf tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.338737 Aug 27 20:52:27.046321 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 563/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:26 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:27.101287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:27.102727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:27.116369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.118486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.121251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.122222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.124161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.127358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.178914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:27.179970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:27.188130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.189337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.208272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.209120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.209595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.211442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.359449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:27.368516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-80385322-2bf0-4883-8fd2-93953d3e02cc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1277 microversion: 2.1 time: 0.193496 Aug 27 20:52:27.372620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 564/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:27 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:27.472565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:27.483209 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4fd8c7c0-ebaf-4b15-9b2a-a4f9c98db4f8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.385972 Aug 27 20:52:27.486081 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 494/1058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:27 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:27.497133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:27.504359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:27.515593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.516130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.523733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.524508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:27.527702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:27.528102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:27.788159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:27.807635 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d027537f-5c4d-45c8-b32a-f77992352561 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1472 microversion: 2.1 time: 0.313408 Aug 27 20:52:27.820344 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 565/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:27 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:28.055739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:28.056784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:28.066021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.067535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.068229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.069142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.069786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.070403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.396842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:28.408403 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cafa842a-256d-4183-904d-bba8fda4ba2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.359190 Aug 27 20:52:28.418532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1052789347", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:28.423742 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 495/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:28 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:28.441725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba52b75-cc52-4020-90d1-88de79056aa5", "name": "network-vif-plugged", "status": "completed", "tag": "03939b32-256f-4490-bfe1-6d0078277650"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:28.484293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.486529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.487747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.527204 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] Creating event network-vif-plugged:03939b32-256f-4490-bfe1-6d0078277650 for instance 5ba52b75-cc52-4020-90d1-88de79056aa5 on nch2-master-1 Aug 27 20:52:28.529213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:28.543889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8aa90787-2dde-412a-b60d-b0b28218c0bd req-d684e54a-c7d0-4ae8-9f66-1ce42088f617 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115320 Aug 27 20:52:28.546468 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 496/1061] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:28.558874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9213b4f8-a682-44bb-8771-1ae451404522", "tag": "4b85e86e-e432-48b9-9f1d-674b5f3deddb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:28.583909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.584405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.584838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.601213 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] Creating event network-changed:4b85e86e-e432-48b9-9f1d-674b5f3deddb for instance 9213b4f8-a682-44bb-8771-1ae451404522 on nch1-master-1 Aug 27 20:52:28.606929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-48389b29-8fa2-4c59-b66f-8921c0813cb8 req-8de31b46-7e87-4297-9efd-05738729c990 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058813 Aug 27 20:52:28.608845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 497/1062] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:28.616983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:28.618139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:28.626917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.627778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.628463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.629531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.630346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.631308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.766911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:28.784541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c1e3abe2-60c8-465a-9ae6-7a6378333fe7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1283 microversion: 2.1 time: 0.173571 Aug 27 20:52:28.798275 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 498/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:28 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:28.804038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:28.804860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:28.811943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.812619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.813252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.814232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.814846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.815480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.920576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:28.921839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:28.922450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:28.922870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:28.923428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:28.935888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.936396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.936851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.937585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:28.938529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:28.939121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:28.960649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Getting quotas for project bdaa7c7ca577460886d51a42e581c3ac. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:28.966323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Getting quotas for user 8755382f70e248039545e8882d4fd015 and project bdaa7c7ca577460886d51a42e581c3ac. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:28.979742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:28.982468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:29.016025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:29.025481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a489d55f-7cc4-4907-a158-003862f6dcb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.225669 Aug 27 20:52:29.026650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 499/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:28 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:29.032355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:29.033618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:29.048217 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-577928de-14c2-4fe0-9abe-bb8e1951f00a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901649 Aug 27 20:52:29.048746 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 566/1065] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:29.052637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.053515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.055494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:29.059746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.060215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3cfcb3c2-6461-45b0-aa02-093a6f9bff82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:29.060844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3cfcb3c2-6461-45b0-aa02-093a6f9bff82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:29.064173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.064735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:29.065898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:29.169393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3cfcb3c2-6461-45b0-aa02-093a6f9bff82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:29.180256 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3cfcb3c2-6461-45b0-aa02-093a6f9bff82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1217 microversion: 2.1 time: 0.123732 Aug 27 20:52:29.181526 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 567/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:29 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:29.284796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:29.294927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-acf84547-4f54-414f-8584-c73627676cec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.264978 Aug 27 20:52:29.295805 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 500/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:29 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:29.437877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:29.440431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:29.451733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.452698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.453448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:29.457278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.458624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.459829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:29.619363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:29.630264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc4470e2-8a1f-4921-bc79-8cd00fbeaaf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.199896 Aug 27 20:52:29.630977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 568/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:29 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:29.805346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:29.806014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:29.813400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.813887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.814313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:29.814973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:29.815695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:29.816186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.001725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:30.010337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c57d8758-41c7-4690-a0d9-080bbee1c017 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.208859 Aug 27 20:52:30.011771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 501/1069] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:29 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:30.050422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:30.051877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:30.059676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.060478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.061097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.061874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.062351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.062834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.200294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:30.203226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:30.204135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:30.210993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.211592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.212087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.213226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.213767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.214568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.216757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55bc26bd-d591-4ace-878a-df3072e00bb5 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.172618 Aug 27 20:52:30.217828 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 569/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:30 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:30.284867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:30.292537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a74eb138-1738-4a0c-9c4b-265fb7b5617f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1213 microversion: 2.1 time: 0.093190 Aug 27 20:52:30.293107 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 502/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:30 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:30.317150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:30.317926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:30.326001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.326499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.326943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.327687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.328150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.328668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.502974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:30.513416 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b390a19d-5431-4b68-b488-edba34ea37c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.200590 Aug 27 20:52:30.514366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 570/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:30 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:30.657985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:30.658585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41be0bb9-c6da-4ddd-9b82-0d0295cff228", "tag": "d1134007-4daa-401f-8925-140cc9922c69"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:30.662811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:30.674874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.675320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.675517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.675829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.676504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.677514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.678540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:30.679277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:30.680201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:30.694285 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] Creating event network-changed:d1134007-4daa-401f-8925-140cc9922c69 for instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 on nch1-master-1 Aug 27 20:52:30.700164 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-833d1e1d-117a-46c4-8a75-9ded095361c4 req-f849a79b-bec3-4ba2-9ee0-358d77030888 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055527 Aug 27 20:52:30.700845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 503/1073] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:30.834671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:30.849163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44650c74-7cd1-4fc3-9c1e-a7489f8b2804 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.199639 Aug 27 20:52:30.850035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 571/1074] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:30 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:31.034074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:31.034826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:31.041648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.042140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.042577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.043290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.043782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.044215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.183092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:31.191857 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e15dd3bb-7923-419f-96cc-747b7cc93e37 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.163332 Aug 27 20:52:31.192422 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 504/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:31 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:31.243188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:31.243918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:31.253940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.254431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.254869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.255625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.256081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.256508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.314519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:31.315220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:31.322618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.323204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.323737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.324527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.325099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.325672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.400081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:31.408874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b5a70302-1780-4113-b0c7-ed0ed4a109f2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1269 microversion: 2.1 time: 0.099093 Aug 27 20:52:31.409655 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 505/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:31 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:31.417581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:31.425980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36842b80-4b49-4eb2-b848-1dcdb56fa1c9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.189734 Aug 27 20:52:31.426604 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 572/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:31 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:31.537367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:31.538230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:31.545031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.545576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.546100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.546824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.547449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.547878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.696885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:31.705875 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3217dc30-0722-4c92-acf2-69aae8348088 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.172491 Aug 27 20:52:31.706495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 506/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:31 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:31.875373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:31.876220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:31.885493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.886298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.886743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:31.887476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:31.887954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:31.888381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.031522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:32.040008 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1db72f3-e0a1-4812-90a0-11b0c78a6b45 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.172502 Aug 27 20:52:32.040610 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 573/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:31 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:32.213572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:32.214740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:32.224066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.224935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.225804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.226991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.227907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.228719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.376430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:32.384845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fac8ef22-588e-45cc-a464-530e40028580 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.176232 Aug 27 20:52:32.385410 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 507/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:32 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:32.431753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:32.432390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:32.441704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.442519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.442965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.443691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.444158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.444587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.447813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:32.448472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:32.455144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.455669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.456121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.456809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.457271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.457698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.518742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:32.526702 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22c1b4ff-9332-4765-abec-2bc860b4d970 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1269 microversion: 2.1 time: 0.100148 Aug 27 20:52:32.527281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 574/1081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:32 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1269 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:32.608519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:32.617158 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42ad7eaf-8bd0-4138-9fdb-1e96702f1ce8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.173700 Aug 27 20:52:32.617746 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 508/1082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:32 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:32.734645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:32.735391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:32.742233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.742736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.743174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.743932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:32.744393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:32.744817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:32.881915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:32.896173 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-384b41d2-1ea0-4c22-b943-5fa4ae4b2925 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.165226 Aug 27 20:52:32.897043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 575/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:32 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:33.061589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:33.062244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.069462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.070057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.070583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.071420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.071979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.072530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.088776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:33.216277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:33.226374 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75b592c0-d5d5-40ea-909c-eb112958e0a5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1317 microversion: 2.1 time: 0.168715 Aug 27 20:52:33.227194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 509/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:33 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:33.406006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:33.406707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.413341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.413882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.414318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.415048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.415572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.415981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.547608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:33.548590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.559382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.560245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.560915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.561836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.562497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.563146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.581949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:33.592565 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01731a94-2aef-4cba-9d7f-ea6da3b007f7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.190579 Aug 27 20:52:33.593741 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 576/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:33 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:33.640105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:33.641540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.648179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:33.649555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.650129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.650780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.651533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.652226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.652882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.668038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6f4d8c3-b18b-4566-b58f-f515a0402fc5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1269 microversion: 2.1 time: 0.124763 Aug 27 20:52:33.669279 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 510/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:33 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:33.789020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:33.797110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ddbf478-bdb4-48a5-bcdd-bfdebbe6205b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.162945 Aug 27 20:52:33.797695 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 577/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:33 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:33.886825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "64be3f2d-844b-45ef-ad23-df21c4cc3a2b"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:33.890529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.898183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.898702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.899195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.899925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.900383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.900816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.921580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:33.922294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:33.929811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.930390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.930880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:33.931746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:33.932273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:33.932795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.081747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:34.090993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] HTTP exception thrown: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. Aug 27 20:52:34.091166 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-13ce663e-bd80-4799-a5a4-75d3b1161961 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.172901 Aug 27 20:52:34.091762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 578/1088] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:33 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Request method failure captured: Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments/e15136f4-31eb-40f1-9622-697a3f2e4960 HTTP/1.1 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 74 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOaTyES5TIs4xVZU6PQCEqXVR9SYGshFVrxNiGbTHGxtNKT3OC_mp3w17xtC-7QM4Hv1Us0MwG91kBqb6Zu5IqAg0x6iucJpqOqL9l9bUyYqDw9nGShYud7smTOa1ZqHdsQcsjxejijf9dbCCDPnp_396WaoeF4sPVtL2lsldxPjPA Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7c837ff8c21c4634a5a57b2621441ab6 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:52:34.095284 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c837ff8c21c4634a5a57b2621441ab6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7c837ff8c21c4634a5a57b2621441ab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7c837ff8c21c4634a5a57b2621441ab6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c837ff8c21c4634a5a57b2621441ab6"}]}] Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7c837ff8c21c4634a5a57b2621441ab6 Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesAdminNegativeTest-816706168-project-admin Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 171b7df182b64bcfa5196154cc74a356 Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesAdminNegativeTest-816706168-project-admin Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: {"volumeAttachment": {"volumeId": "64be3f2d-844b-45ef-ad23-df21c4cc3a2b"}} Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:34.096896 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': '5c35889b-6c0a-4027-ad07-7b3cb8575afe', 'id': 'e15136f4-31eb-40f1-9622-697a3f2e4960', 'body': {'volumeAttachment': {'volumeId': '64be3f2d-844b-45ef-ad23-df21c4cc3a2b'}}} Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 20:52:34.097871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. (HTTP 404) (Request-ID: req-29ac0865-6983-44f2-af5a-7709ba162929) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 20:52:34.098962 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:34.100201 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. Aug 27 20:52:34.101354 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:34.102496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Returning 400 to user: Volume 64be3f2d-844b-45ef-ad23-df21c4cc3a2b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:34.102496 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89ed89d6-09dc-4a64-8fc6-5a6c649ab5b6 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments/e15136f4-31eb-40f1-9622-697a3f2e4960" status: 400 len: 107 microversion: 2.1 time: 0.334124 Aug 27 20:52:34.102496 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 511/1089] 10.222.0.40 () {60 vars in 1433 bytes} [Sat Aug 27 20:52:33 2022] PUT /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments/e15136f4-31eb-40f1-9622-697a3f2e4960 => generated 107 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 20:52:34.172647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.173210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.180033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.180538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.180985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.181841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.182309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.182740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.248082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.249422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.257090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.257594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.258037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.258781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.259242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.259703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.342232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'services' on Instance uuid 5c35889b-6c0a-4027-ad07-7b3cb8575afe {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:52:34.374247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:34.407572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:34.416351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6837042d-d3ac-4b4e-8e79-016fa05fa369 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1467 microversion: 2.1 time: 0.172834 Aug 27 20:52:34.417292 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 512/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1467 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:34.437015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.437732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.444801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.445318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.445783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.446487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.446945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.447390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.478686 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b8d4ba7-c998-41ef-bc16-b8458d46793a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments/e15136f4-31eb-40f1-9622-697a3f2e4960" status: 202 len: 0 microversion: 2.1 time: 0.314520 Aug 27 20:52:34.479329 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 579/1091] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 20:52:34 2022] DELETE /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments/e15136f4-31eb-40f1-9622-697a3f2e4960 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:52:34.489392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.492187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.507362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.508556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.509185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.510721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.511292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.512601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.565734 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ff75746-8554-43bf-9a3f-e7cf1e93292e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081393 Aug 27 20:52:34.571480 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 580/1092] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:34.617241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.617948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.622337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61ad8576-8e99-4a73-bf96-38da5fcdc666 tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1618 microversion: 2.1 time: 0.188867 Aug 27 20:52:34.632669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 513/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1618 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:34.632813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.632813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.632813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.632813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.642906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.642906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.691023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.692071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.699318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.700234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.700961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.701831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.702439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.703142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.809707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:34.822667 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e94ac6d2-c590-405c-84df-7c52888c3115 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1275 microversion: 2.1 time: 0.135357 Aug 27 20:52:34.823984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 514/1094] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:34.830898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1712475567", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6"]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:34.863212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=30 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:34.869388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:34.889561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec1db1a7-ec51-43dc-8614-4173d2889b3e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.280195 Aug 27 20:52:34.892664 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 581/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:34.897811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:34.899940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:34.911905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.912588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.913223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.914117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:34.914888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:34.915521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:34.930626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:35.155712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:35.165663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7aefbd5f-9818-4dcb-8e80-16e6af226366 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.271739 Aug 27 20:52:35.179782 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 582/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:34 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:35.179782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:35.179782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:35.179782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.179782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.180815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.180815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.180815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.181242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.342072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:35.343120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:35.343848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:35.344440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:35.345019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:35.360430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.361420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.362186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.363707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.364274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.364863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.383207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:35.392230 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f2aab01b-953e-4833-97f0-df1aa6aea5c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.224757 Aug 27 20:52:35.392966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 583/1097] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:35 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:35.412394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:35.416876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:35.436428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:35.439119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:35.495903 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87169141-bf7c-4c28-a6c9-ee6afd3d8844 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670333 Aug 27 20:52:35.497342 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 515/1098] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:35.509333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96bb73e2-de87-4dea-aa43-9e4734d8830b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:35.509963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-96bb73e2-de87-4dea-aa43-9e4734d8830b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:35.581449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:35.583186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-96bb73e2-de87-4dea-aa43-9e4734d8830b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:35.584652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:35.595052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96bb73e2-de87-4dea-aa43-9e4734d8830b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1217 microversion: 2.1 time: 0.088568 Aug 27 20:52:35.597697 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 584/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:35 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:35.598402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.598942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.599407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.600144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.600593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.601014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.661444 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a664b2e1-2962-4806-a87f-6fcf2d1bbdf3 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083576 Aug 27 20:52:35.666637 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 516/1100] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 20:52:35 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:52:35.856632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:35.859963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:35.880035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.880680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.881759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.882600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.883298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.884190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.914570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:35.917089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:35.928136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.928920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.929510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.931109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:35.931809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:35.932389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:35.963114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:35.974975 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aef46ad8-5123-4b86-b335-674694551ef5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1275 microversion: 2.1 time: 0.129925 Aug 27 20:52:35.976023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 585/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:35 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:36.108864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:36.118734 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eb39ef1c-28fd-49e7-8cec-7eb84d884c30 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.209752 Aug 27 20:52:36.119326 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 517/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:35 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:36.192543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:36.193345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:36.200141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.200702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.201196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.201974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.202493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.203115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.379031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:36.388443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36d559df-3870-4e25-91ed-856ca9d5aabf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.200975 Aug 27 20:52:36.389077 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 586/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:36 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:36.414550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:36.415185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:36.421898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.422382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.423032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.423792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.424497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.424935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.618783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:36.620158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:36.637048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.638716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.639682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.641583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.643360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.644201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.803225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:36.812215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b2b4bdc-4632-4ab7-8093-55ee20e25be7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1269 microversion: 2.1 time: 0.197996 Aug 27 20:52:36.812791 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 587/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:36 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:36.821897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:36.825384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:36.831906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.832470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.832971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.833625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:36.834108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:36.834534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:36.862655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:36.870964 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d405d0e-19a3-4ce3-b0ae-85d4646edfc3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.460647 Aug 27 20:52:36.871563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 518/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:36 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:36.873063 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9078562-cd67-4759-abcf-89c7a6b64ce6 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057250 Aug 27 20:52:36.873645 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 588/1106] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 20:52:36 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:52:37.000317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:37.001730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:37.006797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:37.012063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.012786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.013406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.014301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.014846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.015538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.051241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-231922031", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "e6cdac53-285c-4679-8aac-b49067522b09"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:37.147352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] validate_networks() for [('e6cdac53-285c-4679-8aac-b49067522b09', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:37.259934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:37.274881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-435b01f9-b33c-41df-a675-db5884a2c9a5 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.282049 Aug 27 20:52:37.276680 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 519/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:36 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:37.284558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:37.284895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:37.296067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.296743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.297201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.301374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.301918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.302485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.593081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:37.603878 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4175e41b-0f96-485a-bf7b-16a074512254 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.325943 Aug 27 20:52:37.604482 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 520/1108] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:37 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:37.609761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41be0bb9-c6da-4ddd-9b82-0d0295cff228", "name": "network-vif-plugged", "status": "completed", "tag": "d1134007-4daa-401f-8925-140cc9922c69"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:37.620739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.621212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.621645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.633388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] Creating event network-vif-plugged:d1134007-4daa-401f-8925-140cc9922c69 for instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 on nch1-master-1 Aug 27 20:52:37.638233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2557763a-fdd9-426f-85c0-2252900370ae req-641f045a-dfe2-434b-ba52-bb8447584d42 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Aug 27 20:52:37.638819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 521/1109] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:37.643818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:37.644579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:37.651033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.651566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.652004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.652698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:37.653152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:37.653584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:37.967627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:37.978918 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f84af005-7ab4-43e5-bdfe-ef03ada20e07 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1503 microversion: 2.1 time: 0.338842 Aug 27 20:52:37.993392 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 522/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:37 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1503 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:37.998433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:38.013743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.013743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.013743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.027988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] Creating event network-changed:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:52:38.034929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-996415b4-02e4-4f7c-8ab9-11cfb9746922 req-79fd432a-0c48-44b9-85c3-f5ff3b6cce40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053737 Aug 27 20:52:38.035910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 523/1111] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:38.042119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:38.043393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:38.050002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.051166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.051166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.052758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.052758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.053112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.101426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:38.102731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:38.103312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:38.103848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:38.104361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:38.120001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.120952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.121616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.122540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.123494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.124209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.144534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for project 96fc49f44f7a4bcca55eae824956691c. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:38.152044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Getting quotas for user 9f6ceb86c4584847aa1ec7631644a264 and project 96fc49f44f7a4bcca55eae824956691c. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:38.169813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:38.179138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:38.181973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:38.187562 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96dc93ec-ba98-4803-a5c6-56d413c3c602 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1275 microversion: 2.1 time: 0.149763 Aug 27 20:52:38.188650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 524/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:38.204791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:38.208686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:38.218125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.219000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.219496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.220390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.221301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.221794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.256427 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f2d3f4c-fd90-4987-849c-a1d336413a4c tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209090 Aug 27 20:52:38.264848 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 589/1113] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:38.271025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0853c96c-e854-4540-8a1e-c1d5d0c0ec15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:38.271790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0853c96c-e854-4540-8a1e-c1d5d0c0ec15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:38.380294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0853c96c-e854-4540-8a1e-c1d5d0c0ec15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:38.388036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0853c96c-e854-4540-8a1e-c1d5d0c0ec15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1217 microversion: 2.1 time: 0.122014 Aug 27 20:52:38.389245 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 590/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:38.395133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:38.396325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:38.403053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.403419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.404452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.405162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.405771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.406690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.592921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:38.602859 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c769dcf-dfd0-4d74-9789-9ec340e81124 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.412550 Aug 27 20:52:38.604250 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 525/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:38.627361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:38.628089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:38.636166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.637019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.637667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.638637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:38.639238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:38.639841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:38.649455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:38.662540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83316c14-9eaf-435d-b5c5-5e06f49c997b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.271854 Aug 27 20:52:38.671122 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 591/1116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:38.880655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:38.888753 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64dfdd1e-1b22-4342-942a-9b06b3799c06 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.265781 Aug 27 20:52:38.889344 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 526/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:39.000835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.001571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.009083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.009687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.010198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.010974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.011464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.011897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.150688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:39.158789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f2fbe545-7edb-4c50-a12f-4e449a7f4b6f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1478 microversion: 2.1 time: 0.162072 Aug 27 20:52:39.159430 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 592/1118] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:38 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.179228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f6148a6-1696-4b31-84a2-6e2afb9643d3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '.version_select at 0x7ff84f90e4c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.183014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f6148a6-1696-4b31-84a2-6e2afb9643d3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.183620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f6148a6-1696-4b31-84a2-6e2afb9643d3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.184119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f6148a6-1696-4b31-84a2-6e2afb9643d3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.194832 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f6148a6-1696-4b31-84a2-6e2afb9643d3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.019021 Aug 27 20:52:39.195641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 527/1119] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.209753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.210740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.211205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.211881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.217685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.218219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.218334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.218657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.218770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.219303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.219438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.219852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.219985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.220357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.220793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.220922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.422515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:39.427615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e762cd0-923b-49e0-a73f-1e1659becf43 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1629 microversion: 2.1 time: 0.220387 Aug 27 20:52:39.428188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 528/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1629 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.430811 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-472e73f5-0276-48ca-b149-50d7ea9429dc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.225197 Aug 27 20:52:39.431598 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 593/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.432782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.433387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.439420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.439954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.440404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.441104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.442037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.442193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.445101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:39.456790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ad7c8f7-db84-4f84-8a06-86d852212818 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: .version_select at 0x7ff84fb89040>, body: {"keypair": {"name": "tempest-keypair-336030746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7gSNR9iwmwPr16WCi3Sl6DXaIuwHD+6mf4198qzZDw8WSWzbNbd+Yez77jYI2zZPD1ck7zw8mcBCB90REadFOV2t3h9X4doLSnDofaQky/aYi8tOi0h0fuKEw6inFWFw=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:39.477266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3ad7c8f7-db84-4f84-8a06-86d852212818 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for project 459a7cdda740490a900289697e84372b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:39.481540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3ad7c8f7-db84-4f84-8a06-86d852212818 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for user 43dd6f015403486491e8140062f43bee and project 459a7cdda740490a900289697e84372b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:39.508713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:39.509865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ad7c8f7-db84-4f84-8a06-86d852212818 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056979 Aug 27 20:52:39.513636 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 594/1122] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:52:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:39.520220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1f6482a-00c5-4d54-98db-c8a7117d012b tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1221 microversion: 2.1 time: 0.090928 Aug 27 20:52:39.520791 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 529/1123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.624615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.625358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.632647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.633142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.633600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.634286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.634743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.635176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.684164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.684826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.692266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.693095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.693704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.694707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.695180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.695650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.903018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:39.911866 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f13ed4d-6726-4cd3-b715-d1f9610ebcf0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.291372 Aug 27 20:52:39.912520 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 595/1124] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:39.917344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:39.917950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:39.924479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.925075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.925528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.926467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:39.927107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:39.927710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:39.944221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:39.960548 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef8b9a6c-f841-4156-80ab-cf35749d31c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.280724 Aug 27 20:52:39.962507 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 530/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:40.079852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:40.091002 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49dff42b-a9a4-4c42-8c10-dfee759a3fed tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1325 microversion: 2.1 time: 0.176665 Aug 27 20:52:40.091873 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 596/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:39 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:40.453094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:40.453748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:40.460986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.461488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.461930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.462649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.463104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.463565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.542050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:40.542879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:40.553509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.554018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.554460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.555173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.555732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.556158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.657978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:40.673381 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca9669c7-c926-4e48-ba44-6170f94d5d15 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1269 microversion: 2.1 time: 0.135677 Aug 27 20:52:40.674544 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 597/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:40 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:40.743303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:40.756561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0fe4acc5-9a27-4e4f-a96c-fe6be5ae2adc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.307304 Aug 27 20:52:40.757627 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 531/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:40 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:40.937161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:40.937859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:40.944435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.944941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.945388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.946105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:40.946564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:40.946998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:40.986517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:40.987177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:41.000399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.000658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.001228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:41.002043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.002494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.002916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:41.184464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:41.188356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:41.192599 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-566f1c09-49d1-4606-8f8e-e2df2ad6e2ed tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.260783 Aug 27 20:52:41.193557 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 598/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:40 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:41.196721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b7193c8-38ca-4991-a746-8c6a569b03bc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.215489 Aug 27 20:52:41.197492 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 532/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:40 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:41.198028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:41.198646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:41.203171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-376161470", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "9b46b331-7562-41ca-bc02-1e78612261fd"}], "security_groups": [{"name": "tempest-securitygroup--1379594098"}], "key_name": "tempest-keypair-336030746", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:41.205204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.205761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.206264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:41.207102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.207697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.208185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:41.407692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] validate_networks() for [('9b46b331-7562-41ca-bc02-1e78612261fd', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:41.851257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:41.866987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:41.870687 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1c7325b-94eb-41c2-982a-55c140aec3e6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.676087 Aug 27 20:52:41.887333 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 599/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:41 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:41.887333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:41.887333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:41.887333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.887911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.887995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:41.889633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:41.890932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:41.890932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.013097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:42.027419 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68fd75e8-95fa-423b-8c3d-144df8bde75a tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1275 microversion: 2.1 time: 0.154289 Aug 27 20:52:42.028281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 600/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:41 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:42.033316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:42.034110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:42.040991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.041895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.042337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.043058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.043546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.044158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.372144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:42.386376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b73bb4c4-2c26-4e74-9a1e-29d96d70eecd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.356820 Aug 27 20:52:42.387438 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 601/1133] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:42 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:42.394032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:42.394946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:42.402267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:42.405311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.406381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.407295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.408347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.409084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.409714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.627875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:52:42.628372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:52:42.628930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:52:42.629799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:52:42.630468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:52:42.649606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.650308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.651068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.652122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.652737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.653401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.687621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:42.692200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for user 43dd6f015403486491e8140062f43bee and project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:42.703147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:42.712386 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84355d50-ba85-4b49-bd00-96496f08f83f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.322750 Aug 27 20:52:42.730316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 602/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:42 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:42.735691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:42.736539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:42.742944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.743691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.744313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.745625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.746244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.746585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:52:42.746983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.751036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:52:42.837572 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5796017a-a997-4725-b5d1-eded7770a291 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.638703 Aug 27 20:52:42.845730 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 533/1135] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:52:42.852577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:42.853758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:42.862171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.863651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.864545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:42.865845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:42.866476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:42.867273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.136912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.147285 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec76c6f2-c8dd-498d-a620-4c037917d11a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.415286 Aug 27 20:52:43.148814 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 603/1136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:42 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:43.154442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-904735c2-d6ba-492d-86ff-cf0cc5db0cd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1443344666", "metadata": {"": ""}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-904735c2-d6ba-492d-86ff-cf0cc5db0cd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action HTTP/1.1 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 107 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:52:43.159571 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1443344666", "metadata": {"": ""}}} Aug 27 20:52:43.161336 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1443344666', 'metadata': {'': ''}}}} Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:43.162242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.163774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:43.165237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:43.166653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-904735c2-d6ba-492d-86ff-cf0cc5db0cd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:43.167725 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-904735c2-d6ba-492d-86ff-cf0cc5db0cd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action" status: 400 len: 170 microversion: 2.1 time: 0.017545 Aug 27 20:52:43.168830 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 604/1137] 10.222.0.40 () {60 vars in 1279 bytes} [Sat Aug 27 20:52:43 2022] POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:52:43.183455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58e04400-f63c-4b33-a82a-aa4c5a8a5aeb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:43.184190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-58e04400-f63c-4b33-a82a-aa4c5a8a5aeb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:43.208977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.222621 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc99e684-06f6-4035-8ec8-848ade14874d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.373382 Aug 27 20:52:43.224026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 534/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:42 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:43.231681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "186c3e48-0b29-41a1-8945-99b5683a77d7", "tag": "d9ea94bf-3c52-4d93-ace7-88166a72448d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:43.260227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.260718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.265348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.281513 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] Creating event network-changed:d9ea94bf-3c52-4d93-ace7-88166a72448d for instance 186c3e48-0b29-41a1-8945-99b5683a77d7 on nch2-master-1 Aug 27 20:52:43.289761 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cb79b742-1d3e-4909-a61a-7c91352e4346 req-844ccffa-eb58-460c-b911-514c9ec7f286 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062651 Aug 27 20:52:43.291166 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 535/1139] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:43.297185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:43.299908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:43.313143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.315130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.315839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.320247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.320477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.321000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.337243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-58e04400-f63c-4b33-a82a-aa4c5a8a5aeb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.340463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=47 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:43.354900 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58e04400-f63c-4b33-a82a-aa4c5a8a5aeb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1233 microversion: 2.1 time: 0.184783 Aug 27 20:52:43.367766 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 605/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:43 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1233 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:43.373250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:43.373858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:43.381813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.382305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.382838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.383637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.384342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.385015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.636327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.645504 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32248865-0994-4f09-83ad-d0cc35199814 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.353024 Aug 27 20:52:43.646155 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 536/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:43 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:43.651882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fc76c4-85dc-43e5-8695-5e0475c8337a", "tag": "2365c611-c3a2-4dcf-9a6b-5165bd800c6f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:43.663097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.663619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.664054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.676607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] Creating event network-changed:2365c611-c3a2-4dcf-9a6b-5165bd800c6f for instance e4fc76c4-85dc-43e5-8695-5e0475c8337a on nch1-master-1 Aug 27 20:52:43.683062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-50cb871e-fe7e-467e-8621-b872de2fd5bb req-1ab2cb8a-516a-4b36-8bfa-3f0cee20ecaa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 Aug 27 20:52:43.684056 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 537/1142] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:43.689188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:43.689899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:43.697562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.698081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.699228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.700017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.700645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.701253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.704792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.715306 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af55003f-1efa-444d-a43a-1a27c45e02c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.345954 Aug 27 20:52:43.731572 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 606/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:43 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:43.737265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:43.738262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:43.745590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.746104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.746547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.747275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:43.749862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:43.750311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:43.966282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:43.978906 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e864621-eec0-4d0a-ac7c-636e4008fcfc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.293539 Aug 27 20:52:43.997273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.012471 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 538/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:43 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.013276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-033d7ed1-4ebd-4021-b3e6-d1abbafea5d0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.274757 Aug 27 20:52:44.013276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 607/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:43 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.031046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-330b14a0-ffdd-466e-853f-890468885a83 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627670277", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-330b14a0-ffdd-466e-853f-890468885a83 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action HTTP/1.1 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 618 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:44.039368 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:44.040726 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:52:44.041344 ncdv-master-1 devstack@n-api.service[140433]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-627670277", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 20:52:44.041344 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:44.041344 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-627670277', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 20:52:44.041572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:44.043003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.044461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 20:52:44.045345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.045876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-330b14a0-ffdd-466e-853f-890468885a83 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:44.045876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-330b14a0-ffdd-466e-853f-890468885a83 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action" status: 400 len: 938 microversion: 2.1 time: 0.014885 Aug 27 20:52:44.045876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 539/1146] 10.222.0.40 () {60 vars in 1279 bytes} [Sat Aug 27 20:52:44 2022] POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action => generated 938 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:52:44.051209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-plugged", "status": "completed", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:44.052778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.053432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.063396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.063543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.063673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.063969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.064087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.064612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.064833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.065295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.065751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.078478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] Creating event network-vif-plugged:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:52:44.085116 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9502ec76-4ec6-4b3b-a048-1fe3779b1279 req-9d1b7aed-9fdb-40e6-9133-ae2425cde314 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037747 Aug 27 20:52:44.085840 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 540/1147] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:44.170136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.171134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.178730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.179735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.180569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.181664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.182513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.183428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.211162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.219976 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f661afc-d56f-47d7-af3a-a31bbe289144 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.173913 Aug 27 20:52:44.220579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 608/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.241645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.242267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.248742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.249241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.249686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.250424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.250876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.251306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.363279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.373145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbf3aa6d-ebaf-4eda-827f-2624a2fde7a9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.207328 Aug 27 20:52:44.373913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 541/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:44.380161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.380787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.387824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.388382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.388864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.389696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.390176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.390638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.415127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.425444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cecc5b67-c1a9-44d5-af67-2c8bc31957f3 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.187936 Aug 27 20:52:44.426502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 609/1150] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.440805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.442202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.448927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.449621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.450064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.450797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.451249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.451702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.522837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.531258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f1b6e1f-fa26-4b07-857d-edbcd88a44b8 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1285 microversion: 2.1 time: 0.094420 Aug 27 20:52:44.531907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 610/1151] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bc9e7b9-9378-4ea3-b337-65678ab26764 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bc9e7b9-9378-4ea3-b337-65678ab26764 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action HTTP/1.1 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 285 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:52:44.543365 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:52:44.545038 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:52:44.545733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:52:44.546419 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:52:44.550216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:52:44.552130 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 20:52:44.552130 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:52:44.552130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bc9e7b9-9378-4ea3-b337-65678ab26764 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:44.552130 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4bc9e7b9-9378-4ea3-b337-65678ab26764 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action" status: 400 len: 619 microversion: 2.1 time: 0.009213 Aug 27 20:52:44.552562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 611/1152] 10.222.0.40 () {60 vars in 1279 bytes} [Sat Aug 27 20:52:44 2022] POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:52:44.552562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.552562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.559196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.559770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.560214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.560953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.561417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.561577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.561850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.570257 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ebfa63a-bae2-45a2-bcae-c95c40ee3086 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.195110 Aug 27 20:52:44.570748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 542/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.667612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.668297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.674877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.675385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.675887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.676652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.677103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.677527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.699718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.708941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41bf3e08-d5c0-4265-897e-d08c5ab2dad6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.161524 Aug 27 20:52:44.709689 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 612/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.730771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:44.731370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.738063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.738559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.739005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.739746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.740205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.740662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.850148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.858999 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afcf3f7a-dfe5-4912-a6b6-f062584b9298 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.195273 Aug 27 20:52:44.859635 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 543/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.898935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:44.907380 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1eca0e4-3830-47d0-ac05-e73c49badbe5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.180527 Aug 27 20:52:44.907950 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 613/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:44 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:44.928154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-430388334"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:44.930659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:44.937442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.937924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.938360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:44.939052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:44.939545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:44.939974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.024192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.024801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.031529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.032004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.032437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.033128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.033579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.034080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.138783 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bcf0fc1c-1fff-4ce7-b061-d00a1d5954f8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action" status: 202 len: 0 microversion: 2.1 time: 0.214661 Aug 27 20:52:45.145008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 544/1157] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:44 2022] POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:52:45.150827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1291330021"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:45.153280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.159933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.160503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.160931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.161616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.162071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.162488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.171962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:45.180262 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb0e1c2c-f828-4c4a-b29a-22689f0489cb tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.160520 Aug 27 20:52:45.180830 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 614/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:45.195611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Cannot 'createImage' instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 while it is in task_state image_snapshot_pending Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action HTTP/1.1 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 85 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:52:45.197296 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1291330021"}} Aug 27 20:52:45.198831 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'createImage' instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 while it is in task_state image_snapshot_pending Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1291330021'}}} Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:45.202738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 while it is in task_state image_snapshot_pending Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 while it is in task_state image_snapshot_pending Aug 27 20:52:45.204132 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:45.205464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 409 to user: Cannot 'createImage' instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 while it is in task_state image_snapshot_pending {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:45.205464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68c59925-28ba-40f7-9f59-018fca048f97 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action" status: 409 len: 167 microversion: 2.1 time: 0.052273 Aug 27 20:52:45.205464 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 545/1159] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:45 2022] POST /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228/action => generated 167 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:52:45.208406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3dc66d1f-8971-4120-a9de-d8c860b92f86 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff84fb89040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.333145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3dc66d1f-8971-4120-a9de-d8c860b92f86 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/images/c7ca1e49-d710-4d89-8b6f-4c4f768e79e0" status: 204 len: 0 microversion: 2.1 time: 0.128500 Aug 27 20:52:45.333819 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 615/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] DELETE /compute/v2.1/images/c7ca1e49-d710-4d89-8b6f-4c4f768e79e0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:52:45.342672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.343292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.349925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.350405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.350841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.351581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.352030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.352451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.395807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.396302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.405258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.405936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.406564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.407814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.408401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.409042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.548335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:45.557553 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f00d49b0-e4d4-47bf-aa88-57ff6643635a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1542 microversion: 2.1 time: 0.219184 Aug 27 20:52:45.558113 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 546/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1542 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:45.563034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.563709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.570271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.570769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.571206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.571960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.572413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.572848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.580245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:45.588933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52fdc9a7-cfd4-4534-8623-bb99150addcb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.197720 Aug 27 20:52:45.589502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 616/1162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:45.594800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.595411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.602084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.602585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.603017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.604231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.604697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.605137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.638624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:45.646905 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3127634f-604e-420f-a6dc-8e5f85244c83 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1285 microversion: 2.1 time: 0.087378 Aug 27 20:52:45.647388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 547/1163] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:45.742985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:45.751215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e0510fb-6082-4bc7-83c0-b7a46b271308 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.159997 Aug 27 20:52:45.751835 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 617/1164] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:45.882076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:45.882795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:45.890556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.891103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.891636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.892413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:45.892926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:45.893412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:45.898374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:46.037653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:46.045958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-84c190d4-76f7-4d17-a276-149c440712fa tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.168931 Aug 27 20:52:46.046561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 548/1165] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:45 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:46.205536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:46.206578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:46.218224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.219048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.219861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.221114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.221926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.222779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.372061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:46.384014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf89da71-d5fc-455e-aacd-ead1b6c8ae5f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.184834 Aug 27 20:52:46.384630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 618/1166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:46 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:46.579879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:46.580507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:46.588212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.588707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.589148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.589862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.590674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.591106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.611069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:46.611759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:46.618502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.619027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.619477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.620180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.620615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.621150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.899027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:46.904207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:46.908023 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4edc077d-7a59-4e6f-af86-e8dce71fc54c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1542 microversion: 2.1 time: 0.333085 Aug 27 20:52:46.908703 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 549/1167] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:46 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:46.913869 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f4674e5-d011-4b96-8cc4-37caa430e2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.306874 Aug 27 20:52:46.914082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:46.914802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:46.925993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.925993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.925993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.925993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.926361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.926610 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 619/1168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:46 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:46.927207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.934088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:46.934754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:46.941294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.941798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.942244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.944044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:46.944531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:46.944960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:46.964705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:46.998440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:47.007194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ddc34c0-8ab2-45bb-bf0c-d4e86b7cecf0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1285 microversion: 2.1 time: 0.097399 Aug 27 20:52:47.007877 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 550/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:46 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:47.067782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:47.068677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:47.075309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.075887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.076385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.077161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.077658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.078090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.105796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:47.114064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28d384e8-3896-49a8-a9d2-77b22d065315 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.186222 Aug 27 20:52:47.114670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 620/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:46 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:47.217672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:47.226314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70567117-d2c5-401b-8460-41da1c3127ed tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.162914 Aug 27 20:52:47.227144 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 551/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:47 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:47.406256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:47.406822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:47.413780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.414269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.414708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.415445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.415899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.416320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.571651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:47.583727 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d1273ab-2cc4-4e38-a123-b1da8c9ba4a0 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.181182 Aug 27 20:52:47.584444 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 621/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:47 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:47.932528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:47.933267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:47.936624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:47.937464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:47.942957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.943664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.944124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.944842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.945299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.945816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.949117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.949811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.950355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:47.952228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:47.952980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:47.953555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.133721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:48.466977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:48.470117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:48.475945 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-549b0893-bc0e-4a85-9978-5994f30434b9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1534 microversion: 2.1 time: 0.549366 Aug 27 20:52:48.476676 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 552/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:47 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1534 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:48.479041 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e3cbbd54-3bdf-4959-9a7a-c1a473fd4d89 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.547167 Aug 27 20:52:48.479691 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 622/1174] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:47 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:48.482308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:48.483197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:48.485324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:48.485944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:48.490620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.491425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.492101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.492950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.493514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.493765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.494077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.494221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.494694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.495490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.495994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.496437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.579124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:48.601090 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e37d5f98-5b34-492a-b1ed-4d07b8df8e47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1285 microversion: 2.1 time: 0.123214 Aug 27 20:52:48.613105 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 553/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:48 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:48.618852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:48.619713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:48.636217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.639380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.639380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.639380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.639380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.639784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.689707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:48.700353 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0fc5e1c-b27d-48ff-8745-950f2370759c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1317 microversion: 2.1 time: 0.218490 Aug 27 20:52:48.701713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 623/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:48 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:48.707417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:48.708339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:48.715944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.716708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.717297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.718337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:48.721722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:48.721722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:48.991146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:49.001080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58e714df-ea77-4844-abfb-2dffca952bf1 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.386484 Aug 27 20:52:49.001677 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 554/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:48 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:49.014889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:49.023612 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b352079-1d89-4593-9812-df07b302592d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.320485 Aug 27 20:52:49.024424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 624/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:48 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:49.500573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:49.501199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:49.503399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:49.504024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:49.509236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.509745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.510185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.510936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.511411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.511857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.512583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.513144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.513641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.514509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.514916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.515485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.740427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:49.748924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:49.769896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9506afdc-59e9-44f0-9bd1-a3a59e623065 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1477 microversion: 2.1 time: 0.271798 Aug 27 20:52:49.770650 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80b58683-e7f3-4ca1-9ea5-d42757b45009 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1534 microversion: 2.1 time: 0.274751 Aug 27 20:52:49.771404 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 625/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:49 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1477 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:49.776644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:49.777475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:49.785397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.785891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.786324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.787037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.788287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.788880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.792936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 555/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:49 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1534 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:49.798098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fc76c4-85dc-43e5-8695-5e0475c8337a", "name": "network-vif-plugged", "status": "completed", "tag": "2365c611-c3a2-4dcf-9a6b-5165bd800c6f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:49.830326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.830960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.831829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.860223 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] Creating event network-vif-plugged:2365c611-c3a2-4dcf-9a6b-5165bd800c6f for instance e4fc76c4-85dc-43e5-8695-5e0475c8337a on nch1-master-1 Aug 27 20:52:49.871839 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-46f0b018-6762-4209-9aa8-ad06e2c55911 req-85b98996-452a-41bb-a11d-23ac3a7bbc1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075936 Aug 27 20:52:49.872042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:49.872749 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 556/1181] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:49.887267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4d27d919-bbe3-40aa-b353-a6d4404a22e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1285 microversion: 2.1 time: 0.114409 Aug 27 20:52:49.888521 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 626/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:49 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:49.894808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:49.895628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:49.903125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.903748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.904222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:49.904977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:49.905485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:49.905955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.024989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:50.025877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:50.038783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.039295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.039983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.040875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.041348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.041788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.084434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:50.094284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5aa54d0e-326a-42ba-830b-ef72e989aa9f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1467 microversion: 2.1 time: 0.215635 Aug 27 20:52:50.095545 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 557/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:49 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1467 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:50.107257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:50.111712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:50.125352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.126328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.134324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.135641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.136352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.137053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.385436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:50.396506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b78625f3-402b-44c5-b33e-9756699e3365 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.376288 Aug 27 20:52:50.397540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 627/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:50 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:50.403326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1671597254", "metadata": {"image_type": "test"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:50.405769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:50.417234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.417776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.418765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.419995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.420587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.421034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.444278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:50.458125 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-516ee5ec-4d3b-4c92-af83-7cd08e174160 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.358804 Aug 27 20:52:50.460882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 558/1185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:50 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:50.483471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Getting quotas for project bdaa7c7ca577460886d51a42e581c3ac. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:52:50.489628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Getting quotas for user 8755382f70e248039545e8882d4fd015 and project bdaa7c7ca577460886d51a42e581c3ac. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:52:50.692846 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec193e71-3955-4218-a5ac-f03e7cc2e92a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "POST /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68/action" status: 202 len: 0 microversion: 2.1 time: 0.293905 Aug 27 20:52:50.693643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 628/1186] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:50 2022] POST /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:52:50.705500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7544a8b5-a54b-4e24-9af8-4e4a2fe54a8c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f041790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:50.757062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7544a8b5-a54b-4e24-9af8-4e4a2fe54a8c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.056014 Aug 27 20:52:50.758668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 559/1187] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:50 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:50.796406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:50.797172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:50.797377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:50.798088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:50.806531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.807040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.807442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.807559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.808101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.808270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.808658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.808772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.809148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:50.810648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:50.811411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:50.811927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.135629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:51.145019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:51.157876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d09077e-0a0a-4023-8765-abbeed4ad963 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1476 microversion: 2.1 time: 0.368438 Aug 27 20:52:51.159258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 629/1188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:50 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:51.163949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fee9e39e-e70c-433e-918e-b225ae588855 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1534 microversion: 2.1 time: 0.370924 Aug 27 20:52:51.168887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 560/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:50 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1534 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:51.171446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "name": "network-vif-unplugged", "status": "completed", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:51.180144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:51.184677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:51.192998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.193610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.194515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.203276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.203942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.204514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.205401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.205920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.206447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.221152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Creating event network-vif-unplugged:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch2-master-1 Aug 27 20:52:51.236924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:52:51.262461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b7c62cee-3c51-4001-a969-a2a3638fa007 req-eeb19718-c0f9-4e5f-8efa-78cb7b5796eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101637 Aug 27 20:52:51.264780 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 630/1190] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:51.313562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:51.325571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-979acdb8-8d43-42e6-b7b4-dfe3ffe05282 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1291 microversion: 2.1 time: 0.155256 Aug 27 20:52:51.326666 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 561/1191] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:51 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1291 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:51.419189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:51.419839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:51.426698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.427187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.427648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.428375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.428860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.429279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.487978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:51.488603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:51.495252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.495778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.496214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.496912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.497355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.498109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.695640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:51.706271 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d629d654-9732-44cb-823a-8aab281c5d6d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1317 microversion: 2.1 time: 0.291978 Aug 27 20:52:51.706922 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 631/1192] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:51 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:51.748005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:51.756649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62e3c338-54ab-41b9-af0e-cf1eda9d54ea tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.272966 Aug 27 20:52:51.766056 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 562/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:51 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:51.774938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52eadabe-6f00-4a3c-91ef-1f7d7faadc7e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f8caf70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:51.844106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52eadabe-6f00-4a3c-91ef-1f7d7faadc7e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.074569 Aug 27 20:52:51.852568 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 632/1194] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:51 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:51.893041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186c3e48-0b29-41a1-8945-99b5683a77d7", "name": "network-vif-plugged", "status": "completed", "tag": "d9ea94bf-3c52-4d93-ace7-88166a72448d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:51.904391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:51.904868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:51.905322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:51.920283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] Creating event network-vif-plugged:d9ea94bf-3c52-4d93-ace7-88166a72448d for instance 186c3e48-0b29-41a1-8945-99b5683a77d7 on nch2-master-1 Aug 27 20:52:51.928009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-dfd955da-8c93-49ad-9cf8-894ba5156fb8 req-f6c8a637-5294-43ec-9c50-48ec3cbd0fb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039413 Aug 27 20:52:51.928709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 563/1195] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:52.182330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.183208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:52.192806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.194205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.194833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.195597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.196502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.197430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.198215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.202583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:52.207443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:52.220075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.222019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.224017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.225061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.227634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.228155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.435170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:52.440922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:52.445160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c39b661a-a047-45d5-9778-08212ce193c0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1474 microversion: 2.1 time: 0.267119 Aug 27 20:52:52.447983 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 633/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:52.450912 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df53203f-5838-465a-9b31-09ac4c71c515 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.266136 Aug 27 20:52:52.451873 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 564/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:52.452612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.453289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:52.460652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.461429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.462095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.462999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.463654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.464394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.611657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:52.619968 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-240d44a5-4ea3-45b6-8e61-b8424e89d043 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.172677 Aug 27 20:52:52.620635 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 634/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:52.665153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:52.670388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:52.676504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.676982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.677416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.688961 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] Creating event network-changed:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch1-master-1 Aug 27 20:52:52.693834 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-200431d8-bc71-4b44-b799-9ff2b593ada2 req-9ccab6cb-50f7-46b7-9f16-74dd3dd0abfd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032768 Aug 27 20:52:52.694578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 565/1199] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:52.728940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.729554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:52.736271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.736766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.737206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.737909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.738581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.739304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.774931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:52.779153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.779936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:52.786547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.787046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.787529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.788360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:52.788820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:52.789252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:52.934710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:52.943584 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05f8f84e-744d-4d25-8c67-6e4126f117de tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1506 microversion: 2.1 time: 0.219052 Aug 27 20:52:52.944114 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 635/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:52.949012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83b4d09e-aff7-40bd-a9f3-57aaba8af837 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84fb899d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:52.966605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:52.984337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e4d6b40-df55-4f7b-a3ca-77b261d59ebd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.209741 Aug 27 20:52:52.997702 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83b4d09e-aff7-40bd-a9f3-57aaba8af837 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.052133 Aug 27 20:52:52.998204 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 566/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:52.998751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 636/1202] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:52 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:53.281866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:53.292475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.293311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.293809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.311291 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Creating event network-changed:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch2-master-1 Aug 27 20:52:53.321099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:52:53.333094 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-43f1de1c-d741-430e-bb70-cf0346d3ba80 req-7772551e-b3cb-47c1-8b5a-459fc0edbaf8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055151 Aug 27 20:52:53.334753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 567/1203] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:53.470787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:53.474647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:53.475582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:53.475893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:53.476341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:53.482739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.483418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.483952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.484403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.484901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.485258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.485382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.485899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.486306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.486792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.487043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.487656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.492429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:53.514827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:53.711929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:53.717509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:53.724678 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8d8300b-85fd-4eff-a92f-28f39695f948 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.253496 Aug 27 20:52:53.725936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 568/1204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:53 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:53.726816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc53be11-ea50-49ad-bde7-0df742e8d38c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1474 microversion: 2.1 time: 0.257070 Aug 27 20:52:53.727875 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 637/1205] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:53 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:53.743242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:53.743903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:53.751461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.752219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.752659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.753370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:53.753826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:53.754255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:53.903693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:53.914248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-840afb02-c34b-4f3d-ae58-2fcc4610b9ee tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.186875 Aug 27 20:52:53.915051 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 569/1206] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:53 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:54.004957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:54.005515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:54.012640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.012820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e956cef8-9933-41df-9073-dec34b98f23f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f079ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:54.013134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.013574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.014275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.014730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.015161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.060592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e956cef8-9933-41df-9073-dec34b98f23f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.051730 Aug 27 20:52:54.061337 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 570/1207] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:54 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:54.149833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:54.158585 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02eb83d6-8d82-44c8-88e5-926ddbe07a54 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.157665 Aug 27 20:52:54.159424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 638/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:53 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:54.344615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4790dce8-465e-48ef-bd27-8cc752e42d75"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:54.347061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:54.354299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.354791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.355231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.355966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.356420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.356849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.406525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] HTTP exception thrown: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Request method failure captured: Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a/os-volume_attachments/a5a93785-5d78-4c3c-9212-7c0e99cd3e5b HTTP/1.1 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 74 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOaTyES5TIs4xVZU6PQCEqXVR9SYGshFVrxNiGbTHGxtNKT3OC_mp3w17xtC-7QM4Hv1Us0MwG91kBqb6Zu5IqAg0x6iucJpqOqL9l9bUyYqDw9nGShYud7smTOa1ZqHdsQcsjxejijf9dbCCDPnp_396WaoeF4sPVtL2lsldxPjPA Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7c837ff8c21c4634a5a57b2621441ab6 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:52:54.408791 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c837ff8c21c4634a5a57b2621441ab6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7c837ff8c21c4634a5a57b2621441ab6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7c837ff8c21c4634a5a57b2621441ab6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7c837ff8c21c4634a5a57b2621441ab6"}]}] Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7c837ff8c21c4634a5a57b2621441ab6 Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-816706168 Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesAdminNegativeTest-816706168-project-admin Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 171b7df182b64bcfa5196154cc74a356 Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesAdminNegativeTest-816706168-project-admin Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: {"volumeAttachment": {"volumeId": "4790dce8-465e-48ef-bd27-8cc752e42d75"}} Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:52:54.410393 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': 'e4fc76c4-85dc-43e5-8695-5e0475c8337a', 'id': 'a5a93785-5d78-4c3c-9212-7c0e99cd3e5b', 'body': {'volumeAttachment': {'volumeId': '4790dce8-465e-48ef-bd27-8cc752e42d75'}}} Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 20:52:54.411593 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. (HTTP 404) (Request-ID: req-41e8693b-ed1f-4860-a638-ff41a91974f3) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 20:52:54.412822 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:52:54.414145 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. Aug 27 20:52:54.416389 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:52:54.417975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] Returning 404 to user: Volume a5a93785-5d78-4c3c-9212-7c0e99cd3e5b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:52:54.417975 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68fd9af7-c90c-4efd-9e15-4cce2b6f9b78 tempest-VolumesAdminNegativeTest-816706168 tempest-VolumesAdminNegativeTest-816706168-project-admin] 10.222.0.40 "PUT /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a/os-volume_attachments/a5a93785-5d78-4c3c-9212-7c0e99cd3e5b" status: 404 len: 109 microversion: 2.1 time: 0.071225 Aug 27 20:52:54.417975 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 571/1209] 10.222.0.40 () {60 vars in 1433 bytes} [Sat Aug 27 20:52:54 2022] PUT /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a/os-volume_attachments/a5a93785-5d78-4c3c-9212-7c0e99cd3e5b => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:52:54.750202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:54.752569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:54.753199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:54.758163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:54.766497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.767018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.767475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.768248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.768685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.769190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.776291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.777025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.777764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.778495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:54.778945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:54.779396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:54.985414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:54.992502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:55.003949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3dfbda5-fb98-4b43-9b52-bc612e6686a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1474 microversion: 2.1 time: 0.257740 Aug 27 20:52:55.004668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 572/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:54 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:55.010209 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18fedc03-9cf6-4ca3-bc7b-f3e1fa400250 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.267808 Aug 27 20:52:55.011023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 639/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:54 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:55.013459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:55.014152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:55.020688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.021258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.021791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.022557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.023224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.023768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.076836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1ab55898-4d3c-463f-8745-7b25711549d2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84fcd2550>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:55.139471 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1ab55898-4d3c-463f-8745-7b25711549d2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.066582 Aug 27 20:52:55.140057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 640/1212] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:55 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:55.174138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:55.180548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:55.181498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:55.182750 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3f9f889-a104-4c3c-8a90-7a02718da204 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.177077 Aug 27 20:52:55.183316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 573/1213] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:55 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:55.187908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.188403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.188844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.189553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.190040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.190465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.327113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:55.335182 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9795ae46-d12b-4d21-ba22-e0f6c71d87d1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.158737 Aug 27 20:52:55.335785 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 641/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:55 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:55.574250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:55.574730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:55.581887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.582375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.582815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.583558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.584013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.584446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.611916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:52:55.694140 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9f46d01-4450-4ddc-8e46-cd5b3289991f tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 204 len: 0 microversion: 2.1 time: 0.123818 Aug 27 20:52:55.694725 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 574/1215] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:52:55 2022] DELETE /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:52:55.703526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:55.704234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:55.711037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.711823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.712402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.713197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.713740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.714248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.762923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41be0bb9-c6da-4ddd-9b82-0d0295cff228", "name": "network-vif-plugged", "status": "completed", "tag": "d1134007-4daa-401f-8925-140cc9922c69"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:55.774961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:55.775775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:55.776198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:55.788189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] Creating event network-vif-plugged:d1134007-4daa-401f-8925-140cc9922c69 for instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 on nch1-master-1 Aug 27 20:52:55.793366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fc0d7548-d28f-4eae-b9c6-a95d5cc5ae23 req-17f034f4-6592-4072-810e-c03378542b86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035480 Aug 27 20:52:55.793959 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 575/1216] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:55.853154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:55.861154 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb8d3937-2ca0-4d8e-a150-ee3ba08af6fb tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1512 microversion: 2.1 time: 0.161615 Aug 27 20:52:55.861736 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 642/1217] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:55 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:56.028439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.029136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:56.032272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.032921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:56.036974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.037428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.037929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.038590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.039045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.039620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.042733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.043804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.044510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.045921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.046649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.047299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.235963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:56.239940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:56.244807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eabcd3f8-0221-4c58-814f-e978bda8310b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1474 microversion: 2.1 time: 0.221866 Aug 27 20:52:56.245590 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 576/1218] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:56.248470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-076bdc67-15f9-4872-9594-ed69c0aa56ae tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.220651 Aug 27 20:52:56.249405 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 643/1219] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:56.251414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7cf9982-4d15-4246-ab0b-ea1c780cec4e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f16a700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.254621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.255229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:56.263421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.263889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.264352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.265068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.265516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.265935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.315906 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7cf9982-4d15-4246-ab0b-ea1c780cec4e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.068156 Aug 27 20:52:56.317036 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 577/1220] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:56.359535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.360561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:56.368945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.369562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.370094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.370886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.371452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.379446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.427999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:56.440248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54b47d8a-7349-4d9f-aa7c-2718029529c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.189749 Aug 27 20:52:56.441286 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 644/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:56.541877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:56.550686 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f65608f2-1a10-4638-b4e7-063e9ac23b2b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.197394 Aug 27 20:52:56.555986 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 578/1222] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:56.882808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:56.883450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:56.890617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.891125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.891589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:56.892267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:56.892716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:56.893137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.031663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:57.039739 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dcd13523-ce2c-403d-b583-b90c534d1401 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1512 microversion: 2.1 time: 0.161045 Aug 27 20:52:57.040304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 645/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:56 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:57.280950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:57.285112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:57.285577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:57.286915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:57.296636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.297138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.297656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.298114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.298370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.298796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.299014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.299219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.299573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.300388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.300951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.301474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.610793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:57.617747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:57.623879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1463a4a-e415-4747-8928-d873eefa1e44 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1471 microversion: 2.1 time: 0.356268 Aug 27 20:52:57.635457 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 579/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:57 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:57.635457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-452afa0c-30d2-4059-9eed-4235d259f909 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f041f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:57.639222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a85ddde-3fc2-4994-8a6f-79c7858e1bd8 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.368282 Aug 27 20:52:57.642998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 646/1225] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:57 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:57.652627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:57.653255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:57.661746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.662310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.662759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.663756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.664298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.665305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.681518 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-452afa0c-30d2-4059-9eed-4235d259f909 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.055316 Aug 27 20:52:57.682204 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 580/1226] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:57 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:57.687263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:57.687984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:57.699837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.701147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.701593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:57.702307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:57.702765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:57.703196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.190868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:58.199584 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb0227a4-ef6b-48cd-a07e-14c2fed7b2e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.555097 Aug 27 20:52:58.200248 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 647/1227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:57 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:58.205189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:58.205729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:58.211940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.212503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.212942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.213645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.214097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.214629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.223554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:58.231833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36c3ceee-e497-4108-a6e5-3039817d7227 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1317 microversion: 2.1 time: 0.548517 Aug 27 20:52:58.236892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 581/1228] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:57 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:58.236892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-plugged", "status": "completed", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:58.246994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.247527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.247987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.259470 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] Creating event network-vif-plugged:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:52:58.264960 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-78bfa134-9d41-4664-8fed-975456005f10 req-758b6476-0a28-47c4-a29a-b570d3701f95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Aug 27 20:52:58.265599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 582/1229] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:52:58.272415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:58.272599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:58.285000 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1755286e-ce52-46ea-8ce2-7f76dbba0f0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2/action" status: 204 len: 0 microversion: 2.1 time: 0.082232 Aug 27 20:52:58.285810 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 648/1230] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:52:58 2022] POST /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:52:58.285934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.286396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.286723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.287443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.287895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.288321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.296047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:58.296047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:58.302531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.303033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.303517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.304948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.305071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.305490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.592946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:58.597761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:58.601445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3ec2e31-fca7-4453-9c36-8c3002cc9773 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1471 microversion: 2.1 time: 0.311063 Aug 27 20:52:58.602542 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 649/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:58 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:58.605742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-98b481de-0053-49cf-8d7b-bc66c878ddd9 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1512 microversion: 2.1 time: 0.338970 Aug 27 20:52:58.606461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 583/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:58 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:58.663056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:58.663900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:58.670804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.671304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.671774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.672485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:58.672941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:58.673392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:58.697492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9122b41a-2d00-4cf6-9ded-c21ca2e384be tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f01ac10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:58.745661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9122b41a-2d00-4cf6-9ded-c21ca2e384be tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.051529 Aug 27 20:52:58.752490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 584/1233] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:58 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:52:58.812730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:58.820700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9d68ca1-e3a3-4370-9507-1a39e0180cb7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.162204 Aug 27 20:52:58.821414 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 650/1234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:58 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.222058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.222782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.229385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.229863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.230309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.230997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.231467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.231888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.256551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.258150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.266719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.267809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.268619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.270155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.271130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.272920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.419243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:59.428171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99fc4adf-4ae4-4bca-a6ab-b009a8fa43c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.209989 Aug 27 20:52:59.439378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 585/1235] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.460153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:59.468872 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a187b42e-2902-4a74-b000-386de6da26a7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1466 microversion: 2.1 time: 0.219721 Aug 27 20:52:59.476288 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 651/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1466 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.490143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.490758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.497190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.497672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.498098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.498786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.499231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.499747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.622218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.622831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.628812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a83ef8c0-01e3-4e82-bd32-cb37e387ec8a tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1617 microversion: 2.1 time: 0.142332 Aug 27 20:52:59.629028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.629405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 586/1237] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1617 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.634289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.634289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.634289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.634289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.634693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.634802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.634904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.641212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.641704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.642161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.642855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.645302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.645302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.855196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:59.860435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:52:59.863934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d9ddc74-d47f-406b-acea-a8ffe1dafd16 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1512 microversion: 2.1 time: 0.233439 Aug 27 20:52:59.864529 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 587/1238] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.869983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1478234897", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:52:59.874628 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4b43214-ddcc-4e88-a2bf-cbe57d66b0f6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1471 microversion: 2.1 time: 0.256269 Aug 27 20:52:59.888298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 652/1239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.888298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32b3a160-bea7-4267-b04e-b6d92ba3e502 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f1f20d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.935809 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32b3a160-bea7-4267-b04e-b6d92ba3e502 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.054268 Aug 27 20:52:59.936022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:52:59.936783 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 653/1240] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:52:59.941726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:52:59.942451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:52:59.948266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:59.949924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.950528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.951069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:52:59.952203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:52:59.952485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:52:59.953018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.191494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:00.200889 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77754408-8e6c-42e2-879c-39bd9abae153 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.263003 Aug 27 20:53:00.201798 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 654/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:52:59 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:00.264603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:53:00.265133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:53:00.265701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:53:00.266196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:53:00.266666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:53:00.276998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.277565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.278044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.278801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.279249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.279696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.280366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "name": "network-vif-plugged", "status": "completed", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:00.292646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.293112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.293720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.298199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:00.299763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:53:00.305108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Getting quotas for user c56017fc97f54ff9b54288f627036a4b and project 64e8b6b7c1f14208baf2d0a9763e51ff. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:53:00.308062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Creating event network-vif-plugged:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch2-master-1 Aug 27 20:53:00.315314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:53:00.317392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:53:00.320131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:53:00.328151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6d01d377-3c9b-4025-9316-808eab356d07 req-8013731f-18bc-48e4-aad4-d75495b7e1fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051350 Aug 27 20:53:00.328781 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 655/1242] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:00.371304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ce67ada-fbcc-4db8-ac1c-ef4c355560d5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505665 Aug 27 20:53:00.371980 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 588/1243] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:52:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:53:00.384940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed82dc1e-6e3a-4831-bc65-659ab8ba6981 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:00.385654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed82dc1e-6e3a-4831-bc65-659ab8ba6981 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:00.451129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:00.451842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:00.455217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed82dc1e-6e3a-4831-bc65-659ab8ba6981 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:00.458605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.459222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.459828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.460582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.461367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.461782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.466308 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed82dc1e-6e3a-4831-bc65-659ab8ba6981 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1217 microversion: 2.1 time: 0.086792 Aug 27 20:53:00.467262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 656/1244] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:00 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:00.491723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:00.615787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:00.624257 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b02a584c-2d0d-428c-85d8-7b169f34c7a9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.178257 Aug 27 20:53:00.624882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 589/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:00 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:00.888294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:00.889372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:00.896528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:00.897472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:00.923390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.923923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.924361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.925059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.925689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.926389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.928444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.929104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.930596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:00.932202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:00.933363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:00.935869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.188191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:01.196255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd1d35b5-3ab1-4045-85d9-8bd3d1c949cb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1471 microversion: 2.1 time: 0.304549 Aug 27 20:53:01.210297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:01.211017 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 590/1246] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:00 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:01.217598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e425084-d5c9-4a8c-814f-28c589a3f3ed tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f041160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:01.221619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4d339f47-08f2-4bad-950d-af89fc037385 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1512 microversion: 2.1 time: 0.339544 Aug 27 20:53:01.222268 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 657/1247] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:00 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:01.243558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:01.244282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:01.257347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.264270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.264844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.265854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.266560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.267232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.301771 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e425084-d5c9-4a8c-814f-28c589a3f3ed tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.089317 Aug 27 20:53:01.312826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 591/1248] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:01 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:01.375542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fc76c4-85dc-43e5-8695-5e0475c8337a", "name": "network-vif-deleted", "tag": "2365c611-c3a2-4dcf-9a6b-5165bd800c6f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:01.386805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.387722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.388431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.402864 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] Creating event network-vif-deleted:2365c611-c3a2-4dcf-9a6b-5165bd800c6f for instance e4fc76c4-85dc-43e5-8695-5e0475c8337a on nch1-master-1 Aug 27 20:53:01.408776 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-48c4ec19-9a0f-4822-a46e-54b2b6832ee5 req-2a7c2519-5fdc-44f5-847c-ea29ef1078fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037020 Aug 27 20:53:01.409887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 592/1249] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:53:01.493616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:01.496937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:01.498373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:01.507405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.509622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.510070 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d3d0cce5-cbd8-49dd-b916-ddc619254032 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1540 microversion: 2.1 time: 0.284936 Aug 27 20:53:01.511224 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 658/1250] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:01 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1540 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:01.512166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.513332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.513807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.514350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.589220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:01.598684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9702eb60-7494-4b75-b321-c2176865a254 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1269 microversion: 2.1 time: 0.114841 Aug 27 20:53:01.599295 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 593/1251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:01 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1269 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:01.646343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:01.646973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:01.653525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.654023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.654462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.655166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:01.655650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:01.656081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:01.797946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:01.811411 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7b12325-94ab-42f8-a3bc-3e2ebc91aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.169099 Aug 27 20:53:01.811996 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 659/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:01 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:02.222509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.224209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.235408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.236190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.236862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.240160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.240160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.240551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.246860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.247528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.254219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.254716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.255159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.255899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.256356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.256787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.290970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.291511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.291948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.292418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'fault' on Instance uuid e4fc76c4-85dc-43e5-8695-5e0475c8337a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:02.344757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:02.353057 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb34eac6-aebc-4fd0-bb93-e70ec0ba5f87 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1307 microversion: 2.1 time: 0.111180 Aug 27 20:53:02.353626 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 660/1253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:02.358244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82e4c419-79ce-4d8f-ae75-f60e4185475c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84fb9e670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.405941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82e4c419-79ce-4d8f-ae75-f60e4185475c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.051000 Aug 27 20:53:02.406408 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 661/1254] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:02.408369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:02.410844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "name": "network-vif-plugged", "status": "completed", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:02.416802 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-242d92ef-0cf4-4298-8bce-1c9a8d190d10 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1471 microversion: 2.1 time: 0.200559 Aug 27 20:53:02.417380 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 594/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:02.422137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.422630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.423068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.433929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] Creating event network-vif-plugged:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch1-master-1 Aug 27 20:53:02.438977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d8594c03-86c0-4819-97f1-9bdbe82bcb53 req-872128bb-3406-4ae2-a0fa-5a96e0f574f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Aug 27 20:53:02.439615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 662/1256] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:02.532116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.532841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.539259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.540415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.540925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.541697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.542198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.542589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.622543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.623393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.631784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.632218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.632654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.634341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.634985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.635604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.723624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:02.733472 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb5e6b2a-df12-4515-980c-dfec3d211177 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1277 microversion: 2.1 time: 0.116537 Aug 27 20:53:02.734546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 663/1257] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:02.737268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:02.763272 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7ec0f60-b30e-4b3a-a8dd-036e57286ee6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1522 microversion: 2.1 time: 0.235095 Aug 27 20:53:02.765750 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 595/1258] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:02.786768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.787272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.793682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.794179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.794617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.795414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.795891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.796328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.834047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:02.834759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:02.839478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:02.846060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.846849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.849111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.849998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:02.851792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:02.852414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:02.992880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-527ae848-6cbc-48dd-947a-fbfdf6a8b1ec tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 204 len: 0 microversion: 2.1 time: 0.209723 Aug 27 20:53:02.993591 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 664/1259] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:02 2022] DELETE /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:03.006190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.006926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:03.014104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.014645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.015139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.015991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.016455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.016886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.071814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:03.080028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f38f19f-7293-4e0c-982c-c0bc58718a06 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.250681 Aug 27 20:53:03.080697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 596/1260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:03.156796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:03.165377 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef70b353-4962-4cee-ab25-a6a3299d0878 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1528 microversion: 2.1 time: 0.164838 Aug 27 20:53:03.165930 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 665/1261] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:02 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1528 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:03.377678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.378609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:03.387883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.388370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.388793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.390205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.390661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.391259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.421005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9bd2fa5-c72c-4f68-ae8e-de22a9ef0124 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeec5e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.426375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.426914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.427476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.427888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'fault' on Instance uuid e4fc76c4-85dc-43e5-8695-5e0475c8337a {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:03.477089 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9bd2fa5-c72c-4f68-ae8e-de22a9ef0124 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.059783 Aug 27 20:53:03.477679 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 666/1262] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:03.478264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:03.483038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.483914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:03.486847 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f460991-ca9c-4396-82f2-d1db0a046181 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1307 microversion: 2.1 time: 0.115247 Aug 27 20:53:03.487438 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 597/1263] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:03.498361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.498917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.499408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.500118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.500571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.501015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.639649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:03.647628 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d7433879-b61a-479e-add6-1dd95188ded0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1463 microversion: 2.1 time: 0.168685 Aug 27 20:53:03.648208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 667/1264] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:03.668760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.669396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:03.675595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.676080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.676511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.677195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.677644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.678059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.755999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.756622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:03.768542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.769092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.769899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.770886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.771599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.772038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.826082 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b3ec3f9-63eb-4b5e-ba3b-d1e2bf6c9480 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1614 microversion: 2.1 time: 0.160645 Aug 27 20:53:03.826303 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 598/1265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:03.855845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-818a7fb6-1996-4326-958f-9751c970fc09 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '.version_select at 0x7ff84f01ae50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:03.860190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818a7fb6-1996-4326-958f-9751c970fc09 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:03.860682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818a7fb6-1996-4326-958f-9751c970fc09 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:03.861127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818a7fb6-1996-4326-958f-9751c970fc09 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:03.880213 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-818a7fb6-1996-4326-958f-9751c970fc09 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.028467 Aug 27 20:53:03.880843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:03.893743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 599/1266] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:03.903668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae6f655c-7d0e-46c3-bd13-6766d2f330f6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1275 microversion: 2.1 time: 0.151290 Aug 27 20:53:03.904558 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 668/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:03 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:04.014969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1869021613", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:04.070043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:53:04.102345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.102884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:04.110519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.111079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.114679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.115726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.116472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.117091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.381015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:04.389620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-053fd2a6-055c-4e6d-993e-19303e6c5cbf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.291230 Aug 27 20:53:04.399553 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 669/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:04.404850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.405689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:04.420336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.421164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.421908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.428410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.429124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.429820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.466055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:53:04.466479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:53:04.466955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:53:04.467818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:53:04.468254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:53:04.514274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.516803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.521230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.522438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.525446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.527322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.583174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:53:04.612655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:53:04.642737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:53:04.646658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:53:04.676510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:04.695856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2955eee9-134d-400e-9a36-ed66acec2276 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1528 microversion: 2.1 time: 0.293755 Aug 27 20:53:04.696735 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 670/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:04.703142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8ab3f5a-5973-4c34-9149-254af4ef47ea tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee8c9d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.749433 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f9a75672-5eaf-4ae2-9253-c31b8482a0a3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738643 Aug 27 20:53:04.757100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 600/1270] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:53:04.765663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b8ab3f5a-5973-4c34-9149-254af4ef47ea tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.067446 Aug 27 20:53:04.766260 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 671/1271] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:04.777120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.777742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:04.784619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.785086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.785523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.786221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.786664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.787093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.788441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7a0011c-e562-4aa4-8ae6-96eaafb9206f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.789298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7a0011c-e562-4aa4-8ae6-96eaafb9206f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:04.849229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:04.856652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.857155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.857560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.858119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'fault' on Instance uuid e4fc76c4-85dc-43e5-8695-5e0475c8337a {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:04.894664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e7a0011c-e562-4aa4-8ae6-96eaafb9206f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:04.916620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7a0011c-e562-4aa4-8ae6-96eaafb9206f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1213 microversion: 2.1 time: 0.133148 Aug 27 20:53:04.917395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 672/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:04.926454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:04.927438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:04.935431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.936487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.937259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.938144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:04.938948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:04.939999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:04.951642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:04.960520 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b737da4-0660-4b12-be36-9b00cea02ab7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1307 microversion: 2.1 time: 0.204368 Aug 27 20:53:04.961422 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 601/1273] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:05.146804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:05.157102 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-824283da-ab7b-45f6-933d-e80e2c17644d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.235837 Aug 27 20:53:05.160231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 673/1274] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:04 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:05.351592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41be0bb9-c6da-4ddd-9b82-0d0295cff228", "name": "network-vif-unplugged", "status": "completed", "tag": "d1134007-4daa-401f-8925-140cc9922c69"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:05.369820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.370853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.371303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.394837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] Creating event network-vif-unplugged:d1134007-4daa-401f-8925-140cc9922c69 for instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 on nch1-master-1 Aug 27 20:53:05.401659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8832243b-c9ef-43d0-b579-16eed2f2b2e8 req-2fe04198-97a5-44e0-820d-f42a4f537688 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053947 Aug 27 20:53:05.403388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 602/1275] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:53:05.421209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:05.422126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:05.436018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.436834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.437506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.438533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.439217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.439987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.692977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:05.705413 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0c8326a8-b649-4779-9a9f-2a2933405e45 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1359 microversion: 2.1 time: 0.288651 Aug 27 20:53:05.730235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:05.731302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:05.734851 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 674/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:05 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1359 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:05.738580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.739159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.739692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.740633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.741282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.741905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.781461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc2cb290-e02e-434f-9079-fa7f9c456edd tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f055700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:05.840527 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc2cb290-e02e-434f-9079-fa7f9c456edd tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.062974 Aug 27 20:53:05.841299 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 675/1277] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:05 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:05.927384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:05.939639 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-794e4c95-b455-40c9-bb0f-29ca84f1b758 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1528 microversion: 2.1 time: 0.214729 Aug 27 20:53:05.942199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:05.942955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:05.949614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.950377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.951021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.952215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.952341 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 603/1278] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:05 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1528 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:05.953001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.953639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.983130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:05.983783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:05.996416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.996913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.997551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:05.998572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:05.999181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:05.999798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.047567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:06.048088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:06.048306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:06.048509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.049156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'fault' on Instance uuid e4fc76c4-85dc-43e5-8695-5e0475c8337a {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:06.057230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:06.060996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9309683-3fa5-4baa-8803-6098960533bd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1217 microversion: 2.1 time: 0.122935 Aug 27 20:53:06.061676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 676/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:05 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:06.098824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:06.108294 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-618fd172-aa9d-4968-a66f-1d9114dd03b7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 200 len: 1307 microversion: 2.1 time: 0.129747 Aug 27 20:53:06.108900 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 604/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:05 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:06.190045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:06.190955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:06.199128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:06.199902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:06.200474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.201197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:06.201658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:06.202259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.395325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:06.405645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92fee7d7-b4b4-4c51-a197-f3749e918d6d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.219746 Aug 27 20:53:06.407545 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 677/1281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:06 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:06.731030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:06.731966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:06.739534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:06.740300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:06.740919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.741628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:06.742227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:06.742642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:06.856633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6022f9a-9f38-44b4-9041-9fce10cb28fb tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f055820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:06.942835 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6022f9a-9f38-44b4-9041-9fce10cb28fb tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.091407 Aug 27 20:53:06.947658 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 678/1282] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:06 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:06.948885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:06.965075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:06.966974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc7f5ee6-951e-46d2-8450-3d6575597cb9 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1542 microversion: 2.1 time: 0.239945 Aug 27 20:53:06.968085 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 605/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:06 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1542 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:06.983135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:06.993366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:06.993903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:07.000672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.001583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.002229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.003109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.003752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.004331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.022301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.023095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.026368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.027525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.030915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.031614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.111990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52e85e61-338e-47f7-8e49-ae9b70ab94a6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127314 Aug 27 20:53:07.112800 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 606/1284] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:53:06 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:07.118638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:07.119929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:07.147254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.151499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.151973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.152690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.161276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.161990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.449237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:07.467457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fde43d2a-a2bd-414d-93de-3d2dad765a2c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1265 microversion: 2.1 time: 0.350787 Aug 27 20:53:07.479383 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 607/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:07 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:07.479383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:07.479383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: e4fc76c4-85dc-43e5-8695-5e0475c8337a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:07.495014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.495537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.495974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.500700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.501257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.501693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.547095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] HTTP exception thrown: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Request method failure captured: Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a HTTP/1.1 Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOOKo9mcH_en0CbSDNc2E9IE1Vc78lugY6_9KfFTJkqiEDa93i30-eak6ttM7ivozUPJpiB5uzEkbSLRYVcLyWYSVSRsErW2Tl7KQGdXIzKjwvqE45BKXgpuXYY42sPryvMKlFL9C6hyWAyHzn-50v4TVaKvC7T1kLtVLPOJgZIQyw Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 96fc49f44f7a4bcca55eae824956691c Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:07.549275 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96fc49f44f7a4bcca55eae824956691c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96fc49f44f7a4bcca55eae824956691c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96fc49f44f7a4bcca55eae824956691c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96fc49f44f7a4bcca55eae824956691c"}]}] Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 96fc49f44f7a4bcca55eae824956691c Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesAdminNegativeTest-250760484-project Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 9f6ceb86c4584847aa1ec7631644a264 Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesAdminNegativeTest-250760484-project Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. Aug 27 20:53:07.550883 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e4fc76c4-85dc-43e5-8695-5e0475c8337a'} Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:07.551878 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. Aug 27 20:53:07.553455 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:07.556347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Returning 404 to user: Instance e4fc76c4-85dc-43e5-8695-5e0475c8337a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:07.558958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41a904cd-4362-4203-bfcb-7d598e544b17 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a" status: 404 len: 111 microversion: 2.1 time: 0.087878 Aug 27 20:53:07.560178 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 608/1286] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:07 2022] GET /compute/v2.1/servers/e4fc76c4-85dc-43e5-8695-5e0475c8337a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:07.566383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691d74ce-cc9b-4995-8936-9ae34db49914", "tag": "81b7f177-9ac6-44f0-8d3b-f2591a636ffc"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:07.608194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.609203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.609203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.641533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] Creating event network-changed:81b7f177-9ac6-44f0-8d3b-f2591a636ffc for instance 691d74ce-cc9b-4995-8936-9ae34db49914 on nch1-master-1 Aug 27 20:53:07.652307 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-57b10d23-d767-492c-acee-a07869476dd8 req-497143ae-5354-4f22-9e00-153f0961120b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089255 Aug 27 20:53:07.653080 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 609/1287] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:07.668440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:07.669165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:07.692912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.693446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.693880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.694617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:07.695072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:07.695682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:07.753848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:07.800258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:07.815666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-750bd035-9fd9-41f4-afa0-a89714a747a6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1528 microversion: 2.1 time: 0.854994 Aug 27 20:53:07.833802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 679/1288] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:06 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1528 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:07.957803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5b17622-3609-4290-aebf-4a9345dd3cf1 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ef3b160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:08.025841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:08.033702 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5b17622-3609-4290-aebf-4a9345dd3cf1 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.080382 Aug 27 20:53:08.035140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 680/1289] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:07 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:08.045850 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10a13a53-022b-4024-89c8-2f0bc2671614 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.391202 Aug 27 20:53:08.055412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 610/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:07 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:08.493983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:08.494603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:08.538578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:08.540004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:08.542816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:08.543873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:08.550098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:08.550653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:08.797454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:08.824970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9689bcf-f15f-4d3a-be1e-1ab486b94e8d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1273 microversion: 2.1 time: 0.335191 Aug 27 20:53:08.839221 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 681/1291] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:08 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:08.847740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:08.848621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:08.865605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:08.866401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:08.867011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:08.868181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:08.868662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:08.869095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:08.970156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:08.970794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:09.005096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.005743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.006259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.013904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.014322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.014790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.015264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lazy-loading 'fault' on Instance uuid 41be0bb9-c6da-4ddd-9b82-0d0295cff228 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:09.019168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.025396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.026075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.097979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:09.161535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:09.171273 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cced422c-da97-4d6f-a875-2798b59931d1 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1315 microversion: 2.1 time: 0.327404 Aug 27 20:53:09.174509 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 611/1292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:08 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:09.179849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daeca3ff-a5ad-4aad-a73d-b70b22f8eb76 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efcef70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:09.260201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed006167-f35f-4aa7-8d54-5d79150beaff tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 204 len: 0 microversion: 2.1 time: 0.299199 Aug 27 20:53:09.261635 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 682/1293] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:08 2022] DELETE /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:09.274761 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-daeca3ff-a5ad-4aad-a73d-b70b22f8eb76 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.096900 Aug 27 20:53:09.278765 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 612/1294] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:09 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:09.289606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:09.293324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:09.293687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:09.296067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:09.333796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.334318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.334748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.335524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.342191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.342793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.343242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.344405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:09.344859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.345280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:09.353060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:09.353517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.028188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:10.042914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-141a4f0f-b776-4951-9e3d-a78e4a775c36 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.765909 Aug 27 20:53:10.047309 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 683/1295] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:09 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:10.059104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:10.075219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16fc1976-d22b-43c2-b2a1-3a49c59c0e31 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1678 microversion: 2.1 time: 0.792932 Aug 27 20:53:10.076659 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 613/1296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:09 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1678 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:10.089837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41be0bb9-c6da-4ddd-9b82-0d0295cff228", "name": "network-vif-deleted", "tag": "d1134007-4daa-401f-8925-140cc9922c69"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:10.108247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:10.109270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:10.117665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.120495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.121872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.126261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.127048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.127679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.128625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.130153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.132965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.153663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] Creating event network-vif-deleted:d1134007-4daa-401f-8925-140cc9922c69 for instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 on nch1-master-1 Aug 27 20:53:10.164771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-72733cb5-fd69-4b06-8ce9-6c45353c044b req-23512a34-165b-4be9-a92a-4fbbc50a1ee2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111043 Aug 27 20:53:10.168130 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 684/1297] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:10.200403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:10.201165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:10.207935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.208664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.209288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.210171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.210815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.211454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.252103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.252628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.253103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.253592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lazy-loading 'fault' on Instance uuid 41be0bb9-c6da-4ddd-9b82-0d0295cff228 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:10.347597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:10.376321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-786432bc-f03b-4adb-81c6-1a76ef5de9fd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1315 microversion: 2.1 time: 0.181291 Aug 27 20:53:10.378037 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 685/1298] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:10 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:10.400562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca1eff95-9378-460c-9e67-33d112d2d344 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ef3b160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:10.428170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:10.437613 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-350c899e-833d-468e-b20f-06196c310ef5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.345825 Aug 27 20:53:10.443921 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 614/1299] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:10 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:10.453095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:10.463373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca1eff95-9378-460c-9e67-33d112d2d344 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.075582 Aug 27 20:53:10.463814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:10.465631 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 686/1300] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:10 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:10.474630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:10.475027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:10.493059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] Creating event network-changed:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch1-master-1 Aug 27 20:53:10.500684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-344513a6-5089-444a-9c99-d0aa61e0dd37 req-812f5572-9c1f-42a9-869f-b0b7ab9d80d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055276 Aug 27 20:53:10.501497 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 615/1301] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:11.069969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:11.071658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:11.099725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.100737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.102720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.103258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:11.103938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.104192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:11.104795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.105452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.118389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.119250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.120019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.120987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.121665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.122335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.348743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:11.366124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:11.380333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-18acdf46-26d1-4e99-96ed-005d234e4037 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1678 microversion: 2.1 time: 0.281698 Aug 27 20:53:11.380920 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 616/1302] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:11 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:11.406666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a11000ee-cb7c-463d-9a43-fffe2f01fee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.338264 Aug 27 20:53:11.407671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 687/1303] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:11 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:11.411947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:11.413819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:11.420965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.421726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.422390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.423285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.423941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.424541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.459296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.460046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.460470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.461099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lazy-loading 'fault' on Instance uuid 41be0bb9-c6da-4ddd-9b82-0d0295cff228 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:11.477072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:11.478351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:11.495318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.499662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.500375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.501271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:11.501954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:11.502535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:11.510401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:11.519489 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91558eeb-5754-45e9-9288-4331215f6bfe tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 200 len: 1315 microversion: 2.1 time: 0.116063 Aug 27 20:53:11.520488 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 617/1304] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:11 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 1315 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:11.525468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6070096d-7dd5-4dba-98d5-606e1d008588 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f096310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:11.593381 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6070096d-7dd5-4dba-98d5-606e1d008588 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.071614 Aug 27 20:53:11.597564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 618/1305] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:11 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:11.692412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:11.705805 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de12e635-bf4e-4abf-beea-36b773b0c389 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.237914 Aug 27 20:53:11.707003 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 688/1306] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:11 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:12.405986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:12.406669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:12.415455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.422704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.423444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:12.424403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.425026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.425624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:12.434879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:12.436116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:12.452347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.455951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.457314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:12.460076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.460767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.463914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:12.861634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:12.867566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:12.892062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07dff05e-85dd-4ee1-8247-cb92ca863ea4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.461901 Aug 27 20:53:12.924764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8425f11f-ca80-42d0-850f-9eb4475cccf7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1678 microversion: 2.1 time: 0.523327 Aug 27 20:53:12.926628 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 689/1307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:12 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:12.928669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 619/1308] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:12 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1678 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:12.940819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b3b141d-3c66-4ecf-a19e-2cbd30d6a0e1 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f137ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:12.942613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:12.943826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:12.976761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.988337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.989216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:12.991676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:12.993286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:12.994155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.058223 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b3b141d-3c66-4ecf-a19e-2cbd30d6a0e1 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.126413 Aug 27 20:53:13.064398 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 620/1309] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:12 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:13.077900 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:53:13.078514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 HTTP/1.1 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:13.086042 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:53:13.088135 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228'} Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:13.088885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:53:13.090705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:13.093026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:13.093026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0089ccc-1bde-4337-830b-44013ddb03a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 404 len: 111 microversion: 2.1 time: 0.157261 Aug 27 20:53:13.093026 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 690/1310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:12 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:13.093466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:13.109824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.110320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.116723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.122042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7308c12-4f86-431d-b963-2063f6491a5c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'create', calling method: .version_select at 0x7ff84fb89a60>, body: {"keypair": {"name": "tempest-keypair-1497563592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6K4MryOK/i0QXXoRKmHU6uw5EVMNwAgVeL0c+KVs31g9TTHi7pHNyjptGC8H792nEXT2L68kGAZpN9+wqBKrSp435biOG0+OCavtwhdRQ00TKtbDNQ/PJRxeuOc8MHsA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:13.128492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.129145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.129589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.163255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f7308c12-4f86-431d-b963-2063f6491a5c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for project 43b82605298a42f8a6b7594647e5d207. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:53:13.167870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f7308c12-4f86-431d-b963-2063f6491a5c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for user 0bdbed202cad4f2bbc0c299bf9442986 and project 43b82605298a42f8a6b7594647e5d207. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:53:13.208847 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7308c12-4f86-431d-b963-2063f6491a5c tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096005 Aug 27 20:53:13.209427 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 691/1311] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:53:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:13.493323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:13.509806 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0815a53c-63df-4022-9f21-5cf0d948cc79 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.441154 Aug 27 20:53:13.510717 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 621/1312] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:13 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:13.852450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c35889b-6c0a-4027-ad07-7b3cb8575afe", "name": "network-vif-deleted", "tag": "6cf9e88d-0cd8-44d3-a58d-c26480ae4cde"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:13.875589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.876084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.877131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.909590 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] Creating event network-vif-deleted:6cf9e88d-0cd8-44d3-a58d-c26480ae4cde for instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe on nch2-master-1 Aug 27 20:53:13.917713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:13.918350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:13.925040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1478c8c1-0035-4f60-8f20-e5b7060b8f50 req-9cedb672-2cda-474f-aeaf-c6ec8d73edd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077157 Aug 27 20:53:13.926504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 692/1313] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:13.928391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.930510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.931177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.932180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.932821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.933432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.954642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:13.957634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:13.971185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.972051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.972680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:13.973613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:13.974285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:13.974924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:14.184838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:14.194528 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-437baec0-9462-4070-a956-58c54cf14a38 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1326 microversion: 2.1 time: 0.244131 Aug 27 20:53:14.212068 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 693/1314] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:13 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1326 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:14.219729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-666e5acb-9d71-45d1-b006-a09e9eebd674 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eecaf70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:14.334530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-666e5acb-9d71-45d1-b006-a09e9eebd674 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.120920 Aug 27 20:53:14.335809 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 694/1315] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:14 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:14.386056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f70541-3f19-479c-af7d-cadb6d1789db", "tag": "6675d230-7e6e-4bf0-9f9e-3af33976084e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:14.407790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:14.408517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:14.409162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:14.413595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:14.426061 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2806a78-d5a3-4b3c-bd2b-ae7177a29f5c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.512561 Aug 27 20:53:14.441728 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 622/1316] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:13 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:14.449588 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] Creating event network-changed:6675d230-7e6e-4bf0-9f9e-3af33976084e for instance 71f70541-3f19-479c-af7d-cadb6d1789db on nch1-master-1 Aug 27 20:53:14.457962 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c3d63a02-a759-425d-a2b8-c670fd19e8b2 req-d5eab7f7-aef0-4ba3-b4e9-929f28613703 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076202 Aug 27 20:53:14.463671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 695/1317] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:53:14.532113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:14.533139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:14.541788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:14.542578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:14.543889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:14.544911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:14.546159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:14.548131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:14.591775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:14.631488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:14.834708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:14.851254 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa67dc7c-274b-4a25-b5b7-ccb7ac140b03 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.323481 Aug 27 20:53:14.854491 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 623/1318] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:14 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:15.222813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:15.224128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:15.252225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.253559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.255526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.258896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.262654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.264616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.334142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:15.343803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.344302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.344730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.351226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lazy-loading 'fault' on Instance uuid 5c35889b-6c0a-4027-ad07-7b3cb8575afe {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:15.361982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2431ac2-714f-4be6-a2da-1352f914ec82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efd3dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:15.448766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6ceb86c4584847aa1ec7631644a264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fc49f44f7a4bcca55eae824956691c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:15.458706 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2431ac2-714f-4be6-a2da-1352f914ec82 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.104834 Aug 27 20:53:15.467379 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-295452e5-a6b7-4bc7-9774-db7a74c4ae4d tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 200 len: 1331 microversion: 2.1 time: 0.251987 Aug 27 20:53:15.469008 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 696/1319] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:15 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 1331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:15.473058 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 624/1320] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:15 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:15.493103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:15.494491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:15.506985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.507879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.508482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.509428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.510054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.510622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.726159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:15.736715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-67f60934-1b83-4017-a316-5cf92a098933 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.266285 Aug 27 20:53:15.751537 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 697/1321] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:15 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:15.874737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:15.875940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:15.885612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.886671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.887514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:15.888744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:15.889577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:15.890210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.095857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:16.117582 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6a971ed-2a07-4593-87cb-29bd77eeacde tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.246749 Aug 27 20:53:16.120552 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 625/1322] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:15 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:16.265060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.266153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:16.273015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.274753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.276912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.278030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.280081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.280845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.335248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:16.341689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:16.457058 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae111e13-7913-41fb-bc75-6d8968df4ab4 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 204 len: 0 microversion: 2.1 time: 0.196398 Aug 27 20:53:16.457862 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 698/1323] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:16 2022] DELETE /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:16.467943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.469132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:16.480357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e222da4d-404b-41e0-9671-83f60b25db6d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee8caf0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.487582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.488720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.489458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.490445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.491106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.495321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.555042 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e222da4d-404b-41e0-9671-83f60b25db6d tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.079125 Aug 27 20:53:16.556022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 699/1324] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:16 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:16.577250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.577250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] [instance: 5c35889b-6c0a-4027-ad07-7b3cb8575afe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:16.600720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.601234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.601737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.602464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.602929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.603378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.630619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] HTTP exception thrown: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Request method failure captured: Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe HTTP/1.1 Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOOKo9mcH_en0CbSDNc2E9IE1Vc78lugY6_9KfFTJkqiEDa93i30-eak6ttM7ivozUPJpiB5uzEkbSLRYVcLyWYSVSRsErW2Tl7KQGdXIzKjwvqE45BKXgpuXYY42sPryvMKlFL9C6hyWAyHzn-50v4TVaKvC7T1kLtVLPOJgZIQyw Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 96fc49f44f7a4bcca55eae824956691c Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:16.637363 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96fc49f44f7a4bcca55eae824956691c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96fc49f44f7a4bcca55eae824956691c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96fc49f44f7a4bcca55eae824956691c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96fc49f44f7a4bcca55eae824956691c"}]}] Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 96fc49f44f7a4bcca55eae824956691c Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-250760484 Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesAdminNegativeTest-250760484-project Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9f6ceb86c4584847aa1ec7631644a264 Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesAdminNegativeTest-250760484-project Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. Aug 27 20:53:16.638751 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5c35889b-6c0a-4027-ad07-7b3cb8575afe'} Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:16.639542 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. Aug 27 20:53:16.640744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:16.641830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Returning 404 to user: Instance 5c35889b-6c0a-4027-ad07-7b3cb8575afe could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:16.641830 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98b00511-dc43-453d-b481-76e42ba59fd7 tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe" status: 404 len: 111 microversion: 2.1 time: 0.084402 Aug 27 20:53:16.643028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 700/1325] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:16 2022] GET /compute/v2.1/servers/5c35889b-6c0a-4027-ad07-7b3cb8575afe => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:16.654441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7e25407-c0d4-4dbb-8447-03553bf49f7e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] Calling method '.version_select at 0x7ff84ee4e550>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.690513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7e25407-c0d4-4dbb-8447-03553bf49f7e tempest-VolumesAdminNegativeTest-250760484 tempest-VolumesAdminNegativeTest-250760484-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493849134" status: 202 len: 0 microversion: 2.1 time: 0.042037 Aug 27 20:53:16.692095 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 701/1326] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 20:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493849134 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:53:16.707938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:16.719472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f71a8979-2352-44db-8563-b3640bf0b4a3 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1709 microversion: 2.1 time: 0.256199 Aug 27 20:53:16.724493 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 626/1327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:16 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1709 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:16.739024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-145640469", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:16.765633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:16.766560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:16.779100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.779958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.781603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.782561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:16.786826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:16.787312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:16.828143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] validate_networks() for [('9c58eb9b-edd7-4932-8b75-d271f5f1d195', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:53:17.097039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:17.116659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e79981d8-4bf4-47be-ace1-5ea23ab98fbd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.355802 Aug 27 20:53:17.118760 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 627/1328] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:16 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:17.146509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:17.147839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:17.160966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.161722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.162051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:17.163073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.163508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.164581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:17.863301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:17.875333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e547d7a-8801-4f15-ab0c-0f443c1ab1c6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.732888 Aug 27 20:53:17.887726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 628/1329] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:17 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:17.887726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a74a21ed-f821-4f9e-9853-89303f0320a8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efce5e0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:17.888058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:53:17.888058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:53:17.888058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:53:17.888058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:53:17.888058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:53:17.898709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.899689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.900208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:17.902304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.902786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.946393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:17.955879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a74a21ed-f821-4f9e-9853-89303f0320a8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1424 microversion: 2.1 time: 0.077952 Aug 27 20:53:17.956766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 629/1330] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:17 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:17.961701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:17.962695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:17.969311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.969893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.971012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:17.971829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:17.972350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:17.972835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.028587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:53:18.034475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for user 0bdbed202cad4f2bbc0c299bf9442986 and project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:53:18.050638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:53:18.053512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:53:18.136471 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ac78db2-de96-424c-a1ed-b7c2b848ad16 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.403469 Aug 27 20:53:18.137547 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 702/1331] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:53:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:53:18.142743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691d74ce-cc9b-4995-8936-9ae34db49914", "name": "network-vif-plugged", "status": "completed", "tag": "81b7f177-9ac6-44f0-8d3b-f2591a636ffc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:18.154226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:18.155187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:18.155331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.173393 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] Creating event network-vif-plugged:81b7f177-9ac6-44f0-8d3b-f2591a636ffc for instance 691d74ce-cc9b-4995-8936-9ae34db49914 on nch1-master-1 Aug 27 20:53:18.178713 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-12ab0186-7022-4b95-9d22-0c6ded43b7e1 req-e7c54590-e863-4298-8d0e-370eee7c2f93 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039927 Aug 27 20:53:18.179897 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 703/1332] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:18.185299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:18.186141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:18.193376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:18.193971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:18.194471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.195464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:18.196327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:18.197027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.631529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:18.649661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32eaa9c8-f228-4f78-8ed3-4c5912214258 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1709 microversion: 2.1 time: 0.691696 Aug 27 20:53:18.663489 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 630/1333] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:17 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1709 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:18.665062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6419c05a-95d3-4a83-8388-d42979b7522a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:18.665705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6419c05a-95d3-4a83-8388-d42979b7522a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:18.743817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:18.751746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79f1ec44-bf39-441d-a57b-8baf48e02864 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.570539 Aug 27 20:53:18.755702 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 704/1334] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:18 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:18.817884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6419c05a-95d3-4a83-8388-d42979b7522a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:18.826417 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6419c05a-95d3-4a83-8388-d42979b7522a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1224 microversion: 2.1 time: 0.165379 Aug 27 20:53:18.833331 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 631/1335] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:18 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:18.899446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:18.900157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:18.909548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:18.910270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:18.910915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.911999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:18.912964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:18.913578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:18.970793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-77e949d2-852e-4326-a997-ae007a240da6 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f079f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.033172 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-77e949d2-852e-4326-a997-ae007a240da6 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1433 microversion: 2.1 time: 0.066355 Aug 27 20:53:19.034132 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 632/1336] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:18 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1433 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:19.047961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f581234-bd63-4170-881f-7654fa410257 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f145ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.102190 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f581234-bd63-4170-881f-7654fa410257 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 200 len: 1433 microversion: 2.1 time: 0.058276 Aug 27 20:53:19.102423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:19.104333 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 633/1337] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:19 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 1433 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:19.110985 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-071ce26f-b671-4ab4-9815-36e3e0b929f1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.216644 Aug 27 20:53:19.115382 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 705/1338] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:18 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:19.117406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.118024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:19.124225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.124906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.125341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.126259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.126862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.127634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.274959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:19.284077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dba65fa-a28d-4eee-91d2-6c1e2981d876 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1480 microversion: 2.1 time: 0.170747 Aug 27 20:53:19.284647 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 634/1339] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:19 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1480 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:19.670642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.671263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:19.678903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.679770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.680590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.681561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.682030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.682474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.772303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.772919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:19.791938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.792485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.793085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.793653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.794106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.794529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.812838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:19.855260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:19.872664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8402dedb-5d90-4743-982b-7b0066fccf6a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1709 microversion: 2.1 time: 0.198226 Aug 27 20:53:19.876580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 706/1340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:19 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1709 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:19.884244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:19.885636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:19.893863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.894640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.895692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:19.896787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:19.897605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:19.898262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.001775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:20.012222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:20.015971 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-30e0d262-2b8f-49f7-bed8-1aec02a187bf tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1276 microversion: 2.1 time: 0.137704 Aug 27 20:53:20.016990 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 707/1341] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:19 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:20.020706 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58d061d4-24b4-448f-a1ce-1070d24e3d27 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.252212 Aug 27 20:53:20.021408 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 635/1342] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:19 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:20.134160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.134775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:20.140994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.141461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.141908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.142786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.143510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.144026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.297903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:20.305682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.306299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:20.312774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.313508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.313944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.314655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.315109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.315571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.322728 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-edd11c19-3570-47c8-82f0-a69dfac47df1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.193739 Aug 27 20:53:20.323829 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 708/1343] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:20 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:20.466283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:20.477789 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae10e043-bd2c-4b94-8fa3-5d039a84800f tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1467 microversion: 2.1 time: 0.176512 Aug 27 20:53:20.479395 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 636/1344] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:20 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1467 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:20.500204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc81cbd4-38b3-434b-b53c-61162f83087b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eef7b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.568446 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc81cbd4-38b3-434b-b53c-61162f83087b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e" status: 200 len: 784 microversion: 2.1 time: 0.072060 Aug 27 20:53:20.569038 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 709/1345] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:20 2022] GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:20.582965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb683c9f-768a-43e1-baa4-598bcf616bde tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.596986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb683c9f-768a-43e1-baa4-598bcf616bde tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017803 Aug 27 20:53:20.599967 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 637/1346] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:53:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:20.612526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-321b1137-aad4-4485-b5d5-57553d6142e9 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeecf70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.897807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:20.900220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:20.911224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.912020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.912643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:20.913982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:20.914631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:20.915210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.256699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:21.271725 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b2b11ef-a5f5-499e-8d16-10cbe4abb50d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1709 microversion: 2.1 time: 0.378237 Aug 27 20:53:21.279736 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 638/1347] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:20 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1709 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:21.301689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:21.302331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:21.321214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-321b1137-aad4-4485-b5d5-57553d6142e9 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "DELETE /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 204 len: 0 microversion: 2.1 time: 0.712445 Aug 27 20:53:21.323457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.323966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.324606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.325451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 710/1348] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:20 2022] DELETE /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:21.327605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.328558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.329215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.332812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:21.333792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:21.369657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.377595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.379689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.380875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.381364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.381800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.440009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:21.449680 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b62f5902-cc12-4dbe-8e53-f77168c096f0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1282 microversion: 2.1 time: 0.168004 Aug 27 20:53:21.450273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 639/1349] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:21 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:21.469236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56c737b9-7da0-46b1-9a9b-a95f39ddcc6c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f096d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:21.495207 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-56c737b9-7da0-46b1-9a9b-a95f39ddcc6c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] HTTP exception thrown: Image not found. Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56c737b9-7da0-46b1-9a9b-a95f39ddcc6c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Request method failure captured: Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 HTTP/1.1 Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoQL_IqSr7f1rSRJvc_Qfo_6PuqVW7PN1cYNm4cCRDP6ZuAW32CAn5FRlYDSyWcDiJVevr4AvJRr9jMqlzERGkH2AwLfr_iVdK2ZyaOcHXU3jOBFKBNbkZxQFKcKXpk3BU-UuOQSGZw8ztGopxyC_BOFlenstI5Uy-HBB37_zLVqH1g Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:21.505557 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdaa7c7ca577460886d51a42e581c3ac", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}] Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8755382f70e248039545e8882d4fd015 Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ed53a05e-3238-491e-abc5-73349cb875d6'} Aug 27 20:53:21.507379 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:53:21.508699 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ed53a05e-3238-491e-abc5-73349cb875d6 Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:53:21.510465 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed53a05e-3238-491e-abc5-73349cb875d6 could not be found. Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:53:21.512211 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:21.513931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56c737b9-7da0-46b1-9a9b-a95f39ddcc6c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:21.515236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56c737b9-7da0-46b1-9a9b-a95f39ddcc6c tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 404 len: 62 microversion: 2.1 time: 0.048238 Aug 27 20:53:21.516256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 640/1350] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:21 2022] GET /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:53:21.522167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:21.523232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:21.534817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.535830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.536567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.537512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.538327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.539055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.792961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:21.799678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:21.813070 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bedba43a-3096-4497-b15c-36f66c2c2716 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.295443 Aug 27 20:53:21.813637 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 641/1351] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:21 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:21.815246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-113dd871-b7ea-45e7-8aa4-8528901d6ad4 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1317 microversion: 2.1 time: 0.488535 Aug 27 20:53:21.815826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 711/1352] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:21 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:21.821850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-833299376"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:21.824484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:21.830873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.831681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.832342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:21.833200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:21.833643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:21.834239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.057224 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad7bcfcf-3344-4aee-9195-d2d946714f54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "POST /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68/action" status: 202 len: 0 microversion: 2.1 time: 0.239878 Aug 27 20:53:22.058384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 712/1353] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:53:21 2022] POST /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:53:22.069401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2aa6d25-aa6f-4ca0-a469-6cb181b276d8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f096dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:22.161362 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2aa6d25-aa6f-4ca0-a469-6cb181b276d8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.096014 Aug 27 20:53:22.170897 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 642/1354] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:22 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:22.297394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:22.298014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:22.335327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.352188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.353105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.354220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.354849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.355541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.472889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:22.474658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:22.484492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.485375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.486062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.487064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.487962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.488613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.676251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:22.697435 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9355214c-621f-4665-b634-f6055e809b7d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1709 microversion: 2.1 time: 0.404224 Aug 27 20:53:22.711171 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 713/1355] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:22 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1709 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:22.716233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f70541-3f19-479c-af7d-cadb6d1789db", "name": "network-vif-plugged", "status": "completed", "tag": "6675d230-7e6e-4bf0-9f9e-3af33976084e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:22.734717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.735620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.736530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.752595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] Creating event network-vif-plugged:6675d230-7e6e-4bf0-9f9e-3af33976084e for instance 71f70541-3f19-479c-af7d-cadb6d1789db on nch1-master-1 Aug 27 20:53:22.757740 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f38fe954-a297-462b-a12b-7b46b7628fe3 req-bd107013-2ec3-431c-bfa2-1397a46e1e1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057077 Aug 27 20:53:22.758675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 714/1356] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:22.795142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:22.812310 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f6efaeb-00f4-43db-9a27-32f53561dde2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.343493 Aug 27 20:53:22.813434 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 643/1357] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:22 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:22.851003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:22.851932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:22.855738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:22.861503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:22.868526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.869796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.870493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.872078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.872769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.873413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.884161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.884653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.886660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:22.889208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:22.891455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:22.894511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.324788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:23.333824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3972f88-7fc3-4a2c-a31b-dd85e3831d06 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1466 microversion: 2.1 time: 0.485458 Aug 27 20:53:23.334550 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 715/1358] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:22 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1466 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:23.339918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f4d948-81e4-4742-a469-225558c65b32", "tag": "ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:23.352365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.353006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.353692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.357143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:23.365233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7da2a461-7097-41dc-8a65-159c9bc420e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.520705 Aug 27 20:53:23.365806 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 644/1359] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:22 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:23.366352 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] Creating event network-changed:ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42 for instance 72f4d948-81e4-4742-a469-225558c65b32 on nch2-master-1 Aug 27 20:53:23.372011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96a76a8c-b05b-4f59-87a8-8ebe04599c23 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f096dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:23.375046 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f92bf2ce-34fb-425e-82bf-c26fe8d0c4bb req-99c92a4b-78ea-454a-b8f2-9b4f1bdc170c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038888 Aug 27 20:53:23.379577 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 716/1360] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:23.385819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:23.387204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:23.393119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.394291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.394291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.394968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.395736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.396166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.445191 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96a76a8c-b05b-4f59-87a8-8ebe04599c23 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.077806 Aug 27 20:53:23.454491 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 645/1361] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:23 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:23.569290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02e2a34-e1a3-4782-8faa-0af7c8a57b35", "name": "network-vif-deleted", "tag": "4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:23.595251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.596043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.598261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.618663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] Creating event network-vif-deleted:4b8aa266-fbc4-4f45-83d9-6a0d66d3c3fd for instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 on nch1-master-1 Aug 27 20:53:23.625563 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0ba6d3d0-1178-484c-9a6e-17c3caf109ea req-b7336475-c9c2-4a57-bb25-bbb01ab354df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061211 Aug 27 20:53:23.626719 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 646/1362] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:23.725554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:23.728045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:23.739180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.740617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.741222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.742839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.743745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.744331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.833595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:23.851479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34cbf3f5-fdf8-4180-b24d-23a54012923e tempest-ServersOnMultiNodesTest-1390506814 tempest-ServersOnMultiNodesTest-1390506814-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1617 microversion: 2.1 time: 0.470517 Aug 27 20:53:23.851766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-293cc67b-f11d-4619-834d-547852141856 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1642 microversion: 2.1 time: 0.135945 Aug 27 20:53:23.853658 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 717/1364] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:23 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1617 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:23.853779 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 647/1364] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:23 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1642 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:23.864570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:23.865586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:23.874418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.875452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.876107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.877016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.877817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.878513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.881336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:23.882744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:23.904655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.905186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.905619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:23.906328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:23.907330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:23.923989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.000785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:24.062051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:24.145063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:24.155542 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0661c98f-ee6f-4a16-85d2-bdf1a5f78748 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.300709 Aug 27 20:53:24.156461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 648/1365] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:23 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:24.165332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c97b5f3e-690a-4085-81de-e6d3314cf75a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 204 len: 0 microversion: 2.1 time: 0.288390 Aug 27 20:53:24.170200 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 718/1366] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:23 2022] DELETE /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:53:24.185530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:24.186337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:24.192815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.193512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.194321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.195330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.195965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.196550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.367464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:24.390377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:24.391896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:24.401151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9606a315-41ea-4a8b-94be-43d41da5127f tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1472 microversion: 2.1 time: 0.230041 Aug 27 20:53:24.402705 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 649/1367] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:24 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:24.416035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.416035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.416035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.416035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.416446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.416446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.470056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9b69936-3132-4ea0-a26a-0db5ea4a308a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f1c28b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:24.552509 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9b69936-3132-4ea0-a26a-0db5ea4a308a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.095339 Aug 27 20:53:24.561323 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 650/1368] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:24 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:24.626765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:24.636941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58cb847a-184a-4bdf-9706-2ef4b41b42f2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.252068 Aug 27 20:53:24.637556 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 719/1369] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:24 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:24.773516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-unplugged", "status": "completed", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:24.786567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.786978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.787484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.799646 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] Creating event network-vif-unplugged:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:53:24.805442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-60a7864a-1424-46f6-bfa8-7963d5dd219a req-29f1efdd-99c2-4f3f-a3be-4a1145b1110d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035890 Aug 27 20:53:24.806049 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 651/1370] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:24.878251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:24.878783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:24.886263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.887077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.887621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.888583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.889160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.889642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.931363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:24.932141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:24.932582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:24.933043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lazy-loading 'fault' on Instance uuid e02e2a34-e1a3-4782-8faa-0af7c8a57b35 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:25.016258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:25.025556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73891d43-c235-4328-8e93-2d675e8c173d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1351 microversion: 2.1 time: 0.151251 Aug 27 20:53:25.028146 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 720/1371] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:24 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:25.177336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:25.178071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:25.185697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.186163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.186598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.187331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.187807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.188230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.419050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:25.425248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:25.425893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:25.428312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9a32839-340e-44e0-acd6-1468d5e95da6 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.255263 Aug 27 20:53:25.439401 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 652/1372] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:25 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:25.444291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.444834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.445477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.446186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.446811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.447248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.567466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cd8ad5b-5bc1-4ebe-924f-08617ea91604 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efcee50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:25.613385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cd8ad5b-5bc1-4ebe-924f-08617ea91604 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.049940 Aug 27 20:53:25.614025 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 653/1373] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:25 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:25.658424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:25.659109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:25.665365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.665865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.666374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.667012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:25.667506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:25.668084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:25.671061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:25.682214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d5e861b8-9eca-4c33-b56d-195f8e064ee7 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1472 microversion: 2.1 time: 0.261639 Aug 27 20:53:25.682927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 721/1374] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:25 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:26.049864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:26.050497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:26.059448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.059913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.060597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.061310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.061822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.062319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.097692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.098235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.098692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.099146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lazy-loading 'fault' on Instance uuid e02e2a34-e1a3-4782-8faa-0af7c8a57b35 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:26.158606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:26.166957 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ba34e7e-363e-444e-9f1f-cf711c5e9e88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1313 microversion: 2.1 time: 0.512514 Aug 27 20:53:26.168186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 654/1375] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:25 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:26.181863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:26.192115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1284d300-e466-4265-966e-e3f3cc107914 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1351 microversion: 2.1 time: 0.146672 Aug 27 20:53:26.193993 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 722/1376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:26 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:26.450590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:26.451653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:26.459075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.459634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.460083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.460867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.461325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.461933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.628377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7bbf2ba1-9d2c-45a2-9126-804037877151 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeecca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:26.696130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:26.704284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7bbf2ba1-9d2c-45a2-9126-804037877151 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.079891 Aug 27 20:53:26.709187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 723/1377] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:26 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:26.716079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:26.717122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:26.717320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fd99bf3-ae1d-45f7-9121-23adcdbeb093 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.270554 Aug 27 20:53:26.724823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.725511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.726011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.726967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:26.727692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:26.728156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:26.741275 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 655/1378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:26 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:26.955834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:26.968591 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64ef2e11-2bf4-4db9-9747-e91bdeb38a76 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1472 microversion: 2.1 time: 0.257143 Aug 27 20:53:26.971046 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 724/1379] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:26 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:27.191686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:27.192428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:27.204516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.205641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.206351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.207376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.208193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.209113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.217815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:27.218727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:27.248558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.255238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.256848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.258202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.265268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.270855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.401623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.403012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.406431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.407403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lazy-loading 'fault' on Instance uuid e02e2a34-e1a3-4782-8faa-0af7c8a57b35 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:27.572531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd3010448cc4d0c8b6da2dd09a55055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61874976b164c9581dc6e4287f77389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:27.582993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b281c194-beb3-4ffe-8cdb-82dd98a2a151 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 200 len: 1351 microversion: 2.1 time: 0.371964 Aug 27 20:53:27.599794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 725/1380] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:27 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 1351 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:27.599794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691d74ce-cc9b-4995-8936-9ae34db49914", "name": "network-vif-deleted", "tag": "81b7f177-9ac6-44f0-8d3b-f2591a636ffc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:27.618672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.619159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.619610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.654930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] Creating event network-vif-deleted:81b7f177-9ac6-44f0-8d3b-f2591a636ffc for instance 691d74ce-cc9b-4995-8936-9ae34db49914 on nch1-master-1 Aug 27 20:53:27.661009 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-696e95c5-708c-4168-bd78-0ba69f20873f req-8a8c9619-c1e1-4598-857b-b87e4535318b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075745 Aug 27 20:53:27.662193 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 726/1381] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:27.725645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3651d249-e324-4210-aa1f-bc95df63e055 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeb48b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:27.797097 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3651d249-e324-4210-aa1f-bc95df63e055 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.076953 Aug 27 20:53:27.798117 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 727/1382] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:27 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:27.804589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:27.805323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:27.814237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.814826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.815327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.816256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.816866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.817301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.880726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:27.888944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8a5c7ac-d26d-4ba8-b7f4-1f4217762b62 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1463 microversion: 2.1 time: 0.702234 Aug 27 20:53:27.889545 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 656/1383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:27 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1463 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:27.910335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:27.913503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:27.921238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.922025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.922730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:27.923756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:27.924521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:27.925094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.009024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.040220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:28.044591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.048086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 20:53:28.058567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:53:28.059156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:53:28.060162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:53:28.060733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:53:28.061555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:53:28.068027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.232036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:28.249006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.250461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08f8349a-969d-4711-b603-93904933b499 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.448106 Aug 27 20:53:28.278600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 728/1384] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:27 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:28.285711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9fb1790-4add-4765-b298-536804e30b3e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db/action" status: 202 len: 0 microversion: 2.1 time: 0.379017 Aug 27 20:53:28.290721 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 657/1385] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:53:27 2022] POST /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:53:28.296810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.297578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:28.302920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.306802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:28.309517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.310197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.311216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.311846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.313855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.314678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.324921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.325743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.326538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.328182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.329173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.329936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.400928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.401469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.401939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.403059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 691d74ce-cc9b-4995-8936-9ae34db49914 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:28.567697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:28.576136 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82c2ed4a-df08-44b4-892b-791527405219 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 200 len: 1307 microversion: 2.1 time: 0.296339 Aug 27 20:53:28.577320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 729/1386] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:28 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:28.615615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.616669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:28.627195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.627709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.628147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.628899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.629357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.629781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.672807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 HTTP/1.1 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:28.675101 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:28.676581 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'e02e2a34-e1a3-4782-8faa-0af7c8a57b35'} Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:28.677391 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:28.686120 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.689561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:28.689561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d78fc2cd-fafb-47a4-ac8c-d320176c56f1 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 404 len: 111 microversion: 2.1 time: 0.068685 Aug 27 20:53:28.689561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 730/1387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:28 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:53:28.700807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.701350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:28.707948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.708459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.709015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.709839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.710302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.710722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.730865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f HTTP/1.1 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:28.736323 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.737883 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '696e2116-4af3-4fa5-8e68-37bdf89f1a7f'} Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:28.738742 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.740109 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.755221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:28.758900 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd723eac-7153-4760-972e-b43677a6845a tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 404 len: 111 microversion: 2.1 time: 0.062425 Aug 27 20:53:28.763845 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 731/1388] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:28 2022] DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:28.770806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.771834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:28.783847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.784554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.785003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.786298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:28.787903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:28.788763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:28.820815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f HTTP/1.1 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:28.822736 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.824205 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '696e2116-4af3-4fa5-8e68-37bdf89f1a7f'} Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:28.824973 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:28.826213 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:28.828151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.829126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:28.830342 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22edfdf0-bf74-4433-8db9-7815018e2d12 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 404 len: 111 microversion: 2.1 time: 0.064592 Aug 27 20:53:28.831034 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 732/1389] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:28 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:28.836524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72908fa6-8f29-4edb-8fde-384e07d14b14 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeb4820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.901594 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72908fa6-8f29-4edb-8fde-384e07d14b14 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.068824 Aug 27 20:53:28.911768 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 733/1390] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:28 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:28.924949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:28.926834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef3ba590-f8ea-4cba-9cb3-7df62c2c3498 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '.version_select at 0x7ff84ee4e940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:28.942238 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c51036fa-c1df-44c1-9c91-e637d65ba750 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1472 microversion: 2.1 time: 0.649496 Aug 27 20:53:28.944789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 658/1391] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:28 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1472 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:28.958744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:28.985112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef3ba590-f8ea-4cba-9cb3-7df62c2c3498 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730360253" status: 202 len: 0 microversion: 2.1 time: 0.071682 Aug 27 20:53:28.986299 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 734/1392] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 20:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730360253 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:53:29.276289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:29.277053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:29.289186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.292877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.293707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.301109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.302258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.303027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.599630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:29.600728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 691d74ce-cc9b-4995-8936-9ae34db49914] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:29.608568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.609353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.609983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.610885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.611643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.612317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.629126 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 HTTP/1.1 Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:29.631206 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. Aug 27 20:53:29.633299 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '691d74ce-cc9b-4995-8936-9ae34db49914'} Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:29.634217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. Aug 27 20:53:29.635432 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:29.638087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 691d74ce-cc9b-4995-8936-9ae34db49914 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:29.639233 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-532413d3-75c1-42d7-962a-c326a523d310 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914" status: 404 len: 111 microversion: 2.1 time: 0.045124 Aug 27 20:53:29.643589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 735/1393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:29 2022] GET /compute/v2.1/servers/691d74ce-cc9b-4995-8936-9ae34db49914 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:29.649028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:29.649537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:29.656437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.656943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.657384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.658084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.658530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.658946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.687222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:29.812843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba2ae6f5-3fdd-43f2-a7b4-1615b6293c61 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 204 len: 0 microversion: 2.1 time: 0.166098 Aug 27 20:53:29.815007 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 736/1394] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:29 2022] DELETE /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:29.833008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:29.836087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:29.851523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.852549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.855036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.856012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:29.858861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:29.859711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:29.892502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:29.904407 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-470a994b-f435-4925-b46e-8bf3fcd5eb48 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.633334 Aug 27 20:53:29.905481 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 659/1395] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:29 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:29.936192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0034e56c-df05-4284-b715-fafd9b46ba8e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f14de50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.008036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0034e56c-df05-4284-b715-fafd9b46ba8e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.091708 Aug 27 20:53:30.010194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 660/1396] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:29 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:30.019988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.022597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:30.045541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.046085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.046538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.047265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.047987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.048609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.392206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:30.406469 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-12511481-a273-4e85-af9f-2136b194c766 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1472 microversion: 2.1 time: 0.584969 Aug 27 20:53:30.408093 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 737/1397] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:29 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1472 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:30.422581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:30.437983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3099ba85-47be-49bb-89b5-7faa741f4de7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1472 microversion: 2.1 time: 0.426170 Aug 27 20:53:30.438903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 661/1398] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1472 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:30.665091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.665852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:30.675180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.682085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.682576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.687742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.688514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.689173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.782652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0251a9cd-157a-47f0-8f63-a7ceb1f96752 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.806317 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0251a9cd-157a-47f0-8f63-a7ceb1f96752 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/584875103" status: 202 len: 0 microversion: 2.1 time: 0.027436 Aug 27 20:53:30.807154 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 662/1399] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:53:30 2022] DELETE /compute/v2.1/flavors/584875103 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:53:30.816090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c179ad8-11b8-438c-aa31-c807e44739b3 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.845274 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c179ad8-11b8-438c-aa31-c807e44739b3 tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.033526 Aug 27 20:53:30.846331 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 663/1400] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:30.865756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-232291ba-fde6-4df5-86e0-a38677fd735e tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.886676 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-232291ba-fde6-4df5-86e0-a38677fd735e tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/415741767" status: 202 len: 0 microversion: 2.1 time: 0.024633 Aug 27 20:53:30.887288 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 664/1401] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:53:30 2022] DELETE /compute/v2.1/flavors/415741767 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:53:30.897814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62aed5fc-8846-4862-bc2b-058633994eda tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.906206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:30.910068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:30.922025 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e857e9e5-36b6-49a5-bcd2-c12910c3f2df tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 2342 microversion: 2.25 time: 0.260674 Aug 27 20:53:30.922289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62aed5fc-8846-4862-bc2b-058633994eda tempest-ServersWithSpecificFlavorTestJSON-1101270737 tempest-ServersWithSpecificFlavorTestJSON-1101270737-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029856 Aug 27 20:53:30.922620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 738/1402] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 2342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:30.923294 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 665/1403] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:30.943469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.943469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:30.951649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.952557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:30.959923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.960421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.961101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.962104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.962505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.962634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.962989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.966406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.966939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.967856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.968424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.968968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:30.982464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 HTTP/1.1 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:30.984164 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:30.985793 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e02e2a34-e1a3-4782-8faa-0af7c8a57b35'} Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:30.986686 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:30.988158 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:30.989748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:30.989748 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cabac15-c978-4a5c-878a-ad29b4492d46 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 404 len: 111 microversion: 2.1 time: 0.038950 Aug 27 20:53:30.989748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 666/1404] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:30 2022] DELETE /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:53:30.994914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:30.998912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:30.999435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:30.999874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.000744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.001211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.001642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.040253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfeed93e-c80f-4217-b5f7-f59cd63f592c tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049672 Aug 27 20:53:31.049127 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 667/1405] 10.222.0.40 () {60 vars in 1217 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:53:31.053981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.054678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: e02e2a34-e1a3-4782-8faa-0af7c8a57b35] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:31.061223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.061727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.062181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.062989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.063464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.063890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.085331 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 HTTP/1.1 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:31.087179 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:31.088718 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e02e2a34-e1a3-4782-8faa-0af7c8a57b35'} Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:31.089478 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. Aug 27 20:53:31.091086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.092239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance e02e2a34-e1a3-4782-8faa-0af7c8a57b35 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:31.092239 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66c81379-e10f-4c23-aec0-38b28de09142 tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35" status: 404 len: 111 microversion: 2.1 time: 0.038662 Aug 27 20:53:31.092239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 668/1406] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:31 2022] GET /compute/v2.1/servers/e02e2a34-e1a3-4782-8faa-0af7c8a57b35 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:31.102900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ffc71ab4-c8ad-49d3-ac86-31f1ff070fbb tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efd34c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.177155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ffc71ab4-c8ad-49d3-ac86-31f1ff070fbb tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.085707 Aug 27 20:53:31.177744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 669/1407] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:31 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:31.190898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.191776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:31.200107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.200607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.201179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.201890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.202473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.202902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.221396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f HTTP/1.1 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:31.223093 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.224787 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '696e2116-4af3-4fa5-8e68-37bdf89f1a7f'} Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:31.225623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.227270 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.228556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:31.228556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-750487bf-7ce2-4c78-b921-c9fc1b26053d tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 404 len: 111 microversion: 2.1 time: 0.042328 Aug 27 20:53:31.228556 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 670/1408] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:31 2022] DELETE /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:31.237244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:31.238916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.239593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] [instance: 696e2116-4af3-4fa5-8e68-37bdf89f1a7f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:31.247832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.248819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.249411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.250079 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3af4532-dc83-4fa0-83e0-7dbf72248901 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.321100 Aug 27 20:53:31.250735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.251464 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 739/1409] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:30 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:31.260167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.262065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.282485 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] HTTP exception thrown: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Request method failure captured: Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f HTTP/1.1 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNIYDNftHa4xYcJn_LcgTiQjjBYUZueYhmEQVjdEBsnJF6EEQeYDPcitHVVW2rnx2O5kFoVrljE1sHPBI_VORxjzRxgoYhTEQIH-R890lGVtVYmyKkA6f8hrYnStBoPY7wS05hOi5Siu0bjCVohkg9YhHEEcRXXlpu_Y155b3_eEw4 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:31.284530 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c61874976b164c9581dc6e4287f77389"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c61874976b164c9581dc6e4287f77389", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c61874976b164c9581dc6e4287f77389"}]}] Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c61874976b164c9581dc6e4287f77389 Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299 Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2fd3010448cc4d0c8b6da2dd09a55055 Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-250379299-project Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.285980 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '696e2116-4af3-4fa5-8e68-37bdf89f1a7f'} Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:31.286778 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. Aug 27 20:53:31.291271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:31.292886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] Returning 404 to user: Instance 696e2116-4af3-4fa5-8e68-37bdf89f1a7f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:31.292886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9bc5543-291e-41a2-8909-d4df118cd5ae tempest-ServersWithSpecificFlavorTestJSON-250379299 tempest-ServersWithSpecificFlavorTestJSON-250379299-project] 10.222.0.40 "GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f" status: 404 len: 111 microversion: 2.1 time: 0.054454 Aug 27 20:53:31.292886 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 671/1410] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:31 2022] GET /compute/v2.1/servers/696e2116-4af3-4fa5-8e68-37bdf89f1a7f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:31.431586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.432450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:31.448028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.449972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.452016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.453069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.453858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.457603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.463492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:31.464791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:31.474789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.475684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.476647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.477787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:31.478474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:31.479117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:31.807695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:31.814223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:31.818514 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9275a700-ee65-4f7a-b5f5-e258d3b00c6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1472 microversion: 2.1 time: 0.360802 Aug 27 20:53:31.819382 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 672/1411] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:31 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:31.851016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9303db9-1b3e-4289-8b10-bbeaec991c28 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1472 microversion: 2.1 time: 0.424059 Aug 27 20:53:31.854379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 740/1412] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:31 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:32.078834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-plugged", "status": "completed", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:32.102026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.102536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.105084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.124031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] Creating event network-vif-plugged:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:53:32.129705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5d0116ed-5f31-4489-b87a-25bc483f6d92 req-fd8742a5-cfb0-4d2a-844b-ebd8f7844776 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055456 Aug 27 20:53:32.132780 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 673/1413] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:32.192320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dcb7f58a-ff41-4911-94ae-ba760f07c229 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee655e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:32.245982 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dcb7f58a-ff41-4911-94ae-ba760f07c229 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.057499 Aug 27 20:53:32.253816 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 741/1414] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:32 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:32.273618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:32.274403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:32.281209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.281780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.282265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.283028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.283569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.284080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.541654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:32.550540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d35d2153-6eb0-48b4-b371-2fc5b6a445c2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.281656 Aug 27 20:53:32.553775 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 674/1415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:32 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:32.640927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1446df3-c151-4097-b737-85c00a26dec0", "device": "/dev/xvdb"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:32.644520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:32.658737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.659262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.659736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.660468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.661328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.662080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.843824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:32.844803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:32.858795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.859301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.859764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:32.861586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:32.862211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:32.863928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.099076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:33.108392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7e7038d-810c-4845-b41d-e923cfb3fce6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.269313 Aug 27 20:53:33.112432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 675/1416] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:32 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:33.118596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:33.123743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:33.130394 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3120af55-2a91-4f18-bb59-63917e2d876f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.494309 Aug 27 20:53:33.132098 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 742/1417] 10.222.0.40 () {62 vars in 1364 bytes} [Sat Aug 27 20:53:32 2022] POST /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 20:53:33.143576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:33.145331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:33.146333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.147390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:33.148291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:33.149316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.330738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:33.341493 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0c33b06-5218-43b7-be07-6b7a9e18101b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1430 microversion: 2.1 time: 0.227707 Aug 27 20:53:33.361519 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 676/1418] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:33 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1430 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:33.370410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-948666be-dacf-41b2-86cb-54770421d60e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efcedc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:33.449623 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-948666be-dacf-41b2-86cb-54770421d60e tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.086569 Aug 27 20:53:33.450787 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 677/1419] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:33 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:33.458314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-749b31dd-fbcf-4597-81a1-0f6dc0a3f084 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:33.465763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "186c3e48-0b29-41a1-8945-99b5683a77d7", "name": "network-vif-deleted", "tag": "d9ea94bf-3c52-4d93-ace7-88166a72448d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:33.476844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-749b31dd-fbcf-4597-81a1-0f6dc0a3f084 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.342051 Aug 27 20:53:33.479143 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 743/1420] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:53:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:33.496471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:33.496946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:33.497386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.514916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] Creating event network-vif-deleted:d9ea94bf-3c52-4d93-ace7-88166a72448d for instance 186c3e48-0b29-41a1-8945-99b5683a77d7 on nch2-master-1 Aug 27 20:53:33.533736 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4476f58e-b88b-452c-b27c-f0bb8c71e59b req-c0d255e9-884c-4bb1-ad4b-7b663d660b94 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081122 Aug 27 20:53:33.533986 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 678/1421] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:33.577010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:33.578035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:33.587971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:33.589216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:33.591085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.592168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:33.592975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:33.593800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:33.786148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:33.796862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c2f632f-a120-40a0-9db8-759bb7e03841 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.225891 Aug 27 20:53:33.797471 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 744/1422] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:33 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:34.135918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:34.137239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:34.152974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.154837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.157441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.158469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.160299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.160935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.368478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:34.370650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:34.381439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.385070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.387731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.388696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.389322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.390740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.391688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:34.403277 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0105aee0-be7b-4594-bdf8-ccd6f5727473 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.272993 Aug 27 20:53:34.404574 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 679/1423] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:34 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:34.467893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-30fa963f-28ac-4677-a46e-963f63b5b7c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f1d4d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:34.469940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.470847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.471549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.472597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 186c3e48-0b29-41a1-8945-99b5683a77d7 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:34.573327 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-30fa963f-28ac-4677-a46e-963f63b5b7c2 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.110753 Aug 27 20:53:34.575865 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 680/1424] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:34 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:34.586176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-157456321", "imageRef": "a4eaa218-add6-45f5-8dc3-ab79ce5eba38", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:34.596976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:34.608526 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8d1fa2b-fe4d-445f-9c6b-f42a1da20ff8 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 200 len: 1307 microversion: 2.1 time: 0.246250 Aug 27 20:53:34.613402 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 745/1425] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:34 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:34.667172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:53:34.818411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:34.819442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:34.835614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.838262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.841443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.843995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:34.845194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:34.847015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:34.986955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] Request method failure captured: Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 142 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRMSqN62ZazknnnKCsx6BrrtDZd5TxLX6YPE3cxYKMQd98vDE5RwVoLglSIL4QkBjBStW-47BiKNXw7fElXP5gJgRgRB2VvU6EBSgyVjqBxZm6N4IdIE-lW6GbC6u92PR7Lg-6ShO2CprbzsPOB2CMQLXYOqRFjXr15dSbg6Otrlpw Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 896e9c0a054d4da6b004f2dc11785b64 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FlavorsV2NegativeTest-1782373825 Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:34.989320 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/896e9c0a054d4da6b004f2dc11785b64"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/896e9c0a054d4da6b004f2dc11785b64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_896e9c0a054d4da6b004f2dc11785b64", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/896e9c0a054d4da6b004f2dc11785b64"}]}] Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FlavorsV2NegativeTest-1782373825 Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 896e9c0a054d4da6b004f2dc11785b64 Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1782373825 Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FlavorsV2NegativeTest-1782373825-project Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8acaa89e2c3c44cc9cbb3df218858961 Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FlavorsV2NegativeTest-1782373825-project Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-157456321", "imageRef": "a4eaa218-add6-45f5-8dc3-ab79ce5eba38", "flavorRef": "452"}} Aug 27 20:53:34.990961 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: exception: Flavor's memory is too small for requested image. Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-157456321', 'imageRef': 'a4eaa218-add6-45f5-8dc3-ab79ce5eba38', 'flavorRef': '452'}}} Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:34.992018 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:34.993461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc6ae06d-a70a-4ca7-9406-013cc286bee3 tempest-FlavorsV2NegativeTest-1782373825 tempest-FlavorsV2NegativeTest-1782373825-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.413604 Aug 27 20:53:34.996355 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 681/1426] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:53:34 2022] POST /compute/v2.1/servers => generated 93 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:53:35.079133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:35.089796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e8cb0b6-4b45-4b8f-83fb-7916690fd3ff tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.275743 Aug 27 20:53:35.091191 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 746/1427] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:34 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:35.425755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:35.427035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:35.446428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.457206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.458558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.458851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.459315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.464109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.592083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e94604d4-b93d-45b0-b7a9-9ca993e0d924 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee70ee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:35.650439 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e94604d4-b93d-45b0-b7a9-9ca993e0d924 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.062336 Aug 27 20:53:35.658155 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 747/1428] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:35 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:35.665607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:35.666533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 186c3e48-0b29-41a1-8945-99b5683a77d7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:35.674519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.675187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.675823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.687162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.687552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.689292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.716734 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 HTTP/1.1 Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:35.719004 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. Aug 27 20:53:35.720654 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '186c3e48-0b29-41a1-8945-99b5683a77d7'} Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:35.721594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. Aug 27 20:53:35.723041 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:35.724986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 186c3e48-0b29-41a1-8945-99b5683a77d7 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:35.725379 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed36f447-e040-4f42-9a21-4ed8e8dd907d tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7" status: 404 len: 111 microversion: 2.1 time: 0.065500 Aug 27 20:53:35.725952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:35.727096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 748/1429] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:35 2022] GET /compute/v2.1/servers/186c3e48-0b29-41a1-8945-99b5683a77d7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:35.736410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:35.737331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:35.737448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81da690f-c03f-4862-8379-a432a7b0d0fd tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.316324 Aug 27 20:53:35.751475 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 682/1430] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:35 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:35.757925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.759201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.760704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.761651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.762625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.763237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.812646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:35.962801 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98787355-8b80-45cd-9725-a45dcb807efa tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 204 len: 0 microversion: 2.1 time: 0.230429 Aug 27 20:53:35.963909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 749/1431] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:35 2022] DELETE /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:35.976044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:35.980427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:35.994160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.994782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.995684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:35.996414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:35.996869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:35.997294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:36.113771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:36.114609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:36.127547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:36.130846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:36.131471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:36.133049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:36.147680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:36.149667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:36.191066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:36.204200 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbb8c517-5b87-4c48-8f65-9104e774dd2c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1473 microversion: 2.1 time: 0.234812 Aug 27 20:53:36.205046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 683/1432] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:35 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:36.435750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:36.455204 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c19a194-f073-4f86-91d3-c16b59a9b2a0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.345871 Aug 27 20:53:36.467809 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 750/1433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:36 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:36.665551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79e96301-b86e-4f98-ac7e-b64f86de1b81 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efceee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:36.748610 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79e96301-b86e-4f98-ac7e-b64f86de1b81 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.087180 Aug 27 20:53:36.751435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 684/1434] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:36 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:36.773854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:36.774800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:36.792574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:36.793183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:36.794742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:36.796666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:36.797152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:36.801647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.125611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f4d948-81e4-4742-a469-225558c65b32", "name": "network-vif-plugged", "status": "completed", "tag": "ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:37.159730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:37.161497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:37.162431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:37.163006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.175289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-53d00ea0-c83e-4fa1-833b-fe6e86646109 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.407991 Aug 27 20:53:37.177195 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 751/1435] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:36 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:37.230035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:37.230862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:37.245110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:37.245463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] Creating event network-vif-plugged:ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42 for instance 72f4d948-81e4-4742-a469-225558c65b32 on nch2-master-1 Aug 27 20:53:37.246192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:37.247967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.250445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:37.252367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:37.253208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.281630 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-672d49bf-9574-4e01-a043-d09c696811a5 req-c2fae8b9-1156-4766-9415-26621ac2578e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151803 Aug 27 20:53:37.283270 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 685/1436] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:53:37.492377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:37.494516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:37.512265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:37.516969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:37.519546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.521916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:37.522625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:37.524513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:37.731963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:37.746034 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97fbbe7f-b59c-4c82-a8ac-88163fbdebf2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1473 microversion: 2.1 time: 0.520555 Aug 27 20:53:37.760409 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 752/1437] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:37 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1473 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:37.774258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe2b81f5-dd75-4b0d-813b-9f757cb2e61a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f0558b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:37.841948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:37.856188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-13427500-5009-4c50-a5cb-c0543f479213 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.379354 Aug 27 20:53:37.873222 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 686/1438] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:37 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:37.891060 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe2b81f5-dd75-4b0d-813b-9f757cb2e61a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.120209 Aug 27 20:53:37.900236 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 753/1439] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:37 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:38.199441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:38.200417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:38.208524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.209619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.210297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:38.211667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.213281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.214051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:38.421624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:38.433214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15eb4591-48d9-4419-8657-e5089011b7da tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.238947 Aug 27 20:53:38.440919 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 687/1440] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:38 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:38.766896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:38.767722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:38.783817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.788250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.789143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:38.791189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.796534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.797415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:38.880078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:38.881416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:38.891916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.894706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.896133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:38.902752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:38.903590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:38.904229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:39.236838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:39.248491 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05939156-ed92-4493-a48f-6082659b6208 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1473 microversion: 2.1 time: 0.486076 Aug 27 20:53:39.263611 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 754/1441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:38 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1473 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:39.274323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2646a304-cb19-4c9b-b1b6-e86a90bd3486 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eef7d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:39.310724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:39.325064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70dbab2c-f1e3-47a7-a7b8-65a5138c3828 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1324 microversion: 2.1 time: 0.448952 Aug 27 20:53:39.325666 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 688/1442] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:38 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:39.369916 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2646a304-cb19-4c9b-b1b6-e86a90bd3486 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.105069 Aug 27 20:53:39.378653 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 755/1443] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:39 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:39.457355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:39.457983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:39.472246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:39.477110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:39.479908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:39.484663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:39.485243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:39.485701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:39.781045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba52b75-cc52-4020-90d1-88de79056aa5", "name": "network-vif-deleted", "tag": "03939b32-256f-4490-bfe1-6d0078277650"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:39.824209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:39.828777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:39.832280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:39.866230 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] Creating event network-vif-deleted:03939b32-256f-4490-bfe1-6d0078277650 for instance 5ba52b75-cc52-4020-90d1-88de79056aa5 on nch2-master-1 Aug 27 20:53:39.894140 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7c94d457-b96b-4df1-a5c1-1e327d800273 req-c88c3ac4-132d-4753-9e56-da6141908fc6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117560 Aug 27 20:53:39.894797 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 756/1444] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:53:40.001802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:40.002827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:40.020426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.022181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.024872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.026279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.028258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.028870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.106555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:40.118726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:40.147899 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c812a44f-7403-4452-9d0d-ef651b488e49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.694136 Aug 27 20:53:40.161065 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 689/1445] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:39 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:40.270368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:40.280675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:40.325001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:40.329968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.332212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.333125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.334836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.344216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.345481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.362720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad4cdcd7-515a-4de1-8537-4fd4da440a22 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 2420 microversion: 2.25 time: 0.366984 Aug 27 20:53:40.363567 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 757/1446] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:39 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 2420 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:40.379941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:40.380745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:40.391554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.392194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.395385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.396271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.396839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.397367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.410807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:40.458889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:40.464256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:40.467591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:40.468912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 5ba52b75-cc52-4020-90d1-88de79056aa5 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:41.021579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:41.117853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:41.133106 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4fe8110f-d67f-4170-b83d-8bcc052ac4b3 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 200 len: 1307 microversion: 2.1 time: 0.866731 Aug 27 20:53:41.147324 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 690/1447] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:40 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 1307 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:41.153426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16b37832-f3a7-4975-9bf7-9da13f384acc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f350e50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:41.242983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16b37832-f3a7-4975-9bf7-9da13f384acc tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.094001 Aug 27 20:53:41.243626 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 691/1448] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:41 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:41.255120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:41.258069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:41.265133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:41.265957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:41.266395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:41.267289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:41.267577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:41.268183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:41.299393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'flavor' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:41.328033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Going to try to live migrate instance to nch2-master-1 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:53:41.537446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:41.551771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-156d946a-13b9-4719-9fb5-9a5967b1a1fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1520 microversion: 2.1 time: 1.185462 Aug 27 20:53:41.554475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 758/1449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:40 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1520 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:41.568587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:41.571724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:41.602398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:41.604018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:41.606766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:41.608138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:41.611134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:41.611940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.120231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:42.128582 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc78b357-5eb2-4d6c-aca1-c1f55e69a79c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.570786 Aug 27 20:53:42.132047 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 759/1450] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:41 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:42.161398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:42.162777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:42.175189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.175687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.176118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.176823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.177269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.177684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.614206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:42.625871 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03433b36-b2db-407f-ab3a-c1d16c806f6a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1520 microversion: 2.1 time: 0.480572 Aug 27 20:53:42.626881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 760/1451] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:42 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:42.635107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:42.636959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5ba52b75-cc52-4020-90d1-88de79056aa5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:42.645872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.646749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.647191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.648385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.648841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.649261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.669651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 HTTP/1.1 Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:42.671914 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. Aug 27 20:53:42.673662 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5ba52b75-cc52-4020-90d1-88de79056aa5'} Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:42.674610 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. Aug 27 20:53:42.676159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:42.679385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 5ba52b75-cc52-4020-90d1-88de79056aa5 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:42.680512 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b6bb65d-c9cc-46c6-9344-75058022b6fd tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5" status: 404 len: 111 microversion: 2.1 time: 0.051916 Aug 27 20:53:42.689019 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 761/1452] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:42 2022] GET /compute/v2.1/servers/5ba52b75-cc52-4020-90d1-88de79056aa5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:42.697407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5db58a6-2ee5-4fd6-8a41-6ffaf172b690 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eeb4280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:42.765115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5db58a6-2ee5-4fd6-8a41-6ffaf172b690 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.073230 Aug 27 20:53:42.765945 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 762/1453] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:42 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:42.773078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-491672690"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:42.775768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:42.792872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.793896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.794616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:42.795649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:42.796283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:42.797390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:43.123314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-633d176e-8eea-4245-afa3-d938e737df89 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32/action" status: 202 len: 0 microversion: 2.1 time: 0.354860 Aug 27 20:53:43.136696 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 763/1454] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:53:42 2022] POST /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:53:43.148034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:43.148736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:43.175518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:43.176549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:43.177163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:43.178107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:43.178747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:43.179546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:43.243060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:43.437728 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf32109e-9737-4743-96e6-9762b1ff0eb1 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 204 len: 0 microversion: 2.1 time: 0.294307 Aug 27 20:53:43.440382 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 764/1455] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:43 2022] DELETE /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:43.457059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-beacbea5-cbf9-470d-b569-ee60c59fee55 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff84ee6a5e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:43.657561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-beacbea5-cbf9-470d-b569-ee60c59fee55 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53" status: 204 len: 0 microversion: 2.1 time: 0.214767 Aug 27 20:53:43.658194 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 765/1456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:43 2022] DELETE /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:43.664590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:43.668788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:43.690652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:43.692961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:43.695274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:43.697008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:43.699528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:43.701976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.120321 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4783271-a085-4abf-bb8b-7874c417c2a6 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/action" status: 202 len: 0 microversion: 2.25 time: 2.868762 Aug 27 20:53:44.120993 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 692/1457] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:53:41 2022] POST /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/action => generated 0 bytes in 2877 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:44.126842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:44.127604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:44.149137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.149657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.150109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.150851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.151309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.151765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.161215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:44.175859 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c21c89de-7a8d-4250-b38f-b142f450d59f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.514227 Aug 27 20:53:44.177286 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 766/1458] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:43 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:44.185394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e66d890e-94f8-41f9-8dc9-50dd2875e666 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff84ee70670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:44.240148 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e66d890e-94f8-41f9-8dc9-50dd2875e666 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Image not found. Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e66d890e-94f8-41f9-8dc9-50dd2875e666 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53 HTTP/1.1 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:44.249466 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '9f06de22-1846-4c41-a11d-edc1d1046e53'} Aug 27 20:53:44.251057 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:53:44.252089 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f06de22-1846-4c41-a11d-edc1d1046e53 Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:53:44.253413 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f06de22-1846-4c41-a11d-edc1d1046e53 could not be found. Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:53:44.254817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:44.256140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e66d890e-94f8-41f9-8dc9-50dd2875e666 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:44.257673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e66d890e-94f8-41f9-8dc9-50dd2875e666 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53" status: 404 len: 62 microversion: 2.1 time: 0.072650 Aug 27 20:53:44.257673 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 767/1459] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:44 2022] GET /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:53:44.257895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:44.265133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db311fac-7319-4c7e-9384-e6295da6159b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee75b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:44.388624 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db311fac-7319-4c7e-9384-e6295da6159b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.133265 Aug 27 20:53:44.389548 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 768/1460] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:44 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:44.401217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:44.404587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:44.420475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.421288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.421926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.423410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.424087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.424697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.485366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc21b47c-779f-4988-88dd-ff8a42d7b3a6 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 204 len: 0 microversion: 2.1 time: 0.362591 Aug 27 20:53:44.486412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 693/1461] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:44 2022] DELETE /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:44.494241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:44.495314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:44.503186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.504006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.504729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:44.505682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:44.506345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:44.506980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:45.204105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:45.217071 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea7129e7-e444-4612-ae8a-75c769054487 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1532 microversion: 2.1 time: 0.728772 Aug 27 20:53:45.232427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 694/1462] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:44 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1532 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:45.237822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:45.238725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:45.246163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:45.246995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:45.247730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:45.248680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:45.249373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:45.250026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:45.620350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:45.638842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:45.641359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:45.645106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5059cd22-38eb-484c-a8a6-cdb2b46f4c33 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 1.254374 Aug 27 20:53:45.646966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 769/1463] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:44 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:45.654592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:45.655529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:45.662358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:45.665081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:45.666386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:45.667398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:45.668084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:45.669232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:45.856217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:45.874786 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80b0d5b5-c274-43b7-a027-2119e61e8140 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1474 microversion: 2.1 time: 0.639967 Aug 27 20:53:45.875954 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 695/1464] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:45 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1474 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:45.882181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53e4bc52-f5f2-4b12-a933-3dc5de238c96 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f2c68b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:45.986611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-53e4bc52-f5f2-4b12-a933-3dc5de238c96 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.109068 Aug 27 20:53:45.996404 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 696/1465] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:45 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:46.238890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:46.239617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:46.253378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.254242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.254852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.255832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.256445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.257020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.368466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:46.396234 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ce4ae740-3edb-4b46-b3a1-248831e4949e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.747859 Aug 27 20:53:46.402331 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 770/1466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:45 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:46.589146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31b082-a78d-469f-a66f-1c9bbe90eb3f", "name": "network-vif-deleted", "tag": "56d396e9-4d65-4d5e-a190-b5f8729970d5"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:46.643235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.650588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.651128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.695947 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] Creating event network-vif-deleted:56d396e9-4d65-4d5e-a190-b5f8729970d5 for instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f on nch1-master-1 Aug 27 20:53:46.702272 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-00b5888e-e0ea-46b1-8fc5-61a45527a5dd req-f90a69b7-2c21-4fac-90c7-2887d4a0044b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127724 Aug 27 20:53:46.703952 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 771/1467] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:46.720773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:46.722611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:46.734365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.736569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.737396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.738985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.739695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.740415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.909462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:46.932028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2afd52c9-0c28-4808-bc7d-8e11afd7321d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1538 microversion: 2.1 time: 0.696480 Aug 27 20:53:46.934051 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 697/1468] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:46 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1538 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:46.945229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:46.946461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:46.963477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.964425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.965254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:46.971142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:46.972457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:46.973495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:47.087036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:47.098334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:47.101336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:47.117088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 5b31b082-a78d-469f-a66f-1c9bbe90eb3f {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:47.283283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:47.314073 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a94cf02c-1e6a-4bb9-80bd-fa9c7a9cefcc tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 200 len: 1309 microversion: 2.1 time: 0.376619 Aug 27 20:53:47.316653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 698/1469] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:46 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:47.336198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d14ff6c4-547e-4bae-8de1-a219e02f0783 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f204a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:47.452431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d14ff6c4-547e-4bae-8de1-a219e02f0783 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.132792 Aug 27 20:53:47.455541 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 699/1470] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:47 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:47.464209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:47.465092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:47.475139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:47.476070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:47.477001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:47.477928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:47.479166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:47.479799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:47.485800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:47.509805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:47.512151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:47.513688 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3dc68f4d-c678-4d36-ac35-dcede2f399e2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.805496 Aug 27 20:53:47.519865 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 772/1471] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:46 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:47.955027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:47.956537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:47.972078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:47.977457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:47.978307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:47.979287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:47.982631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:47.983382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:48.096850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:48.108841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f776eb6d-ab82-43eb-ade8-2efb7191c63a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.651585 Aug 27 20:53:48.114997 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 700/1472] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:47 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:48.338775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:48.340790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5b31b082-a78d-469f-a66f-1c9bbe90eb3f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:48.352531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:48.354120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:48.354771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:48.355856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:48.356496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:48.357157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:48.388762 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f HTTP/1.1 Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:53:48.393382 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. Aug 27 20:53:48.394753 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5b31b082-a78d-469f-a66f-1c9bbe90eb3f'} Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:48.395542 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. Aug 27 20:53:48.396887 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:53:48.401864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 5b31b082-a78d-469f-a66f-1c9bbe90eb3f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:48.403059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ac8a748-e3e2-46f8-b8f5-305565d1e10e tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f" status: 404 len: 111 microversion: 2.1 time: 0.068463 Aug 27 20:53:48.407630 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 701/1473] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:48 2022] GET /compute/v2.1/servers/5b31b082-a78d-469f-a66f-1c9bbe90eb3f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:48.418114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:48.419216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:48.427934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:48.428833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:48.429643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:48.431606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:48.432301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:48.432946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:49.012649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:49.056986 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b90f272c-899f-4b58-a805-39e241e4050f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1538 microversion: 2.1 time: 1.100294 Aug 27 20:53:49.076750 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 773/1474] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:47 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1538 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:49.097807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ccc7ffd9-f9b9-435e-b74e-f66a0e8ae212 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ee75940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:49.191475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ccc7ffd9-f9b9-435e-b74e-f66a0e8ae212 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.109359 Aug 27 20:53:49.192639 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 774/1475] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:49 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:49.203587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:49.206698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:49.227124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:49.228349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:49.229297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:49.230213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:49.231074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:49.231781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:49.562777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:49.572046 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cacf13bb-aad2-4298-932f-5b228b466418 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1475 microversion: 2.1 time: 1.159984 Aug 27 20:53:49.573118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 702/1476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:48 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1475 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:49.592019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:49.593432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:49.597233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:49.611471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:49.613433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:49.619050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:49.622223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:49.622876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:49.623546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:49.955677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:49.973067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:49.974519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:49.975760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ef27aca-0e3e-4b05-adb9-e03b80b3c15c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.777350 Aug 27 20:53:49.976422 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 775/1477] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:49 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:49.999258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d005c5-6ff4-4aa3-a2e8-40489377f369", "name": "network-vif-deleted", "tag": "3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:50.030251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.031413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.032019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.069811 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] Creating event network-vif-deleted:3b7a00d9-a4d5-4ae2-9beb-d65d45a47e59 for instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 on nch2-master-1 Aug 27 20:53:50.078261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-31dae0df-0eb8-4d38-9861-16c971a05951 req-05385178-ed43-40b1-a45c-c348f2e583ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100536 Aug 27 20:53:50.079525 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 776/1478] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:50.089232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:50.091795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:50.110485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.111204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.111846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.113028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.113708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.114394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.160761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:50.172171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59c7b40c-d871-4ae9-98d7-e73f248b5948 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.588172 Aug 27 20:53:50.180028 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 703/1479] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:49 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:50.206898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c4219b0-e82e-42ab-9375-9bccb00cea59 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f3a0dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:50.299775 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c4219b0-e82e-42ab-9375-9bccb00cea59 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.097268 Aug 27 20:53:50.300929 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 704/1480] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:50 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:53:50.598088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:50.598768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:50.615024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.615616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.616072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.617449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.623964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.624585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.696446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:50.696952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:50.697406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:50.697874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 68d005c5-6ff4-4aa3-a2e8-40489377f369 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:53:51.275232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:51.287816 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c114a13-f5b4-490d-b3cb-84bbe3b0d916 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 200 len: 1309 microversion: 2.1 time: 0.694398 Aug 27 20:53:51.289738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 705/1481] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:50 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 1309 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:51.299950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:51.300870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:51.307951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:51.308964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:51.309948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:51.311986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:51.312765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:51.313475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:51.354049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:51.793392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:51.828362 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac8fe6be-f595-4379-b454-35d1bce5e8e2 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1538 microversion: 2.1 time: 1.743764 Aug 27 20:53:51.830435 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 777/1482] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:50 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1538 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:51.851711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:51.852667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:51.872252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:51.873336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:51.873973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:51.875832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:51.877330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:51.877934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.073813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:52.100356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:52.103998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:52.107555 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-776c5167-3b22-47e6-b86d-bca2c22871c6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.812268 Aug 27 20:53:52.109843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 706/1483] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:51 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:52.130403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60c7efee-e022-4a9b-a226-beb6565fb253 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84efcea60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.231561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60c7efee-e022-4a9b-a226-beb6565fb253 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.117662 Aug 27 20:53:52.238572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 707/1484] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:52 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:52.249277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f4d948-81e4-4742-a469-225558c65b32", "name": "network-vif-plugged", "status": "completed", "tag": "ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:52.262072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.262878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.263942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.277720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] Creating event network-vif-plugged:ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42 for instance 72f4d948-81e4-4742-a469-225558c65b32 on nch2-master-1 Aug 27 20:53:52.283919 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-83ebbc76-3db0-4e21-a510-d2897883598c req-f10e04e0-f9e6-45b9-b681-4135e0ae59cf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043312 Aug 27 20:53:52.285368 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 708/1485] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:52.403017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:52.415102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:52.422193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a9bd5ac-fd1f-4190-acc7-9e86b8f41311 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.589929 Aug 27 20:53:52.425160 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 778/1486] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:51 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:52.441905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.444711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 68d005c5-6ff4-4aa3-a2e8-40489377f369] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:52.457519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.458300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.459955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.461016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.463386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.463728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.473565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-100566f7-6653-4413-9a60-b57aa48f7fe4 tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1271569381", "id": 1527360430, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:52.500226 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 HTTP/1.1 Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:52.502220 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. Aug 27 20:53:52.503869 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '68d005c5-6ff4-4aa3-a2e8-40489377f369'} Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:52.504808 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. Aug 27 20:53:52.506240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:52.509539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 68d005c5-6ff4-4aa3-a2e8-40489377f369 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:52.510419 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5132c41-db27-471d-b69f-e48f9720013a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369" status: 404 len: 111 microversion: 2.1 time: 0.079964 Aug 27 20:53:52.512368 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-100566f7-6653-4413-9a60-b57aa48f7fe4 tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.225516 Aug 27 20:53:52.512780 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 779/1487] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:52 2022] GET /compute/v2.1/servers/68d005c5-6ff4-4aa3-a2e8-40489377f369 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:52.521271 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 709/1488] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:53:52 2022] POST /compute/v2.1/flavors => generated 468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:53:52.527063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-632799cb-4b95-40ba-9a8a-b2683e9c54db tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.564829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:52.576193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-632799cb-4b95-40ba-9a8a-b2683e9c54db tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/737f21a1-042b-441a-bef2-cd6e92955251" status: 204 len: 0 microversion: 2.1 time: 0.054029 Aug 27 20:53:52.577029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 780/1489] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 20:53:52 2022] DELETE /compute/v2.1/os-server-groups/737f21a1-042b-441a-bef2-cd6e92955251 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:52.604516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.604971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:52.622733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.623942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.625104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.625875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.626351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.626770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.659810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:52.708299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bedc1294-60cb-4bdb-a202-db12c6e9bb10 tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.732050 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bedc1294-60cb-4bdb-a202-db12c6e9bb10 tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] 10.222.0.40 "GET /compute/v2.1/flavors/1527360430" status: 200 len: 468 microversion: 2.61 time: 0.209590 Aug 27 20:53:52.749596 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 710/1490] 10.222.0.40 () {60 vars in 1199 bytes} [Sat Aug 27 20:53:52 2022] GET /compute/v2.1/flavors/1527360430 => generated 468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:53:52.754470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75a708fa-2e97-43a0-8a0b-7722787d127a tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] Action: 'update', calling method: .version_select at 0x7ff85510ed30>, body: {"flavor": {"description": "new"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:52.831122 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-368d956b-a5c1-43b6-8084-40b3d3c8c771 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 204 len: 0 microversion: 2.1 time: 0.233689 Aug 27 20:53:52.833184 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 781/1491] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:52 2022] DELETE /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:52.856827 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75a708fa-2e97-43a0-8a0b-7722787d127a tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] 10.222.0.40 "PUT /compute/v2.1/flavors/1527360430" status: 200 len: 469 microversion: 2.61 time: 0.105850 Aug 27 20:53:52.857057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.857678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:52.858362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 711/1492] 10.222.0.40 () {62 vars in 1219 bytes} [Sat Aug 27 20:53:52 2022] PUT /compute/v2.1/flavors/1527360430 => generated 469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:53:52.873570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.874068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.874554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:52.874682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.875918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.875918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.876431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.876604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:52.888752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.889675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.890314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.891428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:52.892045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:52.892637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:52.909861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:53.057157 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-461fbf3f-6288-4d9e-aeb7-f97e1c7966ab tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 204 len: 0 microversion: 2.1 time: 0.218088 Aug 27 20:53:53.062166 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 782/1493] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:52 2022] DELETE /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:53.068819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b119662-709a-4119-90f8-bbaf6a81eb5f tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.098116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b119662-709a-4119-90f8-bbaf6a81eb5f tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.034172 Aug 27 20:53:53.099558 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 783/1494] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:53.104942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.106150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:53.124625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.125137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.125569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.126284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.126731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.127146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.319546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:53.331599 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f327951-147d-4ef4-8191-c38bcf01e0a5 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1520 microversion: 2.1 time: 0.461415 Aug 27 20:53:53.332464 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 712/1495] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:52 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:53.339265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ba9c812-3565-4bca-964e-33d86e12ad51 tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.362343 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ba9c812-3565-4bca-964e-33d86e12ad51 tempest-FlavorsV261TestJSON-436605227 tempest-FlavorsV261TestJSON-436605227-project] 10.222.0.40 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.028120 Aug 27 20:53:53.363428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 713/1496] 10.222.0.40 () {60 vars in 1166 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:53.368859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.369767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:53.376226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.376986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.377628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.378688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.379360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.379990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.567773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:53.580278 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fd80d95-52db-4ec1-9be8-a7f1e0389623 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1474 microversion: 2.1 time: 0.479378 Aug 27 20:53:53.583199 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 784/1497] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1474 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:53.597288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-329a8dfa-ee16-40a8-b033-45f4ee1e95b4 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84edc0f70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.674929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-329a8dfa-ee16-40a8-b033-45f4ee1e95b4 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.089167 Aug 27 20:53:53.675657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 785/1498] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:53.691969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.695897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:53.709456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.710427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.711218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.718317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.719170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.722331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.735377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:53.752050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:53.753589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:53.754825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdfcde33-093e-458f-9226-ab6d65f5bb27 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.390275 Aug 27 20:53:53.764533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:53:53.766792 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 714/1499] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:53.774979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e25c0f44-27bc-4dc7-8999-22759cc81bdb tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.813322 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e25c0f44-27bc-4dc7-8999-22759cc81bdb tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1527360430" status: 202 len: 0 microversion: 2.61 time: 0.045536 Aug 27 20:53:53.818692 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 715/1500] 10.222.0.40 () {60 vars in 1202 bytes} [Sat Aug 27 20:53:53 2022] DELETE /compute/v2.1/flavors/1527360430 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:53.824303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:53.825239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:53.835985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.836895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.837546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.838500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:53.839120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:53.839805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:53.934569 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08925702-e746-4671-b5b0-3ce0f38dfe96 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 204 len: 0 microversion: 2.1 time: 0.241665 Aug 27 20:53:53.934569 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 786/1501] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:53:53 2022] DELETE /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:53:54.046460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4d1f14a-a9d9-469a-b896-c1cdce9894ee tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Action: 'create', calling method: .version_select at 0x7ff84eeb48b0>, body: {"pool": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:54.056635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:54.069928 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d681bcd-6638-4213-ba95-c999c09ec368 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.249826 Aug 27 20:53:54.072911 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 716/1502] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:53 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:54.077947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03486dbd-4309-4003-a3af-ec4759eb80d3 tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:54.130784 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03486dbd-4309-4003-a3af-ec4759eb80d3 tempest-FlavorsV261TestJSON-548985886 tempest-FlavorsV261TestJSON-548985886-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.058255 Aug 27 20:53:54.135936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 717/1503] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 20:53:54 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:54.143575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:54.144481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:54.152804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:54.154371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:54.154858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:54.155743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:54.155966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:54.156835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:54.466698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:54.479033 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-65e3b00b-457c-4a8e-853f-a970f11ddd00 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1526 microversion: 2.1 time: 0.341763 Aug 27 20:53:54.480131 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 718/1504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:54 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1526 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:54.612550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:54.612849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:54.625702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:54.626812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:54.627484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:54.628397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:54.629427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:54.630297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:54.889960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:54.905154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd0fbc5b-9dc2-4043-85af-79b748c6e659 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1474 microversion: 2.1 time: 0.300245 Aug 27 20:53:54.919569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 719/1505] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:54 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:54.924213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-acaf1207-d0cd-4ea0-8070-f18280b4e389 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84f3504c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:54.998249 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-acaf1207-d0cd-4ea0-8070-f18280b4e389 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1428 microversion: 2.1 time: 0.081647 Aug 27 20:53:54.999170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 720/1506] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:54 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:55.011251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:55.011927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:55.039218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.048190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.048663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:55.049481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.049957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.050407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:55.308343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:55.315678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:55.317488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:55.322421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae8ebc1d-9a00-4604-aefe-c24723ea6c05 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.318809 Aug 27 20:53:55.323738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 721/1507] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:54 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:55.328837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:55.329532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:55.345434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.346336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.347027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:55.347963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.348600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.349190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:55.635535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:55.649134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd25cfbd-a041-4bb3-b3cf-43c9f98eb0f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.323933 Aug 27 20:53:55.649797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 722/1508] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:55 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:55.657915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:55.658559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:55.688350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.688859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.689299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:55.690268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:55.690978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:55.691431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.000169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:56.013455 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-802acd78-e950-4f61-adae-f6fb1e67e170 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1526 microversion: 2.1 time: 0.362538 Aug 27 20:53:56.015192 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 723/1509] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:55 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1526 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:56.041834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f4d948-81e4-4742-a469-225558c65b32", "name": "network-vif-unplugged", "status": "completed", "tag": "ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:56.070523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.072011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.072796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.096360 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] Creating event network-vif-unplugged:ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42 for instance 72f4d948-81e4-4742-a469-225558c65b32 on nch2-master-1 Aug 27 20:53:56.110396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6fd62e3c-2e66-48cc-b1ff-1fcfcc032c05 req-a1bc8254-43bf-4d4e-95b3-7574daf90453 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093731 Aug 27 20:53:56.116561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 724/1510] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:56.123939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.125658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:56.133036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.134087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.134610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.136135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.136875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.137575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.357593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4d1f14a-a9d9-469a-b896-c1cdce9894ee tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.425601 Aug 27 20:53:56.359507 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 787/1511] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:53:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:56.365020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bdb66f5f-843f-4f59-a5d9-b8ae92c1ff7b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84edc0670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.384542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:56.393767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e540a08-ad50-4d77-bf5d-0fdca47cc1c2 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1474 microversion: 2.1 time: 0.275749 Aug 27 20:53:56.407242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 725/1512] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:56.411509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.412146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:56.425253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.425782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.425907 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bdb66f5f-843f-4f59-a5d9-b8ae92c1ff7b tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1437 microversion: 2.1 time: 0.064967 Aug 27 20:53:56.426229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.426977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.427143 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 788/1513] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1437 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:56.427616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.428059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.432626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d8b2a09f-93fc-4e37-84cb-610968123331 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84ee75dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.687403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:56.696797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:56.702578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:56.704522 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3249a69-2c6a-4518-8a4f-9c681d5b2b4c tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.304616 Aug 27 20:53:56.713902 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d8b2a09f-93fc-4e37-84cb-610968123331 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/3cd6c155-322b-4954-9f59-c5efb42a6f9f" status: 200 len: 142 microversion: 2.1 time: 0.277510 Aug 27 20:53:56.713902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 789/1514] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/os-floating-ips/3cd6c155-322b-4954-9f59-c5efb42a6f9f => generated 142 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:56.719107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34008bbe-58db-48b5-b43b-fc5c9362c262 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84eda0af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.722207 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 726/1515] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:56.727816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:56.728741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:56.737523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.738189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.739078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.740365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:56.740836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:56.741311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:56.791753 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34008bbe-58db-48b5-b43b-fc5c9362c262 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 200 len: 1437 microversion: 2.1 time: 0.083324 Aug 27 20:53:56.792507 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 790/1516] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:56.805648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e4d58f9-7fd1-4f12-9450-584f0e1c68d8 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84ee705e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:57.319070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:57.333131 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16781434-1d7d-4f94-9f9f-194236a68ff7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.609730 Aug 27 20:53:57.334936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 727/1517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:57.342302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:57.345268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:57.352700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.353273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.354092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.354862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.355321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.355770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.387537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e4d58f9-7fd1-4f12-9450-584f0e1c68d8 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.585541 Aug 27 20:53:57.396862 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 791/1518] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:53:56 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:57.402547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:57.403578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:57.410890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.411775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.412579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.413809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.414569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.415224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.586484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:57.597312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d39822c-e2b1-46f7-a8d0-515b1c198725 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1480 microversion: 2.1 time: 0.260119 Aug 27 20:53:57.597921 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 728/1519] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:57 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1480 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:57.615901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e434cce6-4f8b-4e54-90a6-24ab717b87bf tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84f373b80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:57.618516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:57.627245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84940763-aa28-48db-8e55-b31b1d913b69 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1526 microversion: 2.1 time: 0.228868 Aug 27 20:53:57.628109 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 792/1520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:57 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:57.633084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:57.633698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:57.639827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.640692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.641323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.642194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:57.642716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:57.643147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:57.878231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:57.886516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f6d677e-b50e-4503-92fe-e1476c72bd43 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1474 microversion: 2.1 time: 0.257199 Aug 27 20:53:57.887198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 793/1521] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:57 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:58.025075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Calling method '.version_select at 0x7ff84ee75280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:58.028678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.029148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.029777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:58.030702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.031204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.032335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:58.060872 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-23e846d3-3c87-4c81-9acc-f8c08f995dd8 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.172408 Aug 27 20:53:58.061888 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 794/1522] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 20:53:57 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:58.066878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:58.067509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:58.075435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.076177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.076626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:58.077337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.077789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.078217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:58.425250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:58.438921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:58.440645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:58.442509 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8eddf7b5-7abd-4a61-a78c-a863fea5f326 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.379338 Aug 27 20:53:58.443202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 795/1523] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:53:58 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:53:58.579130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73bdc236-a1e6-4f9d-862d-1780fc9536de tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Calling method '.version_select at 0x7ff84ee75d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:58.588207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73bdc236-a1e6-4f9d-862d-1780fc9536de tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73bdc236-a1e6-4f9d-862d-1780fc9536de tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:58.591712 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:53:58.593101 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:53:58.594315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 20:53:58.595739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:58.598669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73bdc236-a1e6-4f9d-862d-1780fc9536de tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:58.598669 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73bdc236-a1e6-4f9d-862d-1780fc9536de tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.153369 Aug 27 20:53:58.602857 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 796/1524] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 20:53:58 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:58.617903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:58.618544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:58.632928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.633700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.635794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:58.637575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:58.638466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:58.639176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.142403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:59.154357 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b2c8c567-e58f-47f7-abc4-4af3d9d320ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1477 microversion: 2.1 time: 0.551668 Aug 27 20:53:59.154873 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 797/1525] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:58 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1477 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:59.170378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "name": "network-vif-unplugged", "status": "completed", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:53:59.196446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.196923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.197350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.227878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] Creating event network-vif-unplugged:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch1-master-1 Aug 27 20:53:59.244289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c3cadea6-6298-46ee-9a5a-6e7715c1cf32 req-2df10c0e-aebb-4e1a-bec5-8755d9684daa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077561 Aug 27 20:53:59.245462 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 798/1526] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:53:59.250850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32239f7b-f4c6-413d-a87d-0389d8bb9156 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Calling method '.version_select at 0x7ff84ed488b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:59.252635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-32239f7b-f4c6-413d-a87d-0389d8bb9156 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32239f7b-f4c6-413d-a87d-0389d8bb9156 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:53:59.254976 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1'} Aug 27 20:53:59.256409 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:53:59.257287 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 20:53:59.259092 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:53:59.262702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32239f7b-f4c6-413d-a87d-0389d8bb9156 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:53:59.263806 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32239f7b-f4c6-413d-a87d-0389d8bb9156 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017109 Aug 27 20:53:59.264565 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 799/1527] 10.222.0.40 () {58 vars in 1191 bytes} [Sat Aug 27 20:53:59 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:53:59.274288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:59.275403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:59.283418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.286780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.287680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.289419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.290589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.291246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.672939 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e434cce6-4f8b-4e54-90a6-24ab717b87bf tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/3cd6c155-322b-4954-9f59-c5efb42a6f9f" status: 202 len: 0 microversion: 2.1 time: 2.063508 Aug 27 20:53:59.677741 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 729/1528] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:53:57 2022] DELETE /compute/v2.1/os-floating-ips/3cd6c155-322b-4954-9f59-c5efb42a6f9f => generated 0 bytes in 2065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:53:59.683509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:59.684120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:59.699664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.703737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.704319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.706483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.706958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.707947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.840257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:53:59.850735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a8642c6-fd82-4cdf-8634-96fea501b3d3 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1467 microversion: 2.1 time: 0.584748 Aug 27 20:53:59.851827 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 800/1529] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:59 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1467 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:53:59.870327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:53:59.871566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:53:59.881168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.881679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.882492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.883470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.883891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.884313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.923665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:53:59.924030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:53:59.924466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:53:59.924914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 87eec846-2882-49dd-9bb2-c672e5810b06 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:00.003993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:00.007296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:00.031473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8581a6ef-9479-46cf-903e-e207939da7ce tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 200 len: 1308 microversion: 2.1 time: 0.166976 Aug 27 20:54:00.033225 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4f45f5f-7c62-4df3-aacf-52f54014ab78 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 200 len: 1526 microversion: 2.1 time: 0.344921 Aug 27 20:54:00.036538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 730/1530] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:59 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 1526 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:00.042975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee62d827-38ff-4e34-9b1d-a3526c27a165", "name": "network-vif-deleted", "tag": "d040742c-ff11-4d13-be4e-bf8a2ee6a8c2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:00.049656 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 801/1531] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:53:59 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:00.065609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3f4d05d-9955-4d83-a655-596912d8c19e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Calling method '.version_select at 0x7ff84edb5280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:00.083957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:00.084211 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b3f4d05d-9955-4d83-a655-596912d8c19e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:00.085153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3f4d05d-9955-4d83-a655-596912d8c19e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:00.088178 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hostname'} Aug 27 20:54:00.089920 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:54:00.091418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 20:54:00.092980 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:00.095676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:00.096665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:00.099454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3f4d05d-9955-4d83-a655-596912d8c19e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:00.102901 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3f4d05d-9955-4d83-a655-596912d8c19e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051911 Aug 27 20:54:00.103717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 802/1532] 10.222.0.40 () {58 vars in 1212 bytes} [Sat Aug 27 20:54:00 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:00.114498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:00.115931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:00.127766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] Creating event network-vif-deleted:d040742c-ff11-4d13-be4e-bf8a2ee6a8c2 for instance ee62d827-38ff-4e34-9b1d-a3526c27a165 on nch2-master-1 Aug 27 20:54:00.139555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:00.140314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:00.141031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4050705a-ccee-4c94-a1ce-959a53f3210a req-6e6b2fba-227f-496b-b77c-eec717462fb1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102810 Aug 27 20:54:00.141482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:00.142446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:00.143183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:00.143592 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 731/1533] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:00.147928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:00.152467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a780100a-9266-4acd-bd5a-b8dc5b7650c7 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Action: 'create', calling method: .version_select at 0x7ff84f47d670>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:00.162465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:00.649607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:00.664786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:00.666765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:00.668523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1772b03-6bb0-4fc3-b959-069ea4810c95 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.562457 Aug 27 20:54:00.669642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 803/1534] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:00 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:00.674301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45e4225a-9b61-4a17-a7cf-7dfea18ceb0a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84ed584c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.335925 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-45e4225a-9b61-4a17-a7cf-7dfea18ceb0a tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "DELETE /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc" status: 204 len: 0 microversion: 2.1 time: 0.664870 Aug 27 20:54:01.339916 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 804/1535] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:00 2022] DELETE /compute/v2.1/images/f625d131-3996-4898-aeb2-fdd92e51e8cc => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:01.345699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86e467bd-e8fe-4a5b-bea9-8761b8f9400a tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Calling method '.version_select at 0x7ff84ee75280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.347658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-86e467bd-e8fe-4a5b-bea9-8761b8f9400a tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86e467bd-e8fe-4a5b-bea9-8761b8f9400a tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:01.349220 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1'} Aug 27 20:54:01.351352 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:01.352353 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 20:54:01.353887 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.356001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86e467bd-e8fe-4a5b-bea9-8761b8f9400a tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.356896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86e467bd-e8fe-4a5b-bea9-8761b8f9400a tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.015096 Aug 27 20:54:01.357457 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 805/1536] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:01.368464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.369438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:01.376976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.377774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.378391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.379429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.380239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.380740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.580602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:01.589773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0578babd-5614-4d14-8d13-046e27e8897c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1474 microversion: 2.1 time: 0.225280 Aug 27 20:54:01.590359 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 806/1537] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:01.604538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.605249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:01.612629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.613123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.613558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.614303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.614860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.615287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.631584 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 HTTP/1.1 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:01.633921 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:01.635617 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '72f4d948-81e4-4742-a469-225558c65b32'} Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.636472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:01.637687 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.638886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.638886 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e3fa6cc-227c-4c04-a4bf-aec193c5bde9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 404 len: 111 microversion: 2.1 time: 0.043538 Aug 27 20:54:01.638886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 807/1538] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:01.640926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.641863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 87eec846-2882-49dd-9bb2-c672e5810b06] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:01.650030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.650676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.651122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.652164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.652630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.653062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.671466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 HTTP/1.1 Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:01.672696 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. Aug 27 20:54:01.674235 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '87eec846-2882-49dd-9bb2-c672e5810b06'} Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.678000 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. Aug 27 20:54:01.679633 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.680742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 87eec846-2882-49dd-9bb2-c672e5810b06 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.680742 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c31905dc-6efc-43da-8a46-eedeb654d75c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06" status: 404 len: 111 microversion: 2.1 time: 0.037097 Aug 27 20:54:01.680742 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 808/1539] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/servers/87eec846-2882-49dd-9bb2-c672e5810b06 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:01.680742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-524d9825-c5c5-4280-b44e-4c6c9bd85621 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '.version_select at 0x7ff84edc00d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.738785 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-524d9825-c5c5-4280-b44e-4c6c9bd85621 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] HTTP exception thrown: Image not found. Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-524d9825-c5c5-4280-b44e-4c6c9bd85621 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Request method failure captured: Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 HTTP/1.1 Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQL_IqSr7f1rSRJvc_Qfo_6PuqVW7PN1cYNm4cCRDP6ZuAW32CAn5FRlYDSyWcDiJVevr4AvJRr9jMqlzERGkH2AwLfr_iVdK2ZyaOcHXU3jOBFKBNbkZxQFKcKXpk3BU-UuOQSGZw8ztGopxyC_BOFlenstI5Uy-HBB37_zLVqH1g Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:01.741470 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdaa7c7ca577460886d51a42e581c3ac", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}] Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8755382f70e248039545e8882d4fd015 Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ed53a05e-3238-491e-abc5-73349cb875d6'} Aug 27 20:54:01.742872 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ed53a05e-3238-491e-abc5-73349cb875d6 to delete Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.743735 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ed53a05e-3238-491e-abc5-73349cb875d6 could not be found. Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.745175 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-524d9825-c5c5-4280-b44e-4c6c9bd85621 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.746656 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-524d9825-c5c5-4280-b44e-4c6c9bd85621 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "DELETE /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6" status: 404 len: 62 microversion: 2.1 time: 0.069728 Aug 27 20:54:01.748685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 809/1540] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:01 2022] DELETE /compute/v2.1/images/ed53a05e-3238-491e-abc5-73349cb875d6 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:01.754446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68921e4d-df81-4bf0-bb4c-c15d608e470e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Calling method '.version_select at 0x7ff84ee65c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.764196 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-68921e4d-df81-4bf0-bb4c-c15d608e470e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68921e4d-df81-4bf0-bb4c-c15d608e470e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:01.770428 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hostname'} Aug 27 20:54:01.771952 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.772800 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:01.774339 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.775951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68921e4d-df81-4bf0-bb4c-c15d608e470e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.775951 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68921e4d-df81-4bf0-bb4c-c15d608e470e tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.018689 Aug 27 20:54:01.775951 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 810/1541] 10.222.0.40 () {58 vars in 1191 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:01.775951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}, {"server_uuid": "72f4d948-81e4-4742-a469-225558c65b32", "name": "network-vif-deleted", "tag": "ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:01.785366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.785770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.786201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.801450 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Creating event network-changed:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch1-master-1 Aug 27 20:54:01.801966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] Creating event network-vif-deleted:ab563f8c-b7d6-4a57-b4ce-d1184e8a2c42 for instance 72f4d948-81e4-4742-a469-225558c65b32 on nch2-master-1 Aug 27 20:54:01.810294 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c5d62186-df61-4199-91dd-d2f9f463ee0b req-05276674-eeff-46a5-99c0-9d1f47dbbe4a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041053 Aug 27 20:54:01.810900 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 811/1542] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:01.815976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-unplugged", "status": "completed", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:01.825700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.826180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.826616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.837862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] Creating event network-vif-unplugged:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:54:01.843187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1da68385-c3ab-42c2-9e9f-9ee7f5ee0984 req-d2b0a577-1484-43d8-9949-7c9ddbea6afd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030853 Aug 27 20:54:01.843827 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 812/1543] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:01.849321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.850078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: ee62d827-38ff-4e34-9b1d-a3526c27a165] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:01.856869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.857404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.857867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.858556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.859010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.859459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.873554 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 HTTP/1.1 Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:01.875309 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. Aug 27 20:54:01.876679 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ee62d827-38ff-4e34-9b1d-a3526c27a165'} Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:01.877438 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. Aug 27 20:54:01.878682 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:01.879868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance ee62d827-38ff-4e34-9b1d-a3526c27a165 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:01.879868 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b231be2d-5ced-4671-9b4e-431834fb390b tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165" status: 404 len: 111 microversion: 2.1 time: 0.031752 Aug 27 20:54:01.879868 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 813/1544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/servers/ee62d827-38ff-4e34-9b1d-a3526c27a165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:01.882136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:01.882751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:01.889218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.889758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.890231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:01.890965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:01.891480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:01.891953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.135685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:02.143896 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a780100a-9266-4acd-bd5a-b8dc5b7650c7 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.998906 Aug 27 20:54:02.144471 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 732/1545] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:54:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:02.144985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:02.146382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:02.147830 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-284011a0-2558-4042-943f-732efd875699 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.269506 Aug 27 20:54:02.148795 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 814/1546] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:01 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:02.149471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:02.154939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1179170979", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:02.155942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:02.163614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.164459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.164914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.165658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.166090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.166740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.192930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:54:02.212096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] validate_networks() for [('9c58eb9b-edd7-4932-8b75-d271f5f1d195', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:54:02.242029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:02.280460 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90ae67fe-4c05-4deb-b7c9-d9ebaf18f522 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 204 len: 0 microversion: 2.1 time: 0.134475 Aug 27 20:54:02.281143 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 733/1547] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:02 2022] DELETE /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:02.286989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1553ecd-81a9-4f8c-ab80-3503b98c82c6 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Calling method '.version_select at 0x7ff84f3a0940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:02.289145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1553ecd-81a9-4f8c-ab80-3503b98c82c6 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1553ecd-81a9-4f8c-ab80-3503b98c82c6 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:02.291105 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ncdv-master-1'} Aug 27 20:54:02.292810 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:02.293766 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 20:54:02.294949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:02.296035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1553ecd-81a9-4f8c-ab80-3503b98c82c6 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:02.296035 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1553ecd-81a9-4f8c-ab80-3503b98c82c6 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010053 Aug 27 20:54:02.296035 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 734/1548] 10.222.0.40 () {58 vars in 1197 bytes} [Sat Aug 27 20:54:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:02.297555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b4a9511-1e65-4ee4-85bd-200a246d594a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:02.332162 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b4a9511-1e65-4ee4-85bd-200a246d594a tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/5489734b-bf2f-416d-a80f-470b2157d6b0" status: 204 len: 0 microversion: 2.1 time: 0.038110 Aug 27 20:54:02.332756 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 735/1549] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 20:54:02 2022] DELETE /compute/v2.1/os-server-groups/5489734b-bf2f-416d-a80f-470b2157d6b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:02.337323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aaf715bf-09a2-4976-995d-ff27b089b3cf tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84f47dee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:02.828145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:54:02.828599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:54:02.829130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:54:02.829644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:54:02.830130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:54:02.841143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.841731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.842249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.843034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.843587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.844073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.862612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:54:02.867397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Getting quotas for user 0bdbed202cad4f2bbc0c299bf9442986 and project 43b82605298a42f8a6b7594647e5d207. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:54:02.879662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:54:02.882040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:54:02.930770 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0b6dbd8d-eed1-4ac7-af75-14b20fbd5d18 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.780504 Aug 27 20:54:02.937390 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 815/1550] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:54:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:54:02.941146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eec846-2882-49dd-9bb2-c672e5810b06", "name": "network-vif-deleted", "tag": "7630223a-b7cb-45a1-92fd-86ad8ef3cf51"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:02.954740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.955232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.955849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.970535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] Creating event network-vif-deleted:7630223a-b7cb-45a1-92fd-86ad8ef3cf51 for instance 87eec846-2882-49dd-9bb2-c672e5810b06 on nch2-master-1 Aug 27 20:54:02.976003 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a4759837-5cf1-40c5-96b0-72663c6c5cbd req-5843d1f7-1e68-4f56-be1c-2cf0c168bb4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042714 Aug 27 20:54:02.977029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 816/1551] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:02.982989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:02.983666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:02.989925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.990933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.992080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:02.992972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:02.993662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:02.994252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.181695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.190558 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47ddebe7-e9c6-475b-acf3-96a0c8fa8dee tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1473 microversion: 2.1 time: 0.212234 Aug 27 20:54:03.208929 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 817/1552] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:02 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:03.216314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63cb75a8-5a7f-4b7f-ba26-cd1160dc1023 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Calling method '.version_select at 0x7ff84edc0700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.226188 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-63cb75a8-5a7f-4b7f-ba26-cd1160dc1023 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63cb75a8-5a7f-4b7f-ba26-cd1160dc1023 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.228055 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hostname'} Aug 27 20:54:03.229712 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:54:03.230692 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 20:54:03.232144 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63cb75a8-5a7f-4b7f-ba26-cd1160dc1023 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63cb75a8-5a7f-4b7f-ba26-cd1160dc1023 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019475 Aug 27 20:54:03.233589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 818/1553] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:03.243721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.244545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:03.253782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.254332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.254810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.255786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.256306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.257181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.292077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:54:03.344881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aaf715bf-09a2-4976-995d-ff27b089b3cf tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c" status: 202 len: 0 microversion: 2.1 time: 1.011009 Aug 27 20:54:03.345772 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 736/1554] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:54:02 2022] DELETE /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:54:03.351433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.352806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:03.360383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.360971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.361599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.362567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.363216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.363707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.379108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=91,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:03.386358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0bc3709-f6fa-42ab-804b-aff28c0a0617 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 204 len: 0 microversion: 2.1 time: 0.153267 Aug 27 20:54:03.387139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 819/1555] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:03 2022] DELETE /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:03.393127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.394172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:03.402821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.403412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.404325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.405031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.405571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.405986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.484485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.492701 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3caac045-0d64-43b1-9ba1-af6e7bb829ea tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1229 microversion: 2.1 time: 0.104170 Aug 27 20:54:03.493258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 820/1556] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:03.497711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.498502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:03.504871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.505332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.505792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.506495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.507107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.507561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.544649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.552908 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6172d835-89dc-4476-abd6-3c4a34cc819a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1474 microversion: 2.1 time: 0.206080 Aug 27 20:54:03.553526 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 737/1557] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:03.558527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e2049fa-c2f2-4fbd-ad69-80b943284f98 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Calling method '.version_select at 0x7ff84efd3c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.560316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e2049fa-c2f2-4fbd-ad69-80b943284f98 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e2049fa-c2f2-4fbd-ad69-80b943284f98 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:03.561879 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ncdv-master-1'} Aug 27 20:54:03.563484 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:03.564491 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 20:54:03.565882 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.567141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e2049fa-c2f2-4fbd-ad69-80b943284f98 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.567141 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e2049fa-c2f2-4fbd-ad69-80b943284f98 tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008471 Aug 27 20:54:03.568019 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 738/1558] 10.222.0.40 () {58 vars in 1194 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:03.572517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84f47d790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.620600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 47ccfa21-9260-4f17-b634-7f381083150c could not be found", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:54:03.621401 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] HTTP exception thrown: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Request method failure captured: Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c HTTP/1.1 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRhLmZEiuhrPyJ4udznCfbn5mKtXGkNQBoe8tm3LY2cxCzu12_bqCzijkElaCrgntFOD5XZpWvEuNmfomZbxYkLWNhpDW9fIi_bnYKvpHwmGEPv8Zrgj26JE68Z_kt38m3mgPoxkmynJPVtxRDohrk3GOUwPQECWuw75pv1upTSnsA Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 83df163a0f8441219980c77898d1ef05 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:03.623359 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83df163a0f8441219980c77898d1ef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83df163a0f8441219980c77898d1ef05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83df163a0f8441219980c77898d1ef05", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83df163a0f8441219980c77898d1ef05"}]}] Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 83df163a0f8441219980c77898d1ef05 Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsTestJSON-2107566410-project Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f957820e34b04b9b8b4a9fc14bcb01b2 Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsTestJSON-2107566410-project Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '47ccfa21-9260-4f17-b634-7f381083150c'} Aug 27 20:54:03.625014 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:54:03.626182 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 47ccfa21-9260-4f17-b634-7f381083150c could not be found Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4fec97-121a-4674-a604-ea8ced3e9311'] Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c. Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.627621 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:03.629107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:03.630615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.630615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.630615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Returning 404 to user: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.630615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2562bc5-2bc9-481b-a250-90d0fe2545e4 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c" status: 404 len: 111 microversion: 2.1 time: 0.057112 Aug 27 20:54:03.630615 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 739/1559] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:03.636679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.637308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:03.643572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.644099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.644542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.645251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:03.645721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:03.646143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:03.682565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.691727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.693210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.694513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fcfcafe5-7e5c-4ff4-932d-6c48d16b8999 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.200282 Aug 27 20:54:03.695265 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 821/1560] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:03.708067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72a289b5-cae7-4e1a-8b14-46d55804592d tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Calling method '.version_select at 0x7ff84edc0dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.708705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-72a289b5-cae7-4e1a-8b14-46d55804592d tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72a289b5-cae7-4e1a-8b14-46d55804592d tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.710552 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hostname'} Aug 27 20:54:03.711961 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:54:03.712812 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 20:54:03.714738 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72a289b5-cae7-4e1a-8b14-46d55804592d tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72a289b5-cae7-4e1a-8b14-46d55804592d tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.015759 Aug 27 20:54:03.717774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 822/1561] 10.222.0.40 () {58 vars in 1215 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:03.719757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Calling method '.version_select at 0x7ff84ed58e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:03.774988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 47ccfa21-9260-4f17-b634-7f381083150c could not be found", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:54:03.775728 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] HTTP exception thrown: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Request method failure captured: Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c HTTP/1.1 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRhLmZEiuhrPyJ4udznCfbn5mKtXGkNQBoe8tm3LY2cxCzu12_bqCzijkElaCrgntFOD5XZpWvEuNmfomZbxYkLWNhpDW9fIi_bnYKvpHwmGEPv8Zrgj26JE68Z_kt38m3mgPoxkmynJPVtxRDohrk3GOUwPQECWuw75pv1upTSnsA Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 83df163a0f8441219980c77898d1ef05 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:03.780198 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83df163a0f8441219980c77898d1ef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/83df163a0f8441219980c77898d1ef05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_83df163a0f8441219980c77898d1ef05", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/83df163a0f8441219980c77898d1ef05"}]}] Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 83df163a0f8441219980c77898d1ef05 Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2107566410 Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsTestJSON-2107566410-project Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f957820e34b04b9b8b4a9fc14bcb01b2 Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsTestJSON-2107566410-project Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: exception: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '47ccfa21-9260-4f17-b634-7f381083150c'} Aug 27 20:54:03.781825 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:54:03.787298 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 47ccfa21-9260-4f17-b634-7f381083150c could not be found Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef08b8c0-1cda-4c0c-9ec4-918f23fbb04a'] Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c. Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.788798 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:03.790149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] Returning 404 to user: Floating IP not found for ID 47ccfa21-9260-4f17-b634-7f381083150c {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cf2f91b-039c-444d-9d6f-73d141e3b152 tempest-FloatingIPsTestJSON-2107566410 tempest-FloatingIPsTestJSON-2107566410-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c" status: 404 len: 111 microversion: 2.1 time: 0.067866 Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 823/1562] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:54:03 2022] DELETE /compute/v2.1/os-floating-ips/47ccfa21-9260-4f17-b634-7f381083150c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:03.791619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-119f075e-9b37-4070-a874-8976374ac03a tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Action: 'update', calling method: .version_select at 0x7ff84eeec310>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-119f075e-9b37-4070-a874-8976374ac03a tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 51 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.794614 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.796029 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance: Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.796911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.798711 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-119f075e-9b37-4070-a874-8976374ac03a tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-119f075e-9b37-4070-a874-8976374ac03a tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.009143 Aug 27 20:54:03.800059 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 824/1563] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:54:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:54:03.807254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e7b23be-24de-48c4-9560-cdd8915d2aba tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ed6c670>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e7b23be-24de-48c4-9560-cdd8915d2aba tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 51 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.811089 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.812795 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance: Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.815540 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.817303 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e7b23be-24de-48c4-9560-cdd8915d2aba tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e7b23be-24de-48c4-9560-cdd8915d2aba tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.010125 Aug 27 20:54:03.818594 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 825/1564] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:54:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:54:03.825554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85be0e89-2040-41ad-bb9d-241e158df0fa tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Action: 'update', calling method: .version_select at 0x7ff84ee6ab80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:03.828950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85be0e89-2040-41ad-bb9d-241e158df0fa tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'aa9f7df7857947779e75937c42e7fdf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fa90baaf9e4b24b2c0a2fc0eed8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85be0e89-2040-41ad-bb9d-241e158df0fa tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Request method failure captured: Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 50 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRkNy6Q8QlLd6lbI_IUj7YiACCKZGvql3bib55kxUgK1BAqBFJnNxgdMODKajcM-M3KljWXhI_tqfvYLuKXFzcBUkqN7ebmJbkA-0JcLmcxP6x2dDefnV-BN50LBKcLJnearUJE4zss9_vBMU23yiui_U5BQXVokVjTZxDWhrGtgIo Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:03.830597 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_39fa90baaf9e4b24b2c0a2fc0eed8562", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/39fa90baaf9e4b24b2c0a2fc0eed8562"}]}] Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 39fa90baaf9e4b24b2c0a2fc0eed8562 Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-829995575 Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: aa9f7df7857947779e75937c42e7fdf6 Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-829995575-project Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 20:54:03.832242 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:03.833279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 20:54:03.834676 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.837085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85be0e89-2040-41ad-bb9d-241e158df0fa tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.837085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85be0e89-2040-41ad-bb9d-241e158df0fa tempest-HostsAdminNegativeTestJSON-829995575 tempest-HostsAdminNegativeTestJSON-829995575-project] 10.222.0.40 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.011914 Aug 27 20:54:03.837637 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 826/1565] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:54:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:03.842674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-057224bd-4b7d-4635-8a55-f463a2aba545 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ed6cca0>, body: {"status": null, "maintenance_mode": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-057224bd-4b7d-4635-8a55-f463a2aba545 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 42 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.846312 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: {"status": null, "maintenance_mode": null} Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 20:54:03.848724 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance: Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi None Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.850724 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.854350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-057224bd-4b7d-4635-8a55-f463a2aba545 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-057224bd-4b7d-4635-8a55-f463a2aba545 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.009013 Aug 27 20:54:03.856321 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 827/1566] 10.222.0.40 () {60 vars in 1190 bytes} [Sat Aug 27 20:54:03 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:54:03.858684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Action: 'update', calling method: .version_select at 0x7ff84ed58700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:03.862438 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.hosts [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Enabling host nonexistent_hostname. Aug 27 20:54:03.865911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:03.869573 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Request method failure captured: Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 50 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRlXQMyB_FOPvFnJ7dQD4P-Age-rOdkaEt2LE7bmKXllBXkP9zTCeZply1b1PhSIw8CaAnxjg_OWIwZptv3JK1KNa7qtTG6Rk_9vgrpxJGmQBWc2ikZdfLxak_6uVQSGKMe1U644hlTfwiGuec-P2qYl_Bf0qEMdoCo4fkzKooGkp0 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:03.871390 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8bca0e0ad5134bcbbd479536ee61f8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8bca0e0ad5134bcbbd479536ee61f8b6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8bca0e0ad5134bcbbd479536ee61f8b6"}]}] Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8bca0e0ad5134bcbbd479536ee61f8b6 Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1593706736 Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: bd41f2de442e4abb90b920365ddbb2d1 Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1593706736-project-admin Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.872976 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 20:54:03.873983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:54:03.875247 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 20:54:03.876806 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:03.877842 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3dcdbb1d-1a2d-4a40-9643-e7f7602bdeba tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1472 microversion: 2.1 time: 0.244681 Aug 27 20:54:03.878581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:03.879628 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a597c8fb-4b28-412b-afb1-2904f1477700 tempest-HostsAdminNegativeTestJSON-1593706736 tempest-HostsAdminNegativeTestJSON-1593706736-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025984 Aug 27 20:54:03.883948 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 828/1567] 10.222.0.40 () {60 vars in 1211 bytes} [Sat Aug 27 20:54:03 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:03.894027 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 740/1568] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:03 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:04.097683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f70541-3f19-479c-af7d-cadb6d1789db", "name": "network-vif-unplugged", "status": "completed", "tag": "6675d230-7e6e-4bf0-9f9e-3af33976084e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:04.127735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.128242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.128650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.150351 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Creating event network-vif-unplugged:6675d230-7e6e-4bf0-9f9e-3af33976084e for instance 71f70541-3f19-479c-af7d-cadb6d1789db on nch1-master-1 Aug 27 20:54:04.156774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] Instance 71f70541-3f19-479c-af7d-cadb6d1789db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:54:04.165074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9f148118-0d4e-4e76-ba85-0970528e0dc7 req-2d2a2974-4f52-4e79-8f3d-0faac4f7fff3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071651 Aug 27 20:54:04.166270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 829/1569] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:04.214411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:04.216476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:04.227058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.227950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.228821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.229771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.230388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.231011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.518924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:04.519149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:04.520810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:04.530224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.531124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.531829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.532970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.533638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.534005 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e783f6a-cd85-45f2-9822-dc33595d6dd7 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1473 microversion: 2.1 time: 0.324876 Aug 27 20:54:04.534426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.537383 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 741/1570] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:04 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:04.579687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:04.580733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:04.589708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.591013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.591538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.592646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.593126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.593550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.623439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:04.634531 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-967d18da-c5ef-46a8-8273-ca00f1b5bee0 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1277 microversion: 2.1 time: 0.121549 Aug 27 20:54:04.638504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 830/1571] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:04 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:04.718894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:04.719604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:04.730156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.730417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.730862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:04.731611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:04.732240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:04.732833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.043705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:05.066706 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-429cde01-260f-4490-813f-87eb62fcdf1c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1474 microversion: 2.1 time: 0.493095 Aug 27 20:54:05.083484 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 742/1572] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:04 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:05.089869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:05.091048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:05.098393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.098994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.099665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.100629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.101197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.101854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.133401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:05.147690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:05.149732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:05.151539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52e82a44-5697-44c8-b456-84d3ef1f364f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.436978 Aug 27 20:54:05.152646 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 831/1573] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:04 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:05.558155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:05.559030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:05.578079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.579316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.579895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.580619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.581339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.581941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.919636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:05.931124 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1e535c7-be4b-41c2-a5f1-aea219d5e8e5 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1472 microversion: 2.1 time: 0.846190 Aug 27 20:54:05.936110 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 743/1574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:05 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1472 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:05.945300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:05.946368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:05.953285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.954037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.954700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:05.955748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:05.956622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:05.957248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.051742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.064190 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a6fc53ff-c5ed-4d5b-ba87-e3066361fcd8 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1473 microversion: 2.1 time: 0.509859 Aug 27 20:54:06.065325 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 832/1575] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:05 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1473 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:06.089841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:06.090996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:06.103296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.103830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.104270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.104978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.105434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.105857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.195598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.207105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ff2dfed-80b0-41b6-90ec-e1ae7802b62e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1283 microversion: 2.1 time: 0.266276 Aug 27 20:54:06.207105 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 744/1576] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:05 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:06.223375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:06.224009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:06.231387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.232738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.233583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.235191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.235870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.236492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.650457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.660840 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0ffcb27-7c79-4eda-a88f-c466d2c4a0e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1471 microversion: 2.1 time: 0.574856 Aug 27 20:54:06.672325 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 833/1577] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:06 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:06.683922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f70541-3f19-479c-af7d-cadb6d1789db", "name": "network-vif-plugged", "status": "completed", "tag": "6675d230-7e6e-4bf0-9f9e-3af33976084e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:06.701678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.702386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.702996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.735186 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Creating event network-vif-plugged:6675d230-7e6e-4bf0-9f9e-3af33976084e for instance 71f70541-3f19-479c-af7d-cadb6d1789db on nch1-master-1 Aug 27 20:54:06.743405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] Instance 71f70541-3f19-479c-af7d-cadb6d1789db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:54:06.752086 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-82887c5a-a7e3-4735-a2c7-e28a03896448 req-57c3844f-f49e-4706-8a19-661f8cf6c797 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077881 Aug 27 20:54:06.753784 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 834/1578] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:06.761151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:06.762416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:06.769582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.770069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.770511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.771644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.772449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.773369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.792837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:06.868189 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4bdd2762-2ef4-40c9-9546-c95e0a35fed6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db/action" status: 204 len: 0 microversion: 2.1 time: 0.111596 Aug 27 20:54:06.869468 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 835/1579] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:54:06 2022] POST /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db/action => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:06.883443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:06.884592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:06.895449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.896178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.896922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.897649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.899399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.900231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.901139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.923633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.930924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:06.937038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad3c0a64-bbd6-46e7-97e2-7204ae7ad4dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.729760 Aug 27 20:54:06.938318 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 745/1580] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:06 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:06.955718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:06.956837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:06.967763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.968966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.969770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:06.978697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:06.979933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:06.981002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.176304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:07.190244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c66e719d-700e-4cf8-bbc9-7108a51e772c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1430 microversion: 2.1 time: 0.238686 Aug 27 20:54:07.194192 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 746/1581] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:06 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1430 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:07.207654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6", "name": "network-vif-deleted", "tag": "38437cf9-f8b3-4b4f-a48d-03b543f2de87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:07.220632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.221286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.224894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.249975 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] Creating event network-vif-deleted:38437cf9-f8b3-4b4f-a48d-03b543f2de87 for instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 on nch1-master-1 Aug 27 20:54:07.259048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-97a32d0d-bb0b-4395-907a-22b10e7be14e req-3a18d37c-5d61-4c1b-b706-a71e1cdc6529 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062649 Aug 27 20:54:07.262892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 747/1582] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:07.280997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:07.283196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:07.299061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.299754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.300783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.301755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.320136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.320834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.365529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:07.374517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.375525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.376416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.377094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lazy-loading 'fault' on Instance uuid 0e2a572b-6233-4e56-8304-0a89fecf7b68 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:07.531754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:07.548043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bd2a955-e7e6-4ae7-83f7-486c48a87591 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1471 microversion: 2.1 time: 0.673734 Aug 27 20:54:07.552388 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 836/1583] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:06 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1471 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:07.563840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755382f70e248039545e8882d4fd015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaa7c7ca577460886d51a42e581c3ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:07.563979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a572b-6233-4e56-8304-0a89fecf7b68", "name": "network-vif-deleted", "tag": "d477adb3-208a-4bb3-ac33-15bd204c9895"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:07.582461 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89b64286-e1ed-4ddf-9de4-7b3dff2acf54 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 200 len: 1307 microversion: 2.1 time: 0.311946 Aug 27 20:54:07.588087 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 748/1584] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:07 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:07.592795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.593887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.594471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.612371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:07.617564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:07.634825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.636035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.636733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.637888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.638538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.639888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:07.648476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] Creating event network-vif-deleted:d477adb3-208a-4bb3-ac33-15bd204c9895 for instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 on nch2-master-1 Aug 27 20:54:07.665761 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e78c35e5-4b1b-4316-bd10-da8be6785266 req-a969561d-28cd-47ca-bb85-f6f03b88b4a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109771 Aug 27 20:54:07.670640 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 837/1585] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:07.759594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:07.771100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48d48e3f-ffe0-400a-ad5f-103172f85f2e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1283 microversion: 2.1 time: 0.170257 Aug 27 20:54:07.778183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 749/1586] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:07 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:07.890099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9072f9b4-0d1c-4a54-9065-f6fda8506901 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:07.891641 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-9072f9b4-0d1c-4a54-9065-f6fda8506901 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9072f9b4-0d1c-4a54-9065-f6fda8506901 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin] Request method failure captured: Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoRvCZJCIkt-PvEPXamghjZwTbw3raaUKSTG3_4mUUCxVuCDgpX7yf8e3O1SRkaaDyO4U1Bm-T6WhYP-T9eAuws2qsp925vsezbj6rsQNkZBWN_-bszuldkBBA5Wed9b8dHqdR5U3siNrdzk3bIVbo5cM8XYoItDUPqgRL7gKwAAKHc Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 475e97f1b5984b8e85602bbc7520c444 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:54:07.899694 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/475e97f1b5984b8e85602bbc7520c444"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/475e97f1b5984b8e85602bbc7520c444"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_475e97f1b5984b8e85602bbc7520c444", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/475e97f1b5984b8e85602bbc7520c444"}]}] Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 475e97f1b5984b8e85602bbc7520c444 Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 001643d3bb58499581497d4771a162a6 Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:07.901114 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid timestamp for date invalid_time Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'invalid_time'} Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:07.901930 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9072f9b4-0d1c-4a54-9065-f6fda8506901 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:07.903159 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9072f9b4-0d1c-4a54-9065-f6fda8506901 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430 tempest-InstanceUsageAuditLogNegativeTestJSON-797344430-project-admin] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.172693 Aug 27 20:54:07.904732 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 838/1587] 10.222.0.40 () {58 vars in 1224 bytes} [Sat Aug 27 20:54:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:54:07.979103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:07.984711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:07.998465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:07.999028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:07.999818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.000931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.009249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.009852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.086546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59ed3f4f-fde0-48d0-bc64-d7fb578edc54 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.090226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59ed3f4f-fde0-48d0-bc64-d7fb578edc54 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '99f9207ff0ef4c0f940a78aaa0b9c700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb2af2a06184d828d582e1b50090469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59ed3f4f-fde0-48d0-bc64-d7fb578edc54 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Request method failure captured: Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRuXIWEdTssxRnGBPHldDpUKdWZ5mDzzuS3YVkKa6fc3wW8xpBuCKBb1ocquDGYV0HaF-e0kfPfPeADl5YCkeaCCsgDvaSgTWUgHbQQB5XyiCGzI3l2XJ-KqtWOLQEoZcx4bv3QYDTq7H_hE1vbnL-SgAaUDAdJEdxMNzSW1SoG0wE Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5bb2af2a06184d828d582e1b50090469 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:08.093325 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb2af2a06184d828d582e1b50090469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb2af2a06184d828d582e1b50090469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb2af2a06184d828d582e1b50090469", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb2af2a06184d828d582e1b50090469"}]}] Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5bb2af2a06184d828d582e1b50090469 Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 99f9207ff0ef4c0f940a78aaa0b9c700 Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project Aug 27 20:54:08.094915 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: action_args: {} Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:08.095881 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 20:54:08.097205 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.101416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59ed3f4f-fde0-48d0-bc64-d7fb578edc54 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:08.103194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59ed3f4f-fde0-48d0-bc64-d7fb578edc54 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.194002 Aug 27 20:54:08.108312 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 750/1588] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:54:07 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:08.115847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ae3b6fc-22a9-4a33-8c67-4a1751c28fd8 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.118405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ae3b6fc-22a9-4a33-8c67-4a1751c28fd8 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '99f9207ff0ef4c0f940a78aaa0b9c700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb2af2a06184d828d582e1b50090469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ae3b6fc-22a9-4a33-8c67-4a1751c28fd8 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Request method failure captured: Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2020:54:08 HTTP/1.1 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoRuXIWEdTssxRnGBPHldDpUKdWZ5mDzzuS3YVkKa6fc3wW8xpBuCKBb1ocquDGYV0HaF-e0kfPfPeADl5YCkeaCCsgDvaSgTWUgHbQQB5XyiCGzI3l2XJ-KqtWOLQEoZcx4bv3QYDTq7H_hE1vbnL-SgAaUDAdJEdxMNzSW1SoG0wE Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5bb2af2a06184d828d582e1b50090469 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:08.120428 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb2af2a06184d828d582e1b50090469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5bb2af2a06184d828d582e1b50090469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5bb2af2a06184d828d582e1b50090469", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5bb2af2a06184d828d582e1b50090469"}]}] Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5bb2af2a06184d828d582e1b50090469 Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 99f9207ff0ef4c0f940a78aaa0b9c700 Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project Aug 27 20:54:08.121854 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '2022-08-27 20:54:08'} Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:54:08.122539 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 20:54:08.123850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.126595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ae3b6fc-22a9-4a33-8c67-4a1751c28fd8 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:08.128508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ae3b6fc-22a9-4a33-8c67-4a1751c28fd8 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715 tempest-InstanceUsageAuditLogNegativeTestJSON-931834715-project] 10.222.0.40 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 20:54:08" status: 403 len: 128 microversion: 2.1 time: 0.018229 Aug 27 20:54:08.134446 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 751/1589] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 20:54:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2020%3A54%3A08 => generated 128 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:08.214687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.216820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:08.227768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.232520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.233470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.235176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.237908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.238735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.339623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.340969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.342418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.343069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lazy-loading 'fault' on Instance uuid 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:08.517762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56017fc97f54ff9b54288f627036a4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8b6b7c1f14208baf2d0a9763e51ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.529202 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f8a78571-a40e-49d6-b6b7-ae0cc1f8d41c tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 200 len: 1306 microversion: 2.1 time: 0.321249 Aug 27 20:54:08.560083 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 752/1590] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:08 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:08.576791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.579463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:08.594084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.596734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.597928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.599698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.601406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.603792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.618999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.630778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.633267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:08.635141 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8a66cf4-c903-4126-88bb-b9458d449039 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.674225 Aug 27 20:54:08.636478 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 839/1591] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:07 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:08.642321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.643227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] [instance: 0e2a572b-6233-4e56-8304-0a89fecf7b68] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:08.652977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.653785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.654491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.656171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.656852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.657825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.697255 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] HTTP exception thrown: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Request method failure captured: Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 HTTP/1.1 Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQL_IqSr7f1rSRJvc_Qfo_6PuqVW7PN1cYNm4cCRDP6ZuAW32CAn5FRlYDSyWcDiJVevr4AvJRr9jMqlzERGkH2AwLfr_iVdK2ZyaOcHXU3jOBFKBNbkZxQFKcKXpk3BU-UuOQSGZw8ztGopxyC_BOFlenstI5Uy-HBB37_zLVqH1g Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:08.724757 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdaa7c7ca577460886d51a42e581c3ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdaa7c7ca577460886d51a42e581c3ac", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdaa7c7ca577460886d51a42e581c3ac"}]}] Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: bdaa7c7ca577460886d51a42e581c3ac Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1355718643 Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8755382f70e248039545e8882d4fd015 Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerTestJSON-1355718643-project Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. Aug 27 20:54:08.727100 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0e2a572b-6233-4e56-8304-0a89fecf7b68'} Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:08.727912 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. Aug 27 20:54:08.730368 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:08.737036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] Returning 404 to user: Instance 0e2a572b-6233-4e56-8304-0a89fecf7b68 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:08.737036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-61ebc113-f263-4fb9-ba8f-cc1a37760362 tempest-ImagesOneServerTestJSON-1355718643 tempest-ImagesOneServerTestJSON-1355718643-project] 10.222.0.40 "GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68" status: 404 len: 111 microversion: 2.1 time: 0.092405 Aug 27 20:54:08.737036 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 840/1592] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:08 2022] GET /compute/v2.1/servers/0e2a572b-6233-4e56-8304-0a89fecf7b68 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:08.793063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:08.795792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:08.809856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.812639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.815162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:08.817117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:08.818335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:08.819174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:09.402473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:09.425441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dada540f-3322-412c-8917-5fe15b3065d6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1471 microversion: 2.1 time: 0.858429 Aug 27 20:54:09.427117 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 753/1593] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:08 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1471 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:09.562328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:09.563209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] [instance: 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:09.573895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:09.575483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:09.579067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:09.580371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:09.580845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:09.581555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:09.616108 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] HTTP exception thrown: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Request method failure captured: Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 HTTP/1.1 Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOpbSd4VbkYiJhKSthucf7AcpROFq72sRYUz0bg--KE9p-cidrJY9FhFhqWj0ePZhuR1M-I0RiTv9nFKm6v0WumeUTAeX1gKK5W0jJAYSr-E3yWaCvMaPZxyySKGE0ktHWUs0hrWd0Rgow6DqNdwskvNeYZUfhNVJog4ZWRrMA13_s Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:09.619362 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/64e8b6b7c1f14208baf2d0a9763e51ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_64e8b6b7c1f14208baf2d0a9763e51ff", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/64e8b6b7c1f14208baf2d0a9763e51ff"}]}] Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 64e8b6b7c1f14208baf2d0a9763e51ff Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1823296390 Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c56017fc97f54ff9b54288f627036a4b Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersOnMultiNodesTest-1823296390-project Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. Aug 27 20:54:09.621022 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6'} Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:09.621817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. Aug 27 20:54:09.623226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:09.624532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] Returning 404 to user: Instance 5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:09.624532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-95b41e57-f405-4058-b2a4-c8d7e9e82743 tempest-ServersOnMultiNodesTest-1823296390 tempest-ServersOnMultiNodesTest-1823296390-project] 10.222.0.40 "GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6" status: 404 len: 111 microversion: 2.1 time: 0.063812 Aug 27 20:54:09.624532 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 754/1594] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:09 2022] GET /compute/v2.1/servers/5e621d50-f20d-42bb-a7a7-ed2f9c97d2a6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:54:09.647794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:09.666203 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28d4a768-c90e-42e5-bffa-d1a600a45117 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.876902 Aug 27 20:54:09.667418 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 841/1595] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:08 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:09.670809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:09.672510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:09.682710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:09.683705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:09.684368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:09.686088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:09.686726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:09.687738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:10.091213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:10.103874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:10.113905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:10.116657 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7de1ea11-392e-47bb-9a6f-0cb0decfebf4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.455467 Aug 27 20:54:10.117610 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 755/1596] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:09 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:10.451603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:10.453358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:10.472035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:10.473440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:10.474251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:10.475205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:10.476302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:10.477024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:10.707620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:10.725233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:10.789486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:10.790403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:10.791033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:10.792045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:10.792724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:10.793318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:11.498575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:11.516279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93439b97-f215-4b4b-9022-b0f57b6b5150 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1463 microversion: 2.1 time: 1.068873 Aug 27 20:54:11.524263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 842/1597] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:10 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1463 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:11.536626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe6ced5-be3b-4ed0-9643-da517613624a", "tag": "d09ea84e-c50c-441e-bf59-a0c6f9da0388"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:11.567443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:11.567962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:11.569517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:11.572065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:11.582480 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4b38961-f20b-45f5-859e-b8d711119ad4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.897914 Aug 27 20:54:11.592726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 756/1598] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:10 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:11.610223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:11.614129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:11.615553 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] Creating event network-changed:d09ea84e-c50c-441e-bf59-a0c6f9da0388 for instance afe6ced5-be3b-4ed0-9643-da517613624a on nch2-master-1 Aug 27 20:54:11.626910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:11.627441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:11.627889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:11.628607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:11.636089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:11.636832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:11.642603 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ae07bdd6-c84b-46ba-8683-d977eab57842 req-fa6a8c9a-dfac-47db-a7b0-e2b007605b41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110794 Aug 27 20:54:11.643657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 843/1599] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:11.664180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:11.665714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:11.673090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:11.673891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:11.674528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:11.675495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:11.676130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:11.676734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:12.329392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:12.331485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:12.342028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:12.344419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:12.345833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a477f9a4-7745-49ff-906e-713fa22a7901 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.752089 Aug 27 20:54:12.360774 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 757/1600] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:11 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:12.454033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:12.467443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b2f7914-91d4-4fb3-8aea-66ab7721c620 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1463 microversion: 2.1 time: 0.820247 Aug 27 20:54:12.469212 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 844/1601] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:11 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1463 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:12.495395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-43b45af0-fb61-471f-8a7d-329bfb8e86ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'create', calling method: .version_select at 0x7ff84f54d1f0>, body: {"keypair": {"name": "tempest-keypair-469423372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDN9JyXhDScBWMzzTfP/kymHCQXgH3K7Xw3HCxYXfGGggxUL3mrgstMfy/o5Hwfg0XxcsNCRMgMYI8SQDw49x3ygt95fyqFL7s2pwIc9Fxb/ZXxej2M6ne4tf8v8ZRPZg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:12.513870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-43b45af0-fb61-471f-8a7d-329bfb8e86ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:54:12.518588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-43b45af0-fb61-471f-8a7d-329bfb8e86ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:54:12.557972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-43b45af0-fb61-471f-8a7d-329bfb8e86ee tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066689 Aug 27 20:54:12.559307 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 758/1602] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:54:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:12.616922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:12.618181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:12.636041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:12.638731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:12.639208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:12.641476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:12.642250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:12.642688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:12.853015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:12.875694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:13.372018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:13.372672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:13.390774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:13.391288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:13.393281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:13.395375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:13.397138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:13.400756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:13.406783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:13.428180 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-090ea9bf-13f4-4f9d-b767-97e6ecc35947 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.816223 Aug 27 20:54:13.444292 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 845/1603] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:12 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:13.714107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:13.726876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:13.730640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:13.731977 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-808f3aec-60dd-4c03-901a-ba48b04a4629 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.365582 Aug 27 20:54:13.739125 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 759/1604] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:13 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:14.451887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:14.453778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:14.462013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:14.462598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:14.463667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:14.464632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:14.465290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:14.466448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:14.652128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:14.676982 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0413e5f-a14c-4ff0-9395-cfe03a6ba93f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.229346 Aug 27 20:54:14.689953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 846/1605] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:14 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:14.763307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:14.764772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:14.774112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:14.774879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:14.776109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:14.777093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:14.778201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:14.779120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:14.821265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1530943337", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:14.960919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:14.980532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:14.980532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:14.982452 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27c14865-191e-484d-8ce8-5a4224b4ce08 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 0.223219 Aug 27 20:54:14.983253 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 847/1606] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:14 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:15.103196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:54:15.405936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:54:15.406629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:54:15.407282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:54:15.407914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:54:15.408507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:54:15.422821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:15.423319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:15.423801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:15.424537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:15.425004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:15.425436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:15.459871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Getting quotas for project f93e6d3811364c5695ab9a06e0418bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:54:15.467290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Getting quotas for user 9f179068b17943c9a2574fd3a15cec90 and project f93e6d3811364c5695ab9a06e0418bf8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:54:15.480932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:54:15.483317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:54:15.546874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e6cc278-6fbb-4475-a796-f4dbc4413247 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914528 Aug 27 20:54:15.553858 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 760/1607] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:54:15.559365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d65ad3a4-32e6-42e0-87bb-7d086e3a0dfa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:15.560974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d65ad3a4-32e6-42e0-87bb-7d086e3a0dfa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:15.707818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:15.712814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:15.729831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:15.731758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:15.732765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:15.735424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:15.735981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:15.737604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:15.746021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d65ad3a4-32e6-42e0-87bb-7d086e3a0dfa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:15.754992 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d65ad3a4-32e6-42e0-87bb-7d086e3a0dfa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1214 microversion: 2.1 time: 0.199697 Aug 27 20:54:15.758531 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 848/1608] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:15 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:16.008973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:16.009979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:16.023718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:16.024709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:16.025436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:16.026773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:16.029563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:16.031165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:16.353138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:16.366460 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03925547-cb01-489b-9423-29c29dea5c74 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.661988 Aug 27 20:54:16.370080 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 761/1609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:15 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:16.404114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c2b418c-1589-471e-a6aa-dc64a0696bb2 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '.version_select at 0x7ff84f6add30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:16.424387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c2b418c-1589-471e-a6aa-dc64a0696bb2 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:16.428556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c2b418c-1589-471e-a6aa-dc64a0696bb2 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:16.429150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c2b418c-1589-471e-a6aa-dc64a0696bb2 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:16.456402 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c2b418c-1589-471e-a6aa-dc64a0696bb2 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 2720 microversion: 2.1 time: 0.084281 Aug 27 20:54:16.472263 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 762/1610] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:54:16 2022] GET /compute/v2.1/os-migrations => generated 2720 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:16.490442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24f6055b-51e1-4232-9f2d-0d80f5773ec6 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:16.500267 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24f6055b-51e1-4232-9f2d-0d80f5773ec6 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015370 Aug 27 20:54:16.501155 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 763/1611] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:16.519733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f7d1596-f6df-42ec-80f2-01ff98f65233 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1350510843", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:16.556150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f7d1596-f6df-42ec-80f2-01ff98f65233 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.042957 Aug 27 20:54:16.557635 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 764/1612] 10.222.0.40 () {60 vars in 1146 bytes} [Sat Aug 27 20:54:16 2022] POST /compute/v2.1/flavors => generated 499 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:16.569684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-33362c6b-cc2f-4cbc-88a9-aac98d063f14 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:16.584263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-33362c6b-cc2f-4cbc-88a9-aac98d063f14 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019654 Aug 27 20:54:16.585653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 765/1613] 10.222.0.40 () {58 vars in 1182 bytes} [Sat Aug 27 20:54:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:54:16.785738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:16.787881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:16.813081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:16.815629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:16.817141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:16.821965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:16.822671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:16.827162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:17.007129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:17.017004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:17.022341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de3d46e8-eb7f-4ef4-919b-9186c201ca67 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1218 microversion: 2.1 time: 0.249101 Aug 27 20:54:17.023931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 766/1614] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:16 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:17.029924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1792122884", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "a00ab627-416a-4fbc-8a09-8c603df7a452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:17.045127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:17.055363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:17.070965 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4526cd16-3244-42d6-981b-52c2b1a604b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1812 microversion: 2.25 time: 1.066209 Aug 27 20:54:17.094538 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 849/1615] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:16 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1812 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:17.172633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:54:17.390025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:17.390722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:17.405883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:17.406422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:17.406872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:17.407686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:17.408153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:17.408583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:17.862526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:17.875769 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2f8ef26-b79b-4da1-8a5f-776205cff318 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.490640 Aug 27 20:54:17.876951 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 850/1616] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:17 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:18.046056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:18.047566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:18.050632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:54:18.051607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:54:18.052096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:54:18.052694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:54:18.053108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:54:18.059776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.060920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.061799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.062987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.063723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.064419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.077474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.079307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.080038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.081091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.082458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.083334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.111994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:54:18.119685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:54:18.138344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:54:18.141502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:54:18.269126 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16115c8b-fe00-41dc-a426-004c4503b804 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241001 Aug 27 20:54:18.273535 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 767/1617] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:54:18.289551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:18.292996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:18.313618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.314396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.315088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.316170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.317310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.318210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.685320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:18.704847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:18.728909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83087f3c-ee5f-4402-9b6f-ad94fe167046 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1266 microversion: 2.1 time: 0.686593 Aug 27 20:54:18.729420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:18.733616 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 851/1618] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:18 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1266 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:18.740627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:18.755561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8170d885-4958-4951-934d-38eb8911f6b4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1802 microversion: 2.25 time: 0.480492 Aug 27 20:54:18.756178 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 768/1619] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:18 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1802 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:18.779243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-535184ea-7f83-4e03-a74d-f0deec8cbcbe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:18.780028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-535184ea-7f83-4e03-a74d-f0deec8cbcbe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:18.781841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6cd04a4-8788-41b3-8671-6a26396ee02d tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '.version_select at 0x7ff84f47d820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:18.792387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6cd04a4-8788-41b3-8671-6a26396ee02d tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.792950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6cd04a4-8788-41b3-8671-6a26396ee02d tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.793332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6cd04a4-8788-41b3-8671-6a26396ee02d tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.827206 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6cd04a4-8788-41b3-8671-6a26396ee02d tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3205 microversion: 2.25 time: 0.050432 Aug 27 20:54:18.828189 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 769/1620] 10.222.0.40 () {60 vars in 1184 bytes} [Sat Aug 27 20:54:18 2022] GET /compute/v2.1/os-migrations => generated 3205 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:54:18.844396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:18.845519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:18.867223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.868066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.880963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.881615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:18.882397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:18.883023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:18.984259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-535184ea-7f83-4e03-a74d-f0deec8cbcbe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:19.001144 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-535184ea-7f83-4e03-a74d-f0deec8cbcbe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1279 microversion: 2.1 time: 0.257114 Aug 27 20:54:19.005281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 852/1621] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:18 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1279 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:19.011732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:19.021599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:19.036141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.037044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.037651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.038719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.039380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.039988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.430260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:19.463537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a29ca69-6d52-42d1-9000-f29850abc09f tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 2420 microversion: 2.25 time: 0.620444 Aug 27 20:54:19.464434 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 770/1622] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:18 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 2420 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:19.496755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:19.497874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:19.514382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.517179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.517659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.518581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.519958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.520980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.598439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:19.612772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e14b3bac-62c2-499f-8853-88852c5a24d7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.606144 Aug 27 20:54:19.613375 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 853/1623] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:19 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:19.756892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:19.757728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:19.766128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.766626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.776087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.777111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.777758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.778348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.789609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:19.811659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1781840-56db-4dcf-8541-86b6b6ee65bb tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 2420 microversion: 2.25 time: 0.319426 Aug 27 20:54:19.821538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 771/1624] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:54:19 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 2420 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:54:19.889142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:19.903132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49d99e46-2b60-4e5f-9850-6ca2477bc576 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1272 microversion: 2.1 time: 0.150030 Aug 27 20:54:19.904718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 854/1625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:19 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:19.955040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:19.955788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:19.973507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.974367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.975415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:19.976342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:19.977136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:19.977759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.028993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:20.029803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:20.042401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.042934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.043451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.044281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.044688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.056996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.150319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'services' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:20.183965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:20.187704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:20.193267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5afb4b28-38d3-4320-b1ea-1b9aafa21313 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1331 microversion: 2.1 time: 0.170604 Aug 27 20:54:20.198458 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 855/1626] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:20 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1331 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:20.307018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments/d1446df3-c151-4097-b737-85c00a26dec0" status: 202 len: 0 microversion: 2.25 time: 0.357965 Aug 27 20:54:20.308177 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 772/1627] 10.222.0.40 () {60 vars in 1457 bytes} [Sat Aug 27 20:54:19 2022] DELETE /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments/d1446df3-c151-4097-b737-85c00a26dec0 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:20.322218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:20.324871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:20.332712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.333501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.334115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.334897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.335503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.335998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.373847 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3bc6e88a-3238-42a0-8972-3d9c37c53050 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061336 Aug 27 20:54:20.375719 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 856/1628] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:54:20 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:54:20.635943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:20.638302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:20.645399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.646233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.646845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.647807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.648438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.649060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.897633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:20.909267 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfc64d95-7cee-4913-a328-b027a4dd7e27 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.277878 Aug 27 20:54:20.910485 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 773/1629] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:20 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:20.929186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:20.932406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:20.942331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.942749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.943198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:20.943992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:20.944689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:20.945293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.045361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:21.071004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e2b4a6a0-444b-492e-a48b-5bbf50f2576e tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1272 microversion: 2.1 time: 0.148278 Aug 27 20:54:21.072362 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 857/1630] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:20 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:21.223126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:21.223974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:21.250947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.252761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.254792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.256876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.258173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.259685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.396621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:21.412743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:21.451027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.454421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.455787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.457507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.464097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.465352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.481740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:21.519739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62418db6-f1c1-4758-b8eb-d5f9b1584f88 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1349 microversion: 2.1 time: 0.301525 Aug 27 20:54:21.520337 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 774/1631] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:21 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1349 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:21.544989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1c6fe7e-5924-4a39-bdf5-2a7b0c55b5d9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.160315 Aug 27 20:54:21.545601 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 858/1632] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:54:21 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:54:21.931282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:21.932927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:21.952440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.952918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.959844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:21.960721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:21.961222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:21.961674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.099898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:22.102014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:22.115311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.115896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.116338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.117039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.117672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.118245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.301629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:22.313322 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd1e956e-f3e7-4027-b26b-bd9a7fb0c041 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1272 microversion: 2.1 time: 0.217195 Aug 27 20:54:22.317222 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 859/1633] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:22 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:22.439162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe6ced5-be3b-4ed0-9643-da517613624a", "name": "network-vif-plugged", "status": "completed", "tag": "d09ea84e-c50c-441e-bf59-a0c6f9da0388"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:22.460014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.460902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.461553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.486354 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] Creating event network-vif-plugged:d09ea84e-c50c-441e-bf59-a0c6f9da0388 for instance afe6ced5-be3b-4ed0-9643-da517613624a on nch2-master-1 Aug 27 20:54:22.498851 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fc505a90-336f-4259-97c8-c469ed80f779 req-c1d0a7a6-203b-4dc3-9f1c-d4a66035ba29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064504 Aug 27 20:54:22.502626 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 860/1634] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:54:22.504157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:22.522119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f6790f8-189a-4215-a06a-a5f985271320 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.594088 Aug 27 20:54:22.525796 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 775/1635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:21 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:22.545983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:22.547071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:22.564367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.565211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:22.568481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.572607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:22.573058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.574097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.578306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.579041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.599772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.606721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.607515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.608567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:22.609238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:22.609885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:22.697901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88a774d3-1b53-49e2-9772-d88bcb36dd88 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.136257 Aug 27 20:54:22.699224 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 776/1636] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 20:54:22 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:22.811709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:22.824533 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-daca5f01-6553-4259-aba9-0f7bb17fd631 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1337 microversion: 2.1 time: 0.279807 Aug 27 20:54:22.834492 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 861/1637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:22 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1337 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:23.338823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:23.353532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:23.369071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:23.371937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:23.372581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:23.373358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:23.374025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:23.374468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:23.551020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:23.551663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:23.584732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:23.585522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:23.586299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:23.587196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:23.587832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:23.589193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:24.127301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:24.136705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2923838f-00ae-4c62-8e9c-cc1e4d225209 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.802149 Aug 27 20:54:24.137298 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 777/1638] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:23 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:24.158973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:24.159650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:24.178664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:24.179515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:24.179723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:24.182702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:24.183182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:24.183648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:24.405494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:24.416794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b85bf2e2-c91a-44b4-93fe-0f3dd445ff04 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1325 microversion: 2.1 time: 0.869579 Aug 27 20:54:24.431422 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 862/1639] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:23 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1325 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:24.470594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:24.484659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47562cf9-b66c-483a-894e-d68fcaf46130 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1337 microversion: 2.1 time: 0.334332 Aug 27 20:54:24.498836 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 778/1640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:24 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1337 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:25.160167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:25.160802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:25.195412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:25.196227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:25.200417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:25.207453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:25.210995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:25.211522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:25.448424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:25.452104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:25.470548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:25.471050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:25.478539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:25.479606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:25.480244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:25.484200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:26.476116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:26.485651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02aeb718-be15-401d-96ff-49063ae3f7f3 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 1.331069 Aug 27 20:54:26.486946 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 863/1641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:25 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:26.505249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:26.505979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:26.514154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:26.515034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:26.515744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:26.516666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:26.517328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:26.517970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:26.547808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:26.552341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:26.575396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dba4e806-7e0f-4fe3-bb7f-fee59e4b5a6f tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1522 microversion: 2.1 time: 1.138488 Aug 27 20:54:26.593063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 779/1642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:25 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1522 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:26.619581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:26.624730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:26.632760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:26.634699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:26.636443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:26.637444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:26.644214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:26.648025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.448741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:27.464162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-631eb74e-c19a-42a0-950a-35c1613d4a49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.975298 Aug 27 20:54:27.467495 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 864/1643] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:26 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:27.478151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:27.479662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:27.493773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.494649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.496180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.497145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.497791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.498423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.544131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:54:27.562973 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da665af1-5b19-4775-8a37-dded784362b0 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1812 microversion: 2.1 time: 0.968066 Aug 27 20:54:27.564050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 780/1644] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:26 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1812 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:27.584426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd0d0c-4b30-49a0-b65f-447d25c1923d", "tag": "2b2ff67b-3109-4685-9968-58b3a6073718"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:27.621964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:27.629467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.629987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.637015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.667917 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] Creating event network-changed:2b2ff67b-3109-4685-9968-58b3a6073718 for instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d on nch1-master-1 Aug 27 20:54:27.698582 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b460a16e-55a8-493c-a491-c151e50ef4fb req-4c6fc50d-59aa-4ece-87b4-017b890d8b95 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129530 Aug 27 20:54:27.700073 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 781/1645] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:27.713482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:27.720078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:27.741000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.741780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.744291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.746153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.747906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.748610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.911038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3fd08fb-3074-4c57-b2f2-9410c8d3880d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 204 len: 0 microversion: 2.1 time: 0.440818 Aug 27 20:54:27.912958 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 865/1646] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:27 2022] DELETE /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:27.925108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:27.947656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.949046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.951406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:27.954060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:27.955370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:27.956625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.040073 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1535865d-fa25-4727-a066-dbaba1f73c92 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.122633 Aug 27 20:54:28.062665 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 866/1647] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:54:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:28.084777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:28.087116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:28.095582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:28.108389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:28.108971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:28.109315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.110024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:28.110479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:28.113086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:28.118291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.136085 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-439f1dd5-b46d-40f3-9323-556820ab3e50 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.434355 Aug 27 20:54:28.139813 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 782/1648] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:27 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:28.244782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:28.262742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=16 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:28.268513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:28.269597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:28.274596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.327418 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] Creating event network-changed:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:54:28.345539 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e94743b5-08f3-4171-a42e-51ea05f683cb req-dd53f1a0-9369-4258-bfec-2795aaddb463 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105725 Aug 27 20:54:28.347247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 783/1649] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:28.493984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:28.495998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:28.542375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:28.542878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:28.543320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.546725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:28.547835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:28.548486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:28.697077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:28.717862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9aeb5dcf-8234-4ee0-859c-33a22ec11af7 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1528 microversion: 2.1 time: 0.654013 Aug 27 20:54:28.733931 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 867/1650] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:28 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1528 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:28.933333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:28.968101 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2bafa183-6959-43c5-9b4a-739b0eb9408e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.479779 Aug 27 20:54:28.968994 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 784/1651] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:28 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:29.155045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:29.160298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:29.161189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:29.184302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:29.186278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:29.186929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:29.188982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:29.189453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:29.189882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:29.748414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:29.749290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:29.766498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:29.767401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:29.773596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:29.775202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:29.777800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:29.787084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:30.224245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:30.239540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d98b815e-15df-4904-82be-84c1f4391197 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 1.085577 Aug 27 20:54:30.240148 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 868/1652] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:29 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:30.245591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:30.251635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:30.272015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:30.274630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:30.275301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:30.275913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:30.279195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:30.279896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:30.282971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:30.637219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:30.656492 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f5f37ca-9a7f-44a8-b030-e48516a20659 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1528 microversion: 2.1 time: 0.916836 Aug 27 20:54:30.657091 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 785/1653] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:29 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1528 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:30.678531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ccf977a-1a3d-47cc-9d34-799b322f16cd", "device": "/dev/xvdb"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:30.682446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:30.710642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:30.711823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:30.712721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:30.713650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:30.714297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:30.715546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:31.203893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:31.217353 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4edba0d-78a2-4fd1-a6c9-42cef577560e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.975731 Aug 27 20:54:31.220560 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 869/1654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:30 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:31.261488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:31.262091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:31.272491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:31.291444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:31.296189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:31.297254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:31.298103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:31.298746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:31.314040 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-746936f9-a280-4141-81f5-21d9406da2f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655541 Aug 27 20:54:31.316343 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 786/1655] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 20:54:30 2022] POST /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:31.681588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:31.683195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:31.704366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:31.705419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:31.706872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:31.708414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:31.709288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:31.710748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:31.866966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:31.886552 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-677c849e-d775-445b-868a-977275e79003 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.629674 Aug 27 20:54:31.887853 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 870/1656] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:31 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:32.170381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:32.204151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a545f36d-bda5-4bea-bc4a-b0e16b160ae9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1528 microversion: 2.1 time: 0.518653 Aug 27 20:54:32.206158 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 787/1657] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:31 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:32.243282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:32.244256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:32.256159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:32.259670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:32.260454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:32.265283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:32.271320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:32.273789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:32.317687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe6ced5-be3b-4ed0-9643-da517613624a", "name": "network-vif-deleted", "tag": "d09ea84e-c50c-441e-bf59-a0c6f9da0388"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:32.344263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:32.344748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:32.349789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:32.378353 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] Creating event network-vif-deleted:d09ea84e-c50c-441e-bf59-a0c6f9da0388 for instance afe6ced5-be3b-4ed0-9643-da517613624a on nch2-master-1 Aug 27 20:54:32.408578 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-31d7e95b-20d0-41d4-83fe-272a0a063704 req-c6686a68-07d1-49be-bbfb-53e57e3a16f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094818 Aug 27 20:54:32.409237 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 788/1658] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:54:32.659580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:32.670795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad1891d1-44d2-4db2-9e77-e6cc3f95865d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.432482 Aug 27 20:54:32.674891 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 871/1659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:32 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:32.914668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:32.915196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:32.925767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:32.926479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:32.930921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:32.949845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:32.953505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:32.955611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:33.229025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:33.230059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:33.246145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:33.248369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:33.249170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:33.249926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:33.254639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:33.255136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:33.268696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:33.269188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:33.281836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91f4cb9b-e2c9-4eb8-a428-b6df7599eeb0 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.372631 Aug 27 20:54:33.284182 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 789/1660] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:32 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:33.385569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:33.403295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb5df90b-f9c8-47b4-8819-5bcd716ea2dc tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1486 microversion: 2.1 time: 0.179018 Aug 27 20:54:33.404237 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 872/1661] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:33 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1486 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:33.697323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:33.698379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:33.718560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:33.720186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:33.722562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:33.725127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:33.725816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:33.726695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:34.189700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:34.203629 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c17dbb35-289b-4825-b90d-cf9cae9ca58b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.510339 Aug 27 20:54:34.209904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 790/1662] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:33 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:34.312537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:34.313378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:34.335679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:34.339155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:34.341732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:34.343701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:34.347191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:34.347896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:34.430640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:34.431306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:34.443548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:34.444092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:34.444832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:34.455718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:34.456310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:34.456758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:34.648658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:34.663681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e74f411b-5972-48e4-96e1-0d22d0c35afd tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1486 microversion: 2.1 time: 0.241417 Aug 27 20:54:34.664566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 791/1663] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:34 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1486 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:54:34.778609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:34.794251 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02eaafac-1c21-48af-83e4-0771de1b999d tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.487712 Aug 27 20:54:34.795147 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 873/1664] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:34 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:35.234395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:35.243602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:35.268300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:35.273413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:35.275221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:35.279846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:35.281901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:35.282574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:35.686344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:35.689563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:35.725831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:35.728244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:35.731851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:35.734502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:35.738380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:35.740390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:35.864422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:35.865373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:35.866366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:35.867276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lazy-loading 'fault' on Instance uuid afe6ced5-be3b-4ed0-9643-da517613624a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:36.092851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:36.107202 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6133dcd0-5420-4658-8d18-eca77d77cba1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.872704 Aug 27 20:54:36.114072 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 792/1665] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:35 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:36.136972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:36.138845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:36.154519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:36.155237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:36.157673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:36.158940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:36.160725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:36.177284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:36.195787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bdbed202cad4f2bbc0c299bf9442986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b82605298a42f8a6b7594647e5d207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:36.252574 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-16e7af25-5292-40e8-a6dc-00cbc7eac772 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 200 len: 1315 microversion: 2.1 time: 0.555464 Aug 27 20:54:36.253512 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 874/1666] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:35 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:36.416691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:36.417368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:36.444261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:36.444848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:36.445204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:36.445925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:36.446381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:36.449672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:37.151255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:37.163775 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1460958-5fca-489b-a3d2-1cdce0e13fb2 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 1.046916 Aug 27 20:54:37.180737 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 793/1667] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:36 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:37.182301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1586380591", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "6eac8f18-1d61-46f9-9a49-f3d18ace45a0"}, {"uuid": "308c893f-0f2f-4a48-a4e5-a16ec8203f0d"}, {"uuid": "6eac8f18-1d61-46f9-9a49-f3d18ace45a0"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:37.279669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] validate_networks() for [('6eac8f18-1d61-46f9-9a49-f3d18ace45a0', None, None, None, None, None), ('308c893f-0f2f-4a48-a4e5-a16ec8203f0d', None, None, None, None, None), ('6eac8f18-1d61-46f9-9a49-f3d18ace45a0', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:54:37.284329 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-945f94b9-4349-4943-82e0-b556a2378357 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1858 microversion: 2.1 time: 0.872066 Aug 27 20:54:37.290758 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 875/1668] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:36 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1858 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:37.301535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:37.302184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:37.316873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:37.320521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:37.321753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:37.322735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:37.324326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:37.326109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:37.983424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:38.314218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:38.324542 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c96c9efb-7f8a-48a6-a518-d38dbd3b675f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 1.032461 Aug 27 20:54:38.327710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 876/1669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:37 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:38.333513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:38.334129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: afe6ced5-be3b-4ed0-9643-da517613624a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:38.351551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:38.354470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:38.354942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:38.355696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:38.356155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:38.356580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:38.385213 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a HTTP/1.1 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:38.386963 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. Aug 27 20:54:38.388950 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'afe6ced5-be3b-4ed0-9643-da517613624a'} Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:38.390012 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. Aug 27 20:54:38.391964 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:38.393625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance afe6ced5-be3b-4ed0-9643-da517613624a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:38.393625 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b30edf7a-b97e-47d7-bc14-f431ab0ad286 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a" status: 404 len: 111 microversion: 2.1 time: 0.059835 Aug 27 20:54:38.393625 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 877/1670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:38 2022] GET /compute/v2.1/servers/afe6ced5-be3b-4ed0-9643-da517613624a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:38.406222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:38.409146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:38.430393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:38.431020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:38.431517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:38.432280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:38.432764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:38.433192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:38.484596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lazy-loading 'flavor' on Instance uuid cf1125bf-71bf-4cca-a222-b5d4099ccd42 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:54:38.500390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Going to try to live migrate instance to nch2-master-1 {{(pid=140434) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:54:39.821247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:54:39.821648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:54:39.822120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:54:39.824819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:54:39.825705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:54:39.839204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:39.841277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:39.841729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:39.842506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:39.842976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:39.843442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:39.914365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Getting quotas for project fe4f6d64a7bc40adb889fa76c3e13bf5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:54:39.919830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Getting quotas for user 5840825b0d3341c1ad511f2646c975a2 and project fe4f6d64a7bc40adb889fa76c3e13bf5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:54:39.947211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:54:39.949703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:54:40.109487 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dea2b819-e003-48c4-b0f9-c48682025f16 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.937335 Aug 27 20:54:40.114702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 794/1671] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:54:40.133775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:40.134415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:40.167902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:40.170962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:40.171472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:40.172286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:40.172795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:40.173228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:40.622692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:40.648279 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42d1ae43-bb7e-4120-9ef6-fce1d7a4ca19 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.528606 Aug 27 20:54:40.666152 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 795/1672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:40 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:40.677288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8d94540-d1c0-43ad-9aff-37545acd331a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff84f4034c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:40.717276 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e8d94540-d1c0-43ad-9aff-37545acd331a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Image not found. Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8d94540-d1c0-43ad-9aff-37545acd331a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53 HTTP/1.1 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:40.719283 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9f06de22-1846-4c41-a11d-edc1d1046e53'} Aug 27 20:54:40.720690 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f06de22-1846-4c41-a11d-edc1d1046e53 to delete Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:40.721537 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f06de22-1846-4c41-a11d-edc1d1046e53 could not be found. Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:40.722757 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:40.724857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8d94540-d1c0-43ad-9aff-37545acd331a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:40.743628 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8d94540-d1c0-43ad-9aff-37545acd331a tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53" status: 404 len: 62 microversion: 2.1 time: 0.073071 Aug 27 20:54:40.745295 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 796/1673] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:40 2022] DELETE /compute/v2.1/images/9f06de22-1846-4c41-a11d-edc1d1046e53 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:41.063971 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-632f300a-033f-4666-b3c2-6c054d152a98 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/action" status: 202 len: 0 microversion: 2.1 time: 2.670033 Aug 27 20:54:41.064895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 878/1674] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:54:38 2022] POST /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/action => generated 0 bytes in 2672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:54:41.076541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:41.080935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:41.120234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:41.122704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:41.123317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:41.126896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:41.128484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:41.133721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:41.210220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9808f19-7ff0-4cb5-925a-8e097d114b5f tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Action: 'create', calling method: .version_select at 0x7ff84f438670>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:41.891084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:41.950247 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ea7091f8-65c1-4b1b-bcd0-29f5edb64c3b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.878267 Aug 27 20:54:41.971918 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 879/1675] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:41 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:42.005335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd0d0c-4b30-49a0-b65f-447d25c1923d", "name": "network-vif-plugged", "status": "completed", "tag": "2b2ff67b-3109-4685-9968-58b3a6073718"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:42.062648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.065748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.066342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.124267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] Creating event network-vif-plugged:2b2ff67b-3109-4685-9968-58b3a6073718 for instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d on nch1-master-1 Aug 27 20:54:42.137078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e8a280fd-00a1-4a5d-ab7d-cca92f494cd7 req-0537a239-b258-46fa-bbf2-8ebf5fbd81bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163679 Aug 27 20:54:42.138211 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 880/1676] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:42.172379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:42.173511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:42.201735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.202521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.204020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.205518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.206347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.207521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.375296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:42.389789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b358873e-08d0-4eed-b5ca-f9a2853ccf06 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1265 microversion: 2.1 time: 0.250018 Aug 27 20:54:42.390798 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 881/1677] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:42 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:42.408706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:42.409240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:42.420226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.421561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.424653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.427908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.428917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.429393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.481839 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 HTTP/1.1 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:42.485889 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:42.487426 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '72f4d948-81e4-4742-a469-225558c65b32'} Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:42.488217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:42.489543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:42.491265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:42.492216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-335fbce5-f403-4aec-a05b-3a4fb0ecb27d tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 404 len: 111 microversion: 2.1 time: 0.099875 Aug 27 20:54:42.495009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 882/1678] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:42 2022] DELETE /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:42.507293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:42.508861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:42.525588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.526239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.527254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.529225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.529702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.533742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.929894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:42.944832 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27355516-235d-41b1-ba78-29d69e884253 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.448174 Aug 27 20:54:42.945438 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 883/1679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:42 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:42.957041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:42.962660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:42.978391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.979596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.992973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:42.994743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:42.995499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:42.996193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:43.698551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:43.738659 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b49f55b-a071-4f27-aded-3347755336a7 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.780920 Aug 27 20:54:43.743612 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 884/1680] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:42 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:43.757173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:43.758806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 72f4d948-81e4-4742-a469-225558c65b32] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:43.771980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:43.772895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:43.773510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:43.774630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:43.775156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:43.775759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:43.819857 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 HTTP/1.1 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:43.821482 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:43.823209 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '72f4d948-81e4-4742-a469-225558c65b32'} Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:43.824238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. Aug 27 20:54:43.825734 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:43.831414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 72f4d948-81e4-4742-a469-225558c65b32 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:43.832536 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9863b4df-8eb6-4aa1-a47d-7deed6007950 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32" status: 404 len: 111 microversion: 2.1 time: 0.085443 Aug 27 20:54:43.835541 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 885/1681] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:43 2022] GET /compute/v2.1/servers/72f4d948-81e4-4742-a469-225558c65b32 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:43.845800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:43.848724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:43.863014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:43.864212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:43.864839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:43.866007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:43.867254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:43.868450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:44.646623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:44.665475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9de4166c-c3f0-471e-a33b-1979c49dab0e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.828279 Aug 27 20:54:44.669699 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 886/1682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:43 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:44.709120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:44.717920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:44.759248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:44.765239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:44.767006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:44.768568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:44.770649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:44.773082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:45.000915 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9808f19-7ff0-4cb5-925a-8e097d114b5f tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.253786 Aug 27 20:54:45.010417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 797/1683] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:54:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:45.042034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f656812c-a06a-4817-bb25-d423fda22ed4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff857d1b5e0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:45.076700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:45.096124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a9928dd-418e-4144-88fa-69202e8d8cb8 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1271 microversion: 2.1 time: 0.404364 Aug 27 20:54:45.097485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 887/1684] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:44 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1271 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:45.118764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:45.120028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:45.125156 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f656812c-a06a-4817-bb25-d423fda22ed4 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497563592" status: 202 len: 0 microversion: 2.1 time: 0.111570 Aug 27 20:54:45.126616 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 798/1685] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 20:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497563592 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:54:45.138683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:45.139486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:45.140127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:45.144228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:45.144808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:45.147543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:45.228343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-plugged", "status": "completed", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:45.245615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:45.246486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:45.247397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:45.264734 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] Creating event network-vif-plugged:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:54:45.274266 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-eddff742-fb71-4e81-8984-2c83eeb8d538 req-15950960-1d05-49f4-95c2-8865b7043ae7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145202 Aug 27 20:54:45.275329 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 799/1686] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:45.284792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:45.285825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:45.305027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:45.305840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:45.306592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:45.307769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:45.308391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:45.309281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:46.065545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:46.083530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2965f515-1880-4e12-938b-62fdad66d608 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1314 microversion: 2.1 time: 0.804205 Aug 27 20:54:46.089182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:46.098819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 800/1687] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:45 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:46.116262 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b17d0298-6b40-4814-a449-e14e58a40bcb tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 1.017354 Aug 27 20:54:46.121546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 888/1688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:45 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:46.127673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c01caf0c-4525-444f-962c-75fa004f253d tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Action: 'create', calling method: .version_select at 0x7ff857d19430>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:46.151985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:46.152619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:46.182876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:46.183731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:46.184650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:46.185596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:46.188741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:46.192904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:46.220740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:46.869810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:46.879093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5646b4ff-80cd-4db8-bf1d-6e8955aaee1e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1379 microversion: 2.1 time: 0.752618 Aug 27 20:54:46.899731 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 889/1689] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:46 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1379 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:46.912327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:46.914884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:46.937794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:46.940239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:46.940900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:46.944415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:46.945385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:46.947972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:47.304691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:47.317941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7f04fe1-07f9-4fd5-bc79-5dd97492601f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1313 microversion: 2.1 time: 0.415460 Aug 27 20:54:47.336381 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 890/1690] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:46 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:47.341982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:47.348235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:47.359510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:47.363354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:47.364016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:47.364949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:47.372652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:47.373357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:47.822774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:47.844556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-baf9bb1f-2b98-406b-b8d3-71251896abd4 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1464 microversion: 2.1 time: 0.506303 Aug 27 20:54:47.845355 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 891/1691] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:47 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1464 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:47.877426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:47.883704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:47.912379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:47.916422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:47.917829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:47.920533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:47.923270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:47.923847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:48.263320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:48.277822 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-40c72f98-ad5a-41e4-a317-d5c6886b9739 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.430906 Aug 27 20:54:48.294409 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 892/1692] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:47 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:48.564454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Calling method '.version_select at 0x7ff84ec73700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:48.593810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:48.598289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:48.598947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:48.640041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:48.640717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:48.641170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:48.677747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44df58fe-0a0b-4beb-a74b-159bb0bd8e20 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/f93e6d3811364c5695ab9a06e0418bf8?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667" status: 200 len: 695 microversion: 2.1 time: 0.382081 Aug 27 20:54:48.687836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 893/1693] 10.222.0.40 () {58 vars in 1412 bytes} [Sat Aug 27 20:54:48 2022] GET /compute/v2.1/os-simple-tenant-usage/f93e6d3811364c5695ab9a06e0418bf8?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667 => generated 695 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:48.702296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:48.702924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:48.714017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:48.714749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:48.718816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:48.719899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:48.720694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:48.721300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.430986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c01caf0c-4525-444f-962c-75fa004f253d tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.329247 Aug 27 20:54:49.432906 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 801/1694] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:54:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:49.441068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:49.443995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:49.461877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.462594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.463476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.465433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.467238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.472048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.534650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:49.588663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:49.604503 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15c80a5d-7e57-4568-93ed-b4adbecac894 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1529 microversion: 2.1 time: 0.912172 Aug 27 20:54:49.607783 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 894/1695] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:48 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1529 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:49.620172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '.version_select at 0x7ff84ed15940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:49.678207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.678964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.680942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.713740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.716563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.717270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.752367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c57aee2d-73eb-4225-9859-bd92794e809a tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/f93e6d3811364c5695ab9a06e0418bf8?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667" status: 200 len: 695 microversion: 2.1 time: 0.143067 Aug 27 20:54:49.756323 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 895/1696] 10.222.0.40 () {58 vars in 1412 bytes} [Sat Aug 27 20:54:49 2022] GET /compute/v2.1/os-simple-tenant-usage/f93e6d3811364c5695ab9a06e0418bf8?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667 => generated 695 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:49.764409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:49.768085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:49.788731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.790307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.792474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.793790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:49.795003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:49.796597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:49.863782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:49.932171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:50.001399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:50.012211 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78d4926a-a992-4c36-afcc-f2e4c8598dbf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1334 microversion: 2.1 time: 0.577688 Aug 27 20:54:50.022935 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 802/1697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:49 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1334 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:50.038767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f933028c-9861-4328-9b0c-1170d78b893e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '.version_select at 0x7ff84f69bca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:50.104314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f933028c-9861-4328-9b0c-1170d78b893e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Image not found. Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f933028c-9861-4328-9b0c-1170d78b893e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/images/c7ca1e49-d710-4d89-8b6f-4c4f768e79e0 HTTP/1.1 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:50.105469 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'c7ca1e49-d710-4d89-8b6f-4c4f768e79e0'} Aug 27 20:54:50.107113 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7ca1e49-d710-4d89-8b6f-4c4f768e79e0 to delete Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:50.108224 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7ca1e49-d710-4d89-8b6f-4c4f768e79e0 could not be found. Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:50.109820 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f933028c-9861-4328-9b0c-1170d78b893e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:50.111795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f933028c-9861-4328-9b0c-1170d78b893e tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/images/c7ca1e49-d710-4d89-8b6f-4c4f768e79e0" status: 404 len: 62 microversion: 2.1 time: 0.079539 Aug 27 20:54:50.112947 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 803/1698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:50 2022] DELETE /compute/v2.1/images/c7ca1e49-d710-4d89-8b6f-4c4f768e79e0 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:54:50.116800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb24f4b3-db16-493d-acb6-791de47aaec4 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Action: 'create', calling method: .version_select at 0x7ff857d60790>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:50.425432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:50.439468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-949a395d-c1a3-4a4a-a111-e5e9bdb6bcae tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.678064 Aug 27 20:54:50.440367 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 896/1699] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:49 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:50.456222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:50.458190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:50.474199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:50.478101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:50.481525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:50.485315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:50.486990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:50.490669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.447152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:51.466787 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95604dcf-6889-4bb5-91b2-b8c8f8725a72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1529 microversion: 2.1 time: 1.021380 Aug 27 20:54:51.469775 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 897/1700] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:50 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1529 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:51.477783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Calling method '.version_select at 0x7ff84ed72280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:51.493451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.494887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.496337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.525208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.526296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.527225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.653778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6cd081c-c3bd-4139-822d-d86d9644ab55 tempest-TenantUsagesTestJSON-1355028893 tempest-TenantUsagesTestJSON-1355028893-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667&detailed=1" status: 200 len: 17430 microversion: 2.1 time: 0.181850 Aug 27 20:54:51.655118 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 898/1701] 10.222.0.40 () {58 vars in 1335 bytes} [Sat Aug 27 20:54:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T20%3A54%3A47.863667&end=2022-08-28T20%3A54%3A47.863667&detailed=1 => generated 17430 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:54:51.660300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:51.660809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:51.671893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.672506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.674144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.675035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.676875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.682074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.699382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 HTTP/1.1 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:51.702007 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:51.703984 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228'} Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:51.705021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:51.707386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:51.708881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:51.708881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4ee86cf-1593-4807-a6fb-3f46e26375fa tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "DELETE /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 404 len: 111 microversion: 2.1 time: 0.050173 Aug 27 20:54:51.713364 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 899/1702] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:51 2022] DELETE /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:51.724536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:51.725420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:51.731839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.732481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.733012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:51.733982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:51.734655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:51.735481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.168525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:52.177590 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a20b2629-e1b2-4c7f-bfd0-9b36d393f798 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.466825 Aug 27 20:54:52.185777 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 900/1703] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:51 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:52.350051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:52.358879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:52.359767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:52.360593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.388071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] Creating event network-vif-unplugged:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch1-master-1 Aug 27 20:54:52.405558 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-92f38d61-43c5-4321-9624-68697f412765 req-db714447-9f57-43ec-b4c7-05b647004d70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.212362 Aug 27 20:54:52.406197 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 901/1704] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:52.411518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:52.412332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:52.445836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:52.446380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:52.447010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.447888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:52.448507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:52.448940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.733558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:52.744966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee5f4417-667b-489f-8aaf-46aed5653020 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.337507 Aug 27 20:54:52.747601 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 902/1705] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:52 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:52.757194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c50308b-24a5-4cf0-a7e6-f8d312cea0ad tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:52.800046 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c50308b-24a5-4cf0-a7e6-f8d312cea0ad tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/a00ab627-416a-4fbc-8a09-8c603df7a452" status: 202 len: 0 microversion: 2.1 time: 0.050987 Aug 27 20:54:52.801764 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 903/1706] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:52 2022] DELETE /compute/v2.1/flavors/a00ab627-416a-4fbc-8a09-8c603df7a452 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:54:52.813528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:52.815868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:52.831903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:52.832682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:52.833293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.834254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:52.835926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:52.836521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:52.893571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:54:53.098708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0b5fc64a-11e9-4c8f-9c98-53726fd132f8 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "DELETE /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 204 len: 0 microversion: 2.1 time: 0.294536 Aug 27 20:54:53.099998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 904/1707] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:54:52 2022] DELETE /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:54:53.105795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:53.107635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] [instance: 41be0bb9-c6da-4ddd-9b82-0d0295cff228] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:53.114576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.115534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.116199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.117634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.118292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.118944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.137751 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] HTTP exception thrown: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Request method failure captured: Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 HTTP/1.1 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoQH1hrh7VoDLWSvjFxfDOyHJwz7NeHsaYnZ2KpGPKGZax8n8NVsrnxRzjpHl9ozpZuihKuQRw6NKb0zKxG3fBtYyqWeNRJvvW0Bs5qj5xZ9f-Ifr_U77J9tgbQu6Rw_xA89BNTbXoYlozRlEEvnGZFSvpjtIPWcbI1GLEu44j3yC9Q Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:54:53.140144 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43b82605298a42f8a6b7594647e5d207"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43b82605298a42f8a6b7594647e5d207", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43b82605298a42f8a6b7594647e5d207"}]}] Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43b82605298a42f8a6b7594647e5d207 Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812 Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0bdbed202cad4f2bbc0c299bf9442986 Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143160812-project Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:53.142442 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '41be0bb9-c6da-4ddd-9b82-0d0295cff228'} Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:53.143447 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. Aug 27 20:54:53.144992 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:54:53.149768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] Returning 404 to user: Instance 41be0bb9-c6da-4ddd-9b82-0d0295cff228 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:53.151201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a447f3a5-38f3-46ca-923e-12bca8946ea9 tempest-ImagesOneServerNegativeTestJSON-2143160812 tempest-ImagesOneServerNegativeTestJSON-2143160812-project] 10.222.0.40 "GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228" status: 404 len: 111 microversion: 2.1 time: 0.049757 Aug 27 20:54:53.152378 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 905/1708] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:53 2022] GET /compute/v2.1/servers/41be0bb9-c6da-4ddd-9b82-0d0295cff228 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:53.165800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c8b1c7f-9fea-4e5e-9d6b-406bcfb26fc3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:53.189304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c8b1c7f-9fea-4e5e-9d6b-406bcfb26fc3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035181 Aug 27 20:54:53.190506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 906/1709] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:54:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:53.199271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:53.200817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:53.208160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.208749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.209554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.210876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.211983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.212466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.461892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:53.473980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34902ee5-96b4-42fd-9e51-f06386389061 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1470 microversion: 2.1 time: 0.282334 Aug 27 20:54:53.475932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 907/1710] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:53 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:53.494682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:53.495438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:53.505511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.509266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.510077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.513979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.514925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.515742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.529699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fb24f4b3-db16-493d-acb6-791de47aaec4 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.421230 Aug 27 20:54:53.530296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 804/1711] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:54:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:53.535461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:53.540382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:53.558239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.558725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.559354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.560219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.560840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.561421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.621400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:53.637169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Old instance type tempest-test_resize_flavor_-1350510843, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 20:54:53.654714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:54:53.656471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:54:53.659116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:54:53.659726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:54:53.660384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:54:53.691963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:53.704850 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-926d3eee-76bc-4fa6-a025-fc03b506bc15 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.226995 Aug 27 20:54:53.707142 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 908/1712] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:53 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:53.713368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3de35c39-d895-4c51-a481-001a19b9640d tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Action: 'create', calling method: .version_select at 0x7ff84ec5a160>, body: {"pool": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:53.824065 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bff37f5b-a129-4fb2-b0e3-5dd96cc16468 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515/action" status: 202 len: 0 microversion: 2.1 time: 0.292644 Aug 27 20:54:53.829827 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 805/1713] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:54:53 2022] POST /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:54:53.952231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "tag": "c5032edf-0fb8-4555-90fd-1c853c53839f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:53.962454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:53.963162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:53.963801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:53.986671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] Creating event network-changed:c5032edf-0fb8-4555-90fd-1c853c53839f for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:54:54.002807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d95ff7f3-e016-414a-ab07-b0341e12e204 req-a39d4b40-16d2-440a-997a-a20227ee44e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171595 Aug 27 20:54:54.005931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 806/1714] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:54.055236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:54.060053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:54.093945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:54.094933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:54.096467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:54.098468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:54.101612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:54.102246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:54.658767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:54.683929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b09a8d8-e9ad-4420-b3f3-a5abf431c2c4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.676622 Aug 27 20:54:54.705838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 807/1715] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:54 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:54.717863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:54.718613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:54.735877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:54.736687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:54.737535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:54.738485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:54.739157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:54.739810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.133056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:55.157269 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25d4463f-366a-4b2d-b1a8-99784ae01507 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1538 microversion: 2.1 time: 0.448840 Aug 27 20:54:55.159829 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 808/1716] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:54 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1538 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:55.174965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:55.176825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:55.193071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.195851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.196414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.199899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.201733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.202299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.507192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:55.531560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d56040b2-e6f9-4ec5-b259-3d89e040efaa tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1470 microversion: 2.1 time: 0.367940 Aug 27 20:54:55.532941 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 809/1717] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:55 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:55.540805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:55.614072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.615496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.616575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.641130 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] Creating event network-changed:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch1-master-1 Aug 27 20:54:55.649703 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3b0180b8-9872-4710-b732-0a5df892c99f req-8ac593fb-c67d-4b49-9d38-198ec2a45d0b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114969 Aug 27 20:54:55.651071 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 810/1718] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:55.660259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:55.661867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:55.672899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.673701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.674483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.675481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.676249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.677570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.892974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:55.904214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46fe0e4b-f48e-4c9e-b096-15108e451d72 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.251328 Aug 27 20:54:55.904817 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 811/1719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:55 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:55.933583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:55.934711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:55.950724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.951137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.951612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:55.952562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:55.953175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:55.953766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:56.284387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:56.299248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dafc6cc9-60c2-4364-8ff1-edd83c99d55f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.376749 Aug 27 20:54:56.321692 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 812/1720] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:55 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:56.330908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:56.331733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:56.340587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:56.341694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:56.342460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:56.343330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:56.343960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:56.344582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:56.754523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:56.763038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-74657092-d9f8-4d6a-9ed2-650d195e3f45 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1538 microversion: 2.1 time: 0.440009 Aug 27 20:54:56.771388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 813/1721] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:56 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1538 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:56.771388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:56.771388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:56.772074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3de35c39-d895-4c51-a481-001a19b9640d tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.062636 Aug 27 20:54:56.775606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:56.776166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:56.776544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:56.777253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:56.777708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:56.778131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:56.780009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 909/1722] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:54:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:56.784968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74c5f4e5-4e8e-4c84-b14b-79f904c5783c tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff84ebe5ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:57.480515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74c5f4e5-4e8e-4c84-b14b-79f904c5783c tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/f878a275-7d82-45d2-ae47-c74f0e9d6d8f" status: 200 len: 142 microversion: 2.1 time: 0.699247 Aug 27 20:54:57.481338 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 910/1723] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:54:56 2022] GET /compute/v2.1/os-floating-ips/f878a275-7d82-45d2-ae47-c74f0e9d6d8f => generated 142 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:57.485804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:57.488173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:57.541832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:57.542783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:57.543401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:57.544017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:57.548756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:57.550239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:57.610051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f179068b17943c9a2574fd3a15cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93e6d3811364c5695ab9a06e0418bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:57.632439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3eb17813-670b-4ef6-b182-01a5bbaccf83 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 200 len: 1470 microversion: 2.1 time: 0.860128 Aug 27 20:54:57.648112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 814/1724] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:56 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 1470 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:57.653323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:57.654323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:57.661434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:57.662417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:57.663092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:57.664111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:57.664794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:57.665434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:58.310952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:58.316615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:58.324453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-46682948-ec9b-47bd-a5ad-8c033ca92c6d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.837180 Aug 27 20:54:58.325826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 911/1725] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:57 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:58.342641 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0083ac98-bdf1-481b-9345-0a3d379f3b44 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.676485 Aug 27 20:54:58.346812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 815/1726] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:57 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:58.370192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:58.387298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:58.387477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6055fe99-5d5d-4889-b719-cf521fd95113 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff84ec5aca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:58.390895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:58.405875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:58.406520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:58.407017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:58.409480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:58.409968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:58.410409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:59.241559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:54:59.258948 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f9b6148-4834-400e-a934-64db2ad6842b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1538 microversion: 2.1 time: 0.892919 Aug 27 20:54:59.260059 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 816/1727] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:58 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1538 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:54:59.271905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd0d0c-4b30-49a0-b65f-447d25c1923d", "name": "network-vif-deleted", "tag": "2b2ff67b-3109-4685-9968-58b3a6073718"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:54:59.295618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:59.296100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:59.296734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:59.308868 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] Creating event network-vif-deleted:2b2ff67b-3109-4685-9968-58b3a6073718 for instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d on nch1-master-1 Aug 27 20:54:59.314425 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-194dcc19-143a-4220-82e8-1450e515eef0 req-f274d3f1-2c43-496b-ad1b-5a9cf1da15c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053102 Aug 27 20:54:59.315600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 817/1728] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:54:59.322271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:59.322982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] [instance: 75dd0d0c-4b30-49a0-b65f-447d25c1923d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:59.329926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:59.330675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:59.331583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:59.332547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:59.333829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:59.334631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:59.360062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] HTTP exception thrown: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Request method failure captured: Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d HTTP/1.1 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoR1h-M4KH1cwjrBK6kMKgjFt4RP_lBsQw6RFiNllsqAuBo2vjTo6ss9wi8TabmzQJDSsY0wc3PtnBx3nkqw12cds53W6zIDJXkrc6MPBK2Mu1Gr2vOUGzx9Gcvqf4NM9ggzeDWIjBSI6BHuE-Jx8GgWt1DcXXJ-Hh7mLaS9WkIiKX8 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f93e6d3811364c5695ab9a06e0418bf8 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TenantUsagesTestJSON-1152672898 Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:54:59.363875 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f93e6d3811364c5695ab9a06e0418bf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f93e6d3811364c5695ab9a06e0418bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f93e6d3811364c5695ab9a06e0418bf8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f93e6d3811364c5695ab9a06e0418bf8"}]}] Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TenantUsagesTestJSON-1152672898 Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f93e6d3811364c5695ab9a06e0418bf8 Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1152672898 Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TenantUsagesTestJSON-1152672898-project Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 9f179068b17943c9a2574fd3a15cec90 Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TenantUsagesTestJSON-1152672898-project Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. Aug 27 20:54:59.366055 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '75dd0d0c-4b30-49a0-b65f-447d25c1923d'} Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:54:59.366984 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. Aug 27 20:54:59.368834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:54:59.370509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] Returning 404 to user: Instance 75dd0d0c-4b30-49a0-b65f-447d25c1923d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:54:59.371868 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29627721-7690-4694-986e-1cee85bc4787 tempest-TenantUsagesTestJSON-1152672898 tempest-TenantUsagesTestJSON-1152672898-project] 10.222.0.40 "GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d" status: 404 len: 111 microversion: 2.1 time: 0.054238 Aug 27 20:54:59.372551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 818/1729] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:59 2022] GET /compute/v2.1/servers/75dd0d0c-4b30-49a0-b65f-447d25c1923d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:54:59.383096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:54:59.384065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:54:59.393308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:59.394787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:59.395572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:54:59.396924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:54:59.397604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:54:59.398927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:00.064265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:00.075866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a80bac5c-9821-4252-a569-09862f32add5 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.698644 Aug 27 20:55:00.077350 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 819/1730] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:54:59 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:00.082448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:00.083391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:00.097297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:00.098802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:00.099570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:00.101121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:00.102611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:00.103273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:00.494696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:00.512956 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d8888c2-4f1c-4da1-916f-2144cd4d5d9e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.434203 Aug 27 20:55:00.513709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 820/1731] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:00 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:00.523469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:00.524095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:00.541210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:00.541715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:00.542155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:00.542871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:00.544765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:00.546210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:01.257923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:01.278435 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9682d62c-1ba4-4d28-82c7-c6be8b78b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.760210 Aug 27 20:55:01.279239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 821/1732] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:00 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:01.292012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:01.294148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:01.323048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:01.332420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:01.336648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:01.337596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:01.341369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:01.342014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:01.373252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6055fe99-5d5d-4889-b719-cf521fd95113 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/f878a275-7d82-45d2-ae47-c74f0e9d6d8f" status: 202 len: 0 microversion: 2.1 time: 3.045565 Aug 27 20:55:01.377179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 912/1733] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:54:58 2022] DELETE /compute/v2.1/os-floating-ips/f878a275-7d82-45d2-ae47-c74f0e9d6d8f => generated 0 bytes in 3050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:55:01.390285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22b3fe22-7e2e-4735-a4bc-5a53152743e1 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff84ec65a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:01.396365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:01.523587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:02.071692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22b3fe22-7e2e-4735-a4bc-5a53152743e1 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.689142 Aug 27 20:55:02.073062 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 913/1734] 10.222.0.40 () {58 vars in 1164 bytes} [Sat Aug 27 20:55:01 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:55:02.091671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "tag": "dbc60c68-865c-49b0-87a6-e8bffca0988a"}, {"name": "network-changed", "server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "tag": "ee33ffe3-4e36-4cc8-bdda-0db799505b22"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:02.104275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:02.107120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:02.107781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:02.108783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:02.118176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:02.127474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Creating event network-changed:dbc60c68-865c-49b0-87a6-e8bffca0988a for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:02.128382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] Creating event network-changed:ee33ffe3-4e36-4cc8-bdda-0db799505b22 for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:02.140133 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4485d368-3ccc-44c9-a815-ca329a36f558 req-cff4a32a-add2-4e06-b693-b8a5b183e510 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065595 Aug 27 20:55:02.142983 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 914/1735] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:02.152406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:02.154271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:02.169056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:02.188123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:02.189445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:02.190616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:02.191154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:02.191947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:02.893532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:02.926023 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ebd8ac2-1a3d-4412-b31a-63669481511a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 1.644086 Aug 27 20:55:02.939932 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 822/1736] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:01 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:02.939932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d639edaa-0ed4-42a1-b033-e3ce040404cc tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff857d60700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:03.408815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:03.421852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07c6f085-7f73-4b67-a611-4d7b7ac35948 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 1.276929 Aug 27 20:55:03.434681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d639edaa-0ed4-42a1-b033-e3ce040404cc tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.500579 Aug 27 20:55:03.434681 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 823/1737] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 20:55:02 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:03.439489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:03.439489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:03.439905 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 915/1738] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:02 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:03.448890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c52eb33c-7b9a-4baa-a9e8-6c48a990025e tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff857dcb700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:03.455286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:03.455588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:03.460846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:03.461631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:03.462107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:03.463588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:03.877500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:03.888824 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5009ec9-9ff8-4ecb-b14e-d69263a61380 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.457441 Aug 27 20:55:03.889738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 824/1739] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:03 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:03.955487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:03.957055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:03.967611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:03.968631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:03.969354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:03.970273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:03.971226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:03.971839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:04.289315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:04.304349 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eb199853-9468-40a5-adb2-8de001379ae4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.360000 Aug 27 20:55:04.307895 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 825/1740] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:03 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:04.449527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:04.450230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:04.465171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:04.465171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:04.465553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:04.466847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:04.467866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:04.468489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:04.770144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:04.790315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f65af2e8-0479-4b0b-8e6e-6691cdb4d577 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.346117 Aug 27 20:55:04.790931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 826/1741] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:04 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:04.932138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:04.934402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:04.948103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:04.948806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:04.949842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:04.951506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:04.952223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:04.952991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:05.168433 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c52eb33c-7b9a-4baa-a9e8-6c48a990025e tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/7e384fa6-f4ce-46fa-8b07-971ecc230b1f" status: 202 len: 0 microversion: 2.1 time: 1.723566 Aug 27 20:55:05.169846 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 916/1742] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:55:03 2022] DELETE /compute/v2.1/os-floating-ips/7e384fa6-f4ce-46fa-8b07-971ecc230b1f => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:55:05.181921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85e3e66c-0828-4de9-834a-be849130fd59 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff84ebe54c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:05.364880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:05.384950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9cabeb9a-8a46-4f17-bf87-cdddc8f0fa5b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.464584 Aug 27 20:55:05.412319 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 827/1743] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:04 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:05.417255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:05.421679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:05.435652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:05.436478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:05.437941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:05.442633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:05.443127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:05.443726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:06.009990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:06.024475 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ced8827f-b492-4d29-9bf9-d7257e0b7688 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.617761 Aug 27 20:55:06.025283 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 828/1744] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:05 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:06.040752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:06.045175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:06.071807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:06.074208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:06.074930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:06.079169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:06.084220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:06.084930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:06.733855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:06.747593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0eaaa2df-0db8-4d0b-9a04-917cfae40666 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.719810 Aug 27 20:55:06.748582 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 829/1745] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:06 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:06.754590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:06.755213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:06.763614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:06.764771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:06.765540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:06.768255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:06.768954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:06.769724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:07.245450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:07.253789 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa6a0ba7-264f-4008-8ce9-e53eb453e504 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.503779 Aug 27 20:55:07.260137 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 830/1746] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:06 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:07.267570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:07.273404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:07.294963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:07.299200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:07.302683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:07.304593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:07.305342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:07.305964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:07.629500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85e3e66c-0828-4de9-834a-be849130fd59 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/fd1a9c47-2fad-44a4-a880-18e84376c095" status: 202 len: 0 microversion: 2.1 time: 2.454609 Aug 27 20:55:07.631719 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 917/1747] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:55:05 2022] DELETE /compute/v2.1/os-floating-ips/fd1a9c47-2fad-44a4-a880-18e84376c095 => generated 0 bytes in 2458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:55:07.642324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92183db3-d1fb-4292-b651-2eb1012df293 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] Calling method '.version_select at 0x7ff857db95e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:07.712921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:07.727315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df856bb3-b8c4-4ac3-9e1e-98407d1461b3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.464865 Aug 27 20:55:07.731904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 831/1748] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:07 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:07.772873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:07.773597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:07.780533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:07.781042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:07.781480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:07.782212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:07.782678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:07.783101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:08.411409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:08.422602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c744a607-c198-4d82-ae48-de5c8111bb8b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1717 microversion: 2.1 time: 0.654364 Aug 27 20:55:08.438027 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 832/1749] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:07 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1717 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:08.445008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:08.445851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:08.454163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:08.454902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:08.455535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:08.456442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:08.457048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:08.457640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:08.964538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:08.980318 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0dcf563b-9053-4cc7-b59c-f138fbb14659 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.540905 Aug 27 20:55:08.981294 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 833/1750] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:08 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:08.985962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:08.986570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:08.993210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:08.994126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:08.994750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:08.995749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:08.996381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:08.997054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.347793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:09.360802 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c60bb8d1-a0f0-43be-b813-2f80c424a481 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.377308 Aug 27 20:55:09.362119 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 834/1751] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:08 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:09.445807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:09.447059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:09.454001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:09.454637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:09.455368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.456154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:09.456761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:09.457371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.774372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:09.791889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-843982c7-c46d-47e5-9222-ac02f75f91be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1707 microversion: 2.1 time: 0.350372 Aug 27 20:55:09.818043 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 835/1752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:09 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1707 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:09.829031 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92183db3-d1fb-4292-b651-2eb1012df293 tempest-FloatingIPDetailsTestJSON-1147711551 tempest-FloatingIPDetailsTestJSON-1147711551-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/f86b7c1c-291d-4bff-9441-c03944f6a3fe" status: 202 len: 0 microversion: 2.1 time: 2.192400 Aug 27 20:55:09.831809 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 918/1753] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:55:07 2022] DELETE /compute/v2.1/os-floating-ips/f86b7c1c-291d-4bff-9441-c03944f6a3fe => generated 0 bytes in 2196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:55:09.837539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1d799c8-ad37-4ff4-a795-438fd04d9725 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '.version_select at 0x7ff84ec5a9d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:09.842804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d799c8-ad37-4ff4-a795-438fd04d9725 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:09.844751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d799c8-ad37-4ff4-a795-438fd04d9725 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:09.845442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d799c8-ad37-4ff4-a795-438fd04d9725 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.853756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1478503797", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50ac8041-95db-40cf-b7b5-1165467e4b65"}], "block_device_mapping_v2": [{"uuid": "0e3b6613-4290-42c9-9b9f-bdced8970206", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:09.868005 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1d799c8-ad37-4ff4-a795-438fd04d9725 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3497 microversion: 2.1 time: 0.034855 Aug 27 20:55:09.869712 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 919/1754] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:55:09 2022] GET /compute/v2.1/os-migrations => generated 3497 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:09.890655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:09.893008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:09.916817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:09.920567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:09.923835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.925306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:09.929439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:09.930017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:09.964216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] validate_networks() for [('50ac8041-95db-40cf-b7b5-1165467e4b65', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:10.638944 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08b54f11-a0c5-4820-9116-0bc990a058f3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1858 microversion: 2.1 time: 0.756934 Aug 27 20:55:10.656766 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 920/1755] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:09 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1858 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:10.656766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:10.660775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:10.702426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:10.704039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:10.705987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:10.710569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:10.712219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:10.714704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.060546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:11.072662 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ccc0aeb1-47cb-41a5-b197-59e24d6b1b72 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.425652 Aug 27 20:55:11.073150 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 921/1756] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:10 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:11.088011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:11.088914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:11.108584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.109340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.110019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.110981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.111858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.112458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.801632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:11.817420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-096839ea-f2b1-4511-b216-06b82de4fe9e tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.743071 Aug 27 20:55:11.824240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 922/1757] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:11 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:11.835637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:11.835637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:11.848845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.853977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.854564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.855520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.856083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.856592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.974873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:11.975419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:11.976230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:11.977278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:11.977706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:11.994517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.995062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.995600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:11.997177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:11.997881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:11.998553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.039677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:12.047193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Getting quotas for user c75d7c2bf734450886113fe48be6c44e and project a5718b7012004d30983db126ff75e348. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:12.203593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:12.206811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e3b6613-4290-42c9-9b9f-bdced8970206',volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:12.259137 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36cb01d7-3e0e-4714-9b51-1641b7e78117 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1858 microversion: 2.1 time: 0.434859 Aug 27 20:55:12.263001 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 923/1758] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:11 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1858 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:12.275843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-plugged", "status": "completed", "tag": "c5032edf-0fb8-4555-90fd-1c853c53839f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:12.301570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.302543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.305921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.382037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] Creating event network-vif-plugged:c5032edf-0fb8-4555-90fd-1c853c53839f for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:12.394153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a12f2f9a-4bcc-4473-96fc-6d3de347327b req-2afd34e3-ab4d-4bde-a37b-faa320cb1c44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128514 Aug 27 20:55:12.405556 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 924/1759] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:12.565320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26d151df-d92d-48bf-abfb-1450eddad568 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.745743 Aug 27 20:55:12.569186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 836/1760] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:55:12.582802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:12.583955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:12.605223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.605743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.606323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.607083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.607552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.607982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.745987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Calling method '.version_select at 0x7ff857dd7ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:12.778299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.781857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.782518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.786378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.788728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.789480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.851360 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-580eb134-d023-4202-864d-620c6b6ee12f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.444258 Aug 27 20:55:12.853652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 925/1761] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Aug 27 20:55:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:12.866774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:12.869225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:12.885057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.887754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.888666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:12.891263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:12.893425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:12.894386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:13.159310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lazy-loading 'services' on Instance uuid cf1125bf-71bf-4cca-a222-b5d4099ccd42 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:55:13.266211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:13.286566 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-955c246d-2c32-4ccf-b1ed-6c5581e1e84b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.713654 Aug 27 20:55:13.288119 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 837/1762] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:12 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:13.312731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:13.313921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:13.358597 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments/4ccf977a-1a3d-47cc-9d34-799b322f16cd" status: 202 len: 0 microversion: 2.1 time: 0.500099 Aug 27 20:55:13.361096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 926/1763] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 20:55:12 2022] DELETE /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments/4ccf977a-1a3d-47cc-9d34-799b322f16cd => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:55:13.374737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:13.377425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:13.392967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:13.394831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:13.395539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:13.396905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:13.397723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:13.398488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:13.623143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:13.633338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:13.643130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:13.644669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3badb5e-0f6b-4883-9ac6-92d65b4e54b3 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1104 microversion: 2.25 time: 0.353384 Aug 27 20:55:13.664755 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 838/1764] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:13 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1104 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:13.681025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-240898219", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:13.787691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:14.360919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:14.370050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bac5b42f-f6e3-4f54-b79d-9b915640f7de tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 1.006971 Aug 27 20:55:14.380228 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 927/1765] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:13 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:14.385607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:14.387943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:14.408068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.409150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.409764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.411314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.412389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.413071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.454593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24cc8260-ed40-4456-987f-11dee0e3a360 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072878 Aug 27 20:55:14.455615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 928/1766] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 20:55:14 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:14.461304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:14.462287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:14.469590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.470483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.471147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.472194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.472886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.473853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.751685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Getting quotas for project 7094bfd2dc844fab93802be1bfbbe28e. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:14.771799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Getting quotas for user fefa42ab58ad48829ef0915213501de1 and project 7094bfd2dc844fab93802be1bfbbe28e. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:14.791017 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Request method failure captured: Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 1751 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoSvPPsloyVSvfDWkX7HSNsQPRE2zpvYEvqrrcfYWljDwIaDX9ldXBKFhU7MuFRSK2Du7QlQCWdmkY3uL5YWyrR4EthealWmRRjloMaEHevEP6jicLbLmDqBXTSd8Kb1nKtRuW3IxPtykI_f1o49-VVH6AD7k7cqxp3xVJMi7mhXr7I Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7094bfd2dc844fab93802be1bfbbe28e Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-789605453 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7094bfd2dc844fab93802be1bfbbe28e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7094bfd2dc844fab93802be1bfbbe28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7094bfd2dc844fab93802be1bfbbe28e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7094bfd2dc844fab93802be1bfbbe28e"}]}] Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-789605453 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7094bfd2dc844fab93802be1bfbbe28e Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-789605453 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-789605453-project Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fefa42ab58ad48829ef0915213501de1 Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-789605453-project Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-240898219", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:55:14.797826 ncdv-master-1 devstack@n-api.service[140433]: exception: Maximum number of metadata items exceeds 128 Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-240898219', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:14.800870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 20:55:14.805632 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:14.807602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:14.812028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b962ecae-1ed0-4c5f-9481-8b24496abd9f tempest-AbsoluteLimitsNegativeTestJSON-789605453 tempest-AbsoluteLimitsNegativeTestJSON-789605453-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.145551 Aug 27 20:55:14.813014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 839/1767] 10.222.0.40 () {60 vars in 1148 bytes} [Sat Aug 27 20:55:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 1147 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:14.824557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:14.825437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:14.847971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.850780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.851492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.852409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:14.853461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:14.854723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:14.891177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:14.901295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b1ccb6f8-bca4-43e6-a87c-c79584f91728 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.444156 Aug 27 20:55:14.916289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 929/1768] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:14 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:15.103875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:15.113829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:15.116202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:15.117905 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-796f8278-eb60-49da-9bd2-cb4daf3efc72 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1241 microversion: 2.25 time: 0.303602 Aug 27 20:55:15.119571 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 840/1769] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:14 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:15.400808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:15.401860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:15.415603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.416202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.416653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:15.417600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.418063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.418491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:15.468493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:15.470716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:15.488967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.489469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.490232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:15.491327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.501446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.504746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:15.584669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61200456-8c07-43a0-8e44-efce05a95738 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117863 Aug 27 20:55:15.588507 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 841/1770] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 20:55:15 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:55:15.924636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:15.926115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:15.940917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:15.949754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd08ea52-59d1-4300-809a-057b444bb825 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.552818 Aug 27 20:55:15.983940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.985601 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 930/1771] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:15 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:15.986140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.986935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:15.994275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:15.995175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:15.996435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:16.142313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:16.143505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:16.150547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:16.155130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:16.156030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:16.157028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:16.166276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:16.167183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:16.352586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:16.365242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:16.372402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:16.374120 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f38d7720-9bae-476f-ac57-71f66cd6fdc8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1251 microversion: 2.25 time: 0.235322 Aug 27 20:55:16.389154 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 931/1772] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:16 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1251 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:55:16.406448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-plugged", "status": "completed", "tag": "ee33ffe3-4e36-4cc8-bdda-0db799505b22"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:16.429936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:16.447707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:16.448417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:16.482510 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] Creating event network-vif-plugged:ee33ffe3-4e36-4cc8-bdda-0db799505b22 for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:16.499215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-240d9e54-624f-4a7f-91b2-79fab2ce9048 req-2d81dc2f-346e-487b-93dd-0f9daf4b21bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108605 Aug 27 20:55:16.500206 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 932/1773] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:16.612062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:16.615554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:16.623883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df797146-1fa2-493d-be2b-0d23c2435d5e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.703027 Aug 27 20:55:16.624831 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 842/1774] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:15 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:17.011239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:17.012418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:17.037535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.042686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.045371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:17.047303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.051978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.053345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:17.406576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:17.407889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:17.428857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.429771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.430413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:17.431322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.432032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.432797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:17.795826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:17.812715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:17.818688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:17.821489 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f5472f1e-0a08-4f83-b1f5-acdb933e6d8a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1239 microversion: 2.25 time: 0.422136 Aug 27 20:55:17.841494 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 843/1775] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:17 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1239 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:17.852881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:17.853819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:17.867508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.870662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.871413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:17.874876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:17.875699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:17.878180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:18.186462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:18.199729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4225d4a2-d09c-4ccb-9c2e-70fb1455af94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 1.192827 Aug 27 20:55:18.205429 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 933/1776] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:17 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:18.557467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:18.565789 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-76b83a8d-2330-42c1-85ee-36c9281ac0c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.722656 Aug 27 20:55:18.566299 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 844/1777] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:17 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:18.658329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-plugged", "status": "completed", "tag": "dbc60c68-865c-49b0-87a6-e8bffca0988a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:18.682418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:18.682905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:18.687912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:18.754630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] Creating event network-vif-plugged:dbc60c68-865c-49b0-87a6-e8bffca0988a for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:18.785776 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b465ab63-4078-4880-bac3-f6cb8f225fd2 req-b255dc99-1d67-4fdd-bb27-5e12f55f309e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131004 Aug 27 20:55:18.788696 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 934/1778] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:18.849284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:18.850227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:18.866318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:18.877548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:18.882713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:18.886312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:18.887399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:18.888258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:19.227100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:19.227938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:19.237501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:19.238450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:19.239302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:19.240498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:19.241307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:19.241999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:19.319963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:19.334734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:19.336712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:19.339450 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c864515-5e19-4f92-9854-9201a12aa642 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 0.493598 Aug 27 20:55:19.340728 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 845/1779] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:18 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:19.592490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:19.593147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:19.610307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:19.610799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:19.611234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:19.612081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:19.612563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:19.612984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:19.862600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:19.881857 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e3b5ba0-2d64-4bd8-b8bf-ed356d027af1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1355 microversion: 2.1 time: 0.659220 Aug 27 20:55:19.882907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 935/1780] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:19 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1355 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:20.024640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-32243734", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9b46b331-7562-41ca-bc02-1e78612261fd"}], "block_device_mapping_v2": [{"uuid": "064bf286-106b-4a7f-a92d-c80ecd263b78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:20.125081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] validate_networks() for [('9b46b331-7562-41ca-bc02-1e78612261fd', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:20.241185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:20.254015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-37872824-4e77-4afa-8b81-f50564760f3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1543 microversion: 2.1 time: 0.665754 Aug 27 20:55:20.265120 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 846/1781] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:19 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1543 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:20.280181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bbac41-db58-4ad1-8fe6-0c0d28bd6565", "tag": "15d8e2f3-f9e5-462a-9557-9c924e65e52f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:20.309085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:20.309293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:20.309773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:20.358718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] Creating event network-changed:15d8e2f3-f9e5-462a-9557-9c924e65e52f for instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 on nch1-master-1 Aug 27 20:55:20.368569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-76f496da-83fd-4d74-801e-fb23934a2169 req-95105ce3-8c79-4066-87b9-b833b2a20c33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094840 Aug 27 20:55:20.369885 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 847/1782] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:20.383040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:20.383990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:20.396037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:20.397378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:20.399389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:20.402864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:20.403726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:20.404704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:21.523007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:21.549012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:21.550399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:21.557895 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4ab4359-8ed5-4c36-bc85-2fcceb91a2e0 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 1.186013 Aug 27 20:55:21.563766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 848/1783] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:20 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:21.569810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:21.570445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:21.615991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:21.616804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:21.617388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:21.618210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:21.625429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:21.626152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:22.026558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:22.276859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:22.285230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6c0116e-9255-4e43-bee8-c320a1bcb169 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1806 microversion: 2.1 time: 0.720089 Aug 27 20:55:22.285816 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 849/1784] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:21 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1806 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:22.321541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:22.322376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:22.329015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:22.329802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:22.330412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:22.331292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:22.331944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:22.332545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:22.777615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:22.817005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:23.009371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:23.029579 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-078a2dd8-e8ea-406a-9312-4ab0dc0d2365 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1542 microversion: 2.1 time: 0.728927 Aug 27 20:55:23.045332 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 850/1785] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:22 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1542 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:23.245873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1738743336", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:23.314206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:23.362662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:23.363313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:23.363825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:23.364843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:23.366472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:23.390035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.390572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.391205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.394361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.407310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.410067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.465245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:23.480434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Getting quotas for user 43dd6f015403486491e8140062f43bee and project 459a7cdda740490a900289697e84372b. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:23.574757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:23.576973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='064bf286-106b-4a7f-a92d-c80ecd263b78',volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:23.808956 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78eb08a0-be8a-4ed5-9e58-c90005200902 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.790675 Aug 27 20:55:23.811723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 936/1786] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:23.817372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:23.818264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:23.826552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.827458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.828146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.829252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.829930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.830573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.865775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20b40ff0-daaa-4e9d-84cf-7ef3e7f53180 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54/ips" status: 200 len: 219 microversion: 2.1 time: 0.052594 Aug 27 20:55:23.867155 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 937/1787] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:55:23 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54/ips => generated 219 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:23.874082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:23.875135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:23.885501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.888081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.889890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.891384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:23.892148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:23.893135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:23.930350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:24.452491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:24.456039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:24.456540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:24.456954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:24.457391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:24.488821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.489327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.493558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:24.498630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.501486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.504867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:24.577108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Getting quotas for project c709ec9938bd48179cb71ac25c6f7256. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:24.605380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Getting quotas for user dff9c89bfd3b44908a44a5f4726d2d39 and project c709ec9938bd48179cb71ac25c6f7256. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:24.612572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:24.644280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:24.651099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:24.653957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:24.664664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:24.670432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:24.671905 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc36a07b-abbf-405d-8219-709f9570ae6d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 0.803488 Aug 27 20:55:24.673001 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 938/1788] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:23 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:24.793217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4e119239-13ad-41ec-adad-d5d30dddadc2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746191 Aug 27 20:55:24.795786 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 851/1789] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:24.808664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:24.809485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:24.842364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.842968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.843625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:24.845582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.850810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.851377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:24.955234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:24.969160 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4bd4785e-6ab4-4166-842e-a8c9bb557ed3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1149 microversion: 2.1 time: 0.172092 Aug 27 20:55:24.970362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 852/1790] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:24 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1149 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:24.975853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:24.976471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:24.990933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.991919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.993530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:24.995567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:24.997157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:24.998260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.057743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:55:25.119079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-382397027", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5b97881f-89ac-4440-8b19-f267ffb14088"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:25.218825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] validate_networks() for [('5b97881f-89ac-4440-8b19-f267ffb14088', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:25.263935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ccfea46-94e9-4239-918f-f85ec242bc0a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 204 len: 0 microversion: 2.1 time: 0.292160 Aug 27 20:55:25.264538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 853/1791] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:55:24 2022] DELETE /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:55:25.283293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:25.284069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:25.304464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.304992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.305441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.306205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.306650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.307078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.597898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:25.615608 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab2ec6a7-c777-4750-973f-62e283a8d479 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1474 microversion: 2.1 time: 0.345741 Aug 27 20:55:25.616949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 854/1792] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:25 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:25.625899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:25.626567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:25.634612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.635449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.636119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.637054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.637736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.638388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.753655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:25.764985 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-28a7844f-3733-4261-a05c-63479a45cb76 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1223 microversion: 2.1 time: 0.146669 Aug 27 20:55:25.784416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 855/1793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:25 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1223 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:25.792056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:25.793813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:25.812898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.816609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.818102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:25.821134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:25.821847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:25.823411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.200487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:26.212536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9dc15d42-641d-4af5-b31e-54c5ee594a41 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1812 microversion: 2.1 time: 0.426406 Aug 27 20:55:26.240839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 856/1794] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:25 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1812 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:26.264054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:26.268592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:26.279712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.285258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.286163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.287423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.288172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.292974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:26.294106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:26.294793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:26.295638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:26.296836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:26.304153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.320276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.327154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.327664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.328532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.328995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.329432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.398363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:26.415319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for user ede90e55159a4d3192505c74a2a69a51 and project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:26.478873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:26.483676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:26.638815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a362de09-c804-4d01-b298-a92631f1bedb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964493 Aug 27 20:55:26.642882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 939/1795] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:26.654169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-unplugged", "status": "completed", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:26.680746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.683411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.689492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:26.703723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:26.704633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.712125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:26.713908 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-205870d8-22db-4967-bf71-879d20c3c454 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 0.468765 Aug 27 20:55:26.715108 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 857/1796] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:26 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:26.722161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:26.723051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:26.730975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.731799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.732703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.733729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.734382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.735028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.736828 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Creating event network-vif-unplugged:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:55:26.755202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:55:26.777326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-125fc771-814b-4005-888e-7e93e516cf00 req-4f33bb00-4dfb-4d14-90ac-12e0aa235d40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131803 Aug 27 20:55:26.778352 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 940/1797] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:26.901088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:26.914690 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8675135e-075e-4828-82b6-1a96fdbcd6ea tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1149 microversion: 2.1 time: 0.197619 Aug 27 20:55:26.916370 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 858/1798] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:26 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1149 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:26.934383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:26.935370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:26.953242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.955760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.957237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:26.959684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:26.961423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:26.963113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.007264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:27.133555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1d15783-ddfb-4fd8-bbb9-02fd5533ce11 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Calling method '.version_select at 0x7ff857dd7c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.169537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1d15783-ddfb-4fd8-bbb9-02fd5533ce11 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1d15783-ddfb-4fd8-bbb9-02fd5533ce11 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/2dafca6c-b310-42e9-9311-4291d08a539c/metadata/os_distro HTTP/1.1 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'image_id': '2dafca6c-b310-42e9-9311-4291d08a539c', 'id': 'os_distro'} Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2dafca6c-b310-42e9-9311-4291d08a539c Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:27.174472 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2dafca6c-b310-42e9-9311-4291d08a539c could not be found. Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:27.180705 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.187385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1d15783-ddfb-4fd8-bbb9-02fd5533ce11 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:27.187385 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1d15783-ddfb-4fd8-bbb9-02fd5533ce11 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "DELETE /compute/v2.1/images/2dafca6c-b310-42e9-9311-4291d08a539c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.406654 Aug 27 20:55:27.198000 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 941/1799] 10.222.0.40 () {58 vars in 1293 bytes} [Sat Aug 27 20:55:26 2022] DELETE /compute/v2.1/images/2dafca6c-b310-42e9-9311-4291d08a539c/metadata/os_distro => generated 62 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:27.204094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3de9ece8-7c19-4b2f-834f-955b1fbf5c33 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.215502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3de9ece8-7c19-4b2f-834f-955b1fbf5c33 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:27.406603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3de9ece8-7c19-4b2f-834f-955b1fbf5c33 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:27.419191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3de9ece8-7c19-4b2f-834f-955b1fbf5c33 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1207 microversion: 2.1 time: 0.218867 Aug 27 20:55:27.421014 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 942/1800] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1207 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:27.440360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:27.443041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.444206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:27.462553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.463593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.464387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.470949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9da19be7-4fc1-4285-9469-8f884c170406 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1474 microversion: 2.1 time: 0.549013 Aug 27 20:55:27.471616 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 859/1801] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:26 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:27.477274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.477923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.480291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.493695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-347bf932-17b0-468d-94cd-59ac1bdeadcc tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Calling method '.version_select at 0x7ff857cf6700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.538698 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-347bf932-17b0-468d-94cd-59ac1bdeadcc tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-347bf932-17b0-468d-94cd-59ac1bdeadcc tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/images/422979bd-7479-4e8f-8594-3d58fd07c344/metadata/os_version HTTP/1.1 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'image_id': '422979bd-7479-4e8f-8594-3d58fd07c344', 'id': 'os_version'} Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 422979bd-7479-4e8f-8594-3d58fd07c344 Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:27.541952 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 422979bd-7479-4e8f-8594-3d58fd07c344 could not be found. Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-347bf932-17b0-468d-94cd-59ac1bdeadcc tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:27.546406 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-347bf932-17b0-468d-94cd-59ac1bdeadcc tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "GET /compute/v2.1/images/422979bd-7479-4e8f-8594-3d58fd07c344/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.060258 Aug 27 20:55:27.558283 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 860/1802] 10.222.0.40 () {58 vars in 1293 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/images/422979bd-7479-4e8f-8594-3d58fd07c344/metadata/os_version => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:27.570201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.573027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:27.596024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.597406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.599398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.600619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.601104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.603698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.763131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:27.778939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-499717e2-9f67-4f7d-a022-fdb9d3d08d21 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1223 microversion: 2.1 time: 0.349926 Aug 27 20:55:27.783693 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 943/1803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1223 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:27.794763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94cd89a1-66de-452a-90c3-a9ad53d653a1 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Calling method '.version_select at 0x7ff857d843a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.821772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-94cd89a1-66de-452a-90c3-a9ad53d653a1 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94cd89a1-66de-452a-90c3-a9ad53d653a1 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/images/a4494e90-d84c-4ed1-bc43-a184bdcefeb8/metadata HTTP/1.1 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'image_id': 'a4494e90-d84c-4ed1-bc43-a184bdcefeb8'} Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4494e90-d84c-4ed1-bc43-a184bdcefeb8 Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:27.826017 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4494e90-d84c-4ed1-bc43-a184bdcefeb8 could not be found. Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:27.830337 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:27.842448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94cd89a1-66de-452a-90c3-a9ad53d653a1 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:27.842448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94cd89a1-66de-452a-90c3-a9ad53d653a1 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "GET /compute/v2.1/images/a4494e90-d84c-4ed1-bc43-a184bdcefeb8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055474 Aug 27 20:55:27.845294 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 944/1804] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/images/a4494e90-d84c-4ed1-bc43-a184bdcefeb8/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:27.865057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:27.867157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:27.888187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.889118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.889822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:27.891068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:27.891813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:27.892789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.344766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.365219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5a1bc50-021b-4806-b453-562aedbf57e6 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1812 microversion: 2.1 time: 0.816020 Aug 27 20:55:28.370891 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 861/1805] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1812 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:28.392967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24c5284c-7992-4937-9f38-330a1942bd2a tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Action: 'update_all', calling method: .version_select at 0x7ff84f39f1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:28.457463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-24c5284c-7992-4937-9f38-330a1942bd2a tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24c5284c-7992-4937-9f38-330a1942bd2a tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/images/d2afc945-6de0-4fbe-939c-bf40c0b1ad34/metadata HTTP/1.1 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 57 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'image_id': 'd2afc945-6de0-4fbe-939c-bf40c0b1ad34', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d2afc945-6de0-4fbe-939c-bf40c0b1ad34 Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:28.460310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d2afc945-6de0-4fbe-939c-bf40c0b1ad34 could not be found. Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:28.466474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.474398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24c5284c-7992-4937-9f38-330a1942bd2a tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:28.476441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24c5284c-7992-4937-9f38-330a1942bd2a tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "PUT /compute/v2.1/images/d2afc945-6de0-4fbe-939c-bf40c0b1ad34/metadata" status: 404 len: 62 microversion: 2.1 time: 0.103946 Aug 27 20:55:28.477698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 862/1806] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:55:28 2022] PUT /compute/v2.1/images/d2afc945-6de0-4fbe-939c-bf40c0b1ad34/metadata => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:28.486673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:28.488656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:28.502337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.502986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.503579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.504418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.505064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.506016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.551668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.562824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.567974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.575855 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1150a01a-04f6-4f3f-811a-3249e2b8bbd4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 0.728982 Aug 27 20:55:28.584935 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 945/1807] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:27 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:28.612331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:28.612952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:28.632469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.632974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.633422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.634174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.636305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.637015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.686130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.696818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-381dab6c-7aa9-43a3-ade7-514fc3ee03dc tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1149 microversion: 2.1 time: 0.217527 Aug 27 20:55:28.700336 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 863/1808] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:28 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1149 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:28.708254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06ab8fb4-b32b-4f43-bd44-6b69f3308788 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Action: 'update', calling method: .version_select at 0x7ff857c7ff70>, body: {"meta": {"os_distro": "alt"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:28.737439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:28.751735 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-06ab8fb4-b32b-4f43-bd44-6b69f3308788 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:28.761284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7304d1c7-e505-440b-b6cd-8e2de1da8ef8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1259 microversion: 2.1 time: 0.174536 Aug 27 20:55:28.762773 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 946/1809] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:28 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06ab8fb4-b32b-4f43-bd44-6b69f3308788 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/images/a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a/metadata/os_distro HTTP/1.1 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 30 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: {"meta": {"os_distro": "alt"}} Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'image_id': 'a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:28.763107 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a could not be found. Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:28.768038 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.777419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06ab8fb4-b32b-4f43-bd44-6b69f3308788 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:28.780049 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06ab8fb4-b32b-4f43-bd44-6b69f3308788 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "PUT /compute/v2.1/images/a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.077022 Aug 27 20:55:28.782587 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 864/1810] 10.222.0.40 () {60 vars in 1310 bytes} [Sat Aug 27 20:55:28 2022] PUT /compute/v2.1/images/a1e9e133-fb67-4cea-81b3-3c4a3aaeb21a/metadata/os_distro => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:28.791946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:28.793018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:28.796251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3bfa12c-4227-4fd6-aed3-836f04144169 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Action: 'create', calling method: .version_select at 0x7ff857c7cca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:28.810151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.811014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.812048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.813203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.814246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.816023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.845719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b3bfa12c-4227-4fd6-aed3-836f04144169 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] HTTP exception thrown: Image not found. Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3bfa12c-4227-4fd6-aed3-836f04144169 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Request method failure captured: Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/images/2f7862f2-f86c-4ee5-bbcc-0400c52cdef7/metadata HTTP/1.1 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 57 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS9XIzf72OFkl7m7NT4m4kaHoQ_9LDewO8YAwmIgka023ZOZgzfa3UR3g7wKf7UrZns2ZSFy6fqpkWYnECWij2L1Lqip7dwitiTnnI1X7DNUk7dYo4LdjWQmFB5-_opI4jgecpLqKLP4nItZsxl09lWB9JGuAMUXwHiq39XgdY1dSI Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/36c39919c11d48bc9c544a129e68d70b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_36c39919c11d48bc9c544a129e68d70b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/36c39919c11d48bc9c544a129e68d70b"}]}] Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 36c39919c11d48bc9c544a129e68d70b Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1703208087334e769a1c16b315d2c80f Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1710767488-project Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'image_id': '2f7862f2-f86c-4ee5-bbcc-0400c52cdef7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2f7862f2-f86c-4ee5-bbcc-0400c52cdef7 Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:55:28.851097 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f7862f2-f86c-4ee5-bbcc-0400c52cdef7 could not be found. Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3bfa12c-4227-4fd6-aed3-836f04144169 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3bfa12c-4227-4fd6-aed3-836f04144169 tempest-ImagesMetadataNegativeTestJSON-1710767488 tempest-ImagesMetadataNegativeTestJSON-1710767488-project] 10.222.0.40 "POST /compute/v2.1/images/2f7862f2-f86c-4ee5-bbcc-0400c52cdef7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.067235 Aug 27 20:55:28.860412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 865/1811] 10.222.0.40 () {60 vars in 1281 bytes} [Sat Aug 27 20:55:28 2022] POST /compute/v2.1/images/2f7862f2-f86c-4ee5-bbcc-0400c52cdef7/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:55:28.872408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:28.879945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:28.899157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.900626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.901335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:28.902307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:28.903274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:28.904230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:29.410290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:29.426671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fff6662a-22a1-4b14-bf4e-b67e4d1522c9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1271 microversion: 2.1 time: 0.559469 Aug 27 20:55:29.432107 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 866/1812] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:28 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1271 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:29.453036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-deleted", "tag": "ee33ffe3-4e36-4cc8-bdda-0db799505b22"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:29.479037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:29.479527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:29.479969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:29.525059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] Creating event network-vif-deleted:ee33ffe3-4e36-4cc8-bdda-0db799505b22 for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:29.540976 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-87ab40fe-c68e-40ac-830f-f42cee69905f req-778f9045-517b-436a-a683-3f133eb21ae5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104980 Aug 27 20:55:29.541632 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 867/1813] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:29.564839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:29.566465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:29.570226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:29.583576 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4b59688-bfb7-48c9-aba7-d96852b0fb00 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1471 microversion: 2.1 time: 0.806876 Aug 27 20:55:29.584371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 947/1814] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:28 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1471 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:29.612569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:29.613948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:29.622537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:29.625643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:29.626120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:29.626867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:29.627351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:29.631086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:29.632795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:29.635625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:29.636227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:29.639360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:29.640087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:29.640694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.531731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:30.542589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27f81a79-af84-425d-853e-5df58fb531ba tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1677 microversion: 2.1 time: 0.996863 Aug 27 20:55:30.552348 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 868/1815] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:29 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1677 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:30.557841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:30.562995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:30.583422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.583884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.592198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.593260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.593835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.600189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.730826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:30.731854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.735810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.736505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.738443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.742329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.743041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.754214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:30.757925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:30.765546 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-774f4223-d509-4372-b9e4-760715140f3d tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 1.161444 Aug 27 20:55:30.781075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 948/1816] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:29 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:30.800362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:30.801687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:30.823333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.828064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.828812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.830880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:30.831614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:30.832432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:30.839047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:30.853222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:31.135215 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92330e9d-77a0-4111-9761-25fed1206e96 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515/action" status: 202 len: 0 microversion: 2.1 time: 0.580414 Aug 27 20:55:31.136694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 869/1817] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:55:30 2022] POST /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:55:31.145478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:31.147868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:31.160842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.162795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.165719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.167758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.168443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.170205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.180924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:31.194778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8fef8352-45a0-4835-932f-1b28c8b702b1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1167 microversion: 2.1 time: 0.407776 Aug 27 20:55:31.195642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 949/1818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:30 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1167 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:31.205231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bbac41-db58-4ad1-8fe6-0c0d28bd6565", "name": "network-vif-plugged", "status": "completed", "tag": "15d8e2f3-f9e5-462a-9557-9c924e65e52f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:31.235739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.236692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.237391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.262112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] Creating event network-vif-plugged:15d8e2f3-f9e5-462a-9557-9c924e65e52f for instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 on nch1-master-1 Aug 27 20:55:31.280679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-05401584-3041-4df5-bfe5-904817876f5e req-dab61991-8fbe-4676-8b75-b9e0d20c5c58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082520 Aug 27 20:55:31.281873 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 950/1819] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:31.291973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:31.292814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:31.324283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.328442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.328998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.330028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.331948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.332376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.473077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:31.488447 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90686a7c-c615-4f1d-a4e5-c8ad16f49ded tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1265 microversion: 2.1 time: 0.348828 Aug 27 20:55:31.504908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 870/1820] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:31 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:31.523356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:31.525975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:31.552974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.558126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.558126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.558758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.560703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.562443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.642903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:31.662163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d61d54a-d51c-4f25-bed4-bafb82ccae54 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1277 microversion: 2.1 time: 0.378499 Aug 27 20:55:31.667933 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 951/1821] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:31 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:31.677843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:31.685285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:31.701519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.709198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.710743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:31.711615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:31.712095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:31.715735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.371902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:32.386551 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24f484d1-b9b3-4dfc-a2d3-0bda45e8cfad tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1656 microversion: 2.1 time: 0.712227 Aug 27 20:55:32.407826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 952/1822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:31 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1656 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:32.419956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:32.420579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:32.434538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:32.443016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.444469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.445214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.446203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.447024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.448617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.498572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:32.508003 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2491297c-f7d6-4cca-b553-84d8ca97d975 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1470 microversion: 2.1 time: 1.000930 Aug 27 20:55:32.510729 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 871/1823] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:31 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1470 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:32.522385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-deleted", "tag": "c5032edf-0fb8-4555-90fd-1c853c53839f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:32.533917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.534828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.535532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.554531 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] Creating event network-vif-deleted:c5032edf-0fb8-4555-90fd-1c853c53839f for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:32.566767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7b1e7150-136f-42d7-a0e1-da070a737e31 req-d190fcaf-6d18-4416-b17a-6e4198e8fee3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054401 Aug 27 20:55:32.568433 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 872/1824] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:32.580160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:32.581295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:32.589575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.595085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.596064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.597168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.597937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.598652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.730686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:32.750872 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9030a372-55a2-4000-9bb4-3be9fbb1811d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1155 microversion: 2.1 time: 0.180758 Aug 27 20:55:32.751541 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 873/1825] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:32 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1155 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:32.774248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:32.775140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:32.783894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.784604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.785209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:32.786208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:32.787142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:32.787867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.007582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:33.019123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:33.023679 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-076492d1-0a12-4b37-a8b7-0c0317665c8c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1265 microversion: 2.1 time: 0.254592 Aug 27 20:55:33.024896 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 874/1826] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:32 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:33.031957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:33.033554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:33.035325 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7cb7c943-3139-4fec-9ded-bbc22b173b9f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1281 microversion: 2.25 time: 0.626455 Aug 27 20:55:33.044862 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 953/1827] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:32 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1281 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:33.052844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:33.053859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:33.071210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.071792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.072900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.075089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.075726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.076167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.218517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:33.234324 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea785758-0b9f-4df1-bac5-fede3a72e86e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1277 microversion: 2.1 time: 0.207422 Aug 27 20:55:33.235283 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 875/1828] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:33 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:33.333275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-unplugged", "status": "completed", "tag": "dbc60c68-865c-49b0-87a6-e8bffca0988a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:33.364906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.368937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.369646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.402453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] Creating event network-vif-unplugged:dbc60c68-865c-49b0-87a6-e8bffca0988a for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:33.408445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:33.409073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:33.418176 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6f7af9e6-a6b8-4d20-9486-4d4717b41c3a req-e7c0e673-9041-49f7-a682-8214193e9664 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087845 Aug 27 20:55:33.418437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.418791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.423109 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 954/1829] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:33.424006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.427135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.427995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.429012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.539870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:33.540733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:33.559213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.561469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.566433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:33.567329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:33.568061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:33.570022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:34.629394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=18 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:34.721045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:34.729314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-28b3dff7-76f0-49eb-98c1-4cb10c566ad1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 200 len: 1497 microversion: 2.1 time: 1.324678 Aug 27 20:55:34.754265 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 876/1830] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:33 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 1497 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:34.762353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:34.762976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:34.785022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:34.785795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:34.790058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:34.791157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:34.791841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:34.792454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:34.835817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:34.845334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7667d5ce-d97c-4fef-913a-50bf7ee473b9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1470 microversion: 2.1 time: 1.310660 Aug 27 20:55:34.865929 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 955/1831] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:33 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1470 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:34.874395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:34.875020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:34.903532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:34.904356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:34.904828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:34.907757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:34.908285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:34.908739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.290734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:35.301480 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd5a583a-e8c2-4d13-a161-f466d40444bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.434330 Aug 27 20:55:35.302612 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 956/1832] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:34 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:35.353109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:35.371294 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cda498c5-f459-4306-89f0-78c2c6d4b1a3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.615702 Aug 27 20:55:35.376694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 877/1833] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:34 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:35.389181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:35.393910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:35.404521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.405219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.405840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.406741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.407487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.408079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.477910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:35.629213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3fad311f-4405-41cf-b1ee-70c7845b0a79 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Action: 'create', calling method: .version_select at 0x7ff84ec09280>, body: {"keypair": {"name": "tempest-keypair-1667229588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDV+maR09C8sqUUrlXa9L7roPsUXbZapjO0X6Mc/V8KSNVZEo7n5TBOrixNA/ZtPhRc2TGLWIkoPowtkP8uyrVntnyuQHdfQ2E0PeZdRKf/ivj5p9cVjHJyl3AOlTRTgA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:35.658298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3fad311f-4405-41cf-b1ee-70c7845b0a79 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for project bba5d28e239340c29ec8f7d9f9bd2653. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:35.662798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3fad311f-4405-41cf-b1ee-70c7845b0a79 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for user bebb885925d646d7bbfe523109df7c56 and project bba5d28e239340c29ec8f7d9f9bd2653. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:35.713603 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3fad311f-4405-41cf-b1ee-70c7845b0a79 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396445 Aug 27 20:55:35.717581 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 957/1834] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:55:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:35.727820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:35.728870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:35.740710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:35.744554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.745463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.746336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.747271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.747906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.748496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.751139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:35.757646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:35.758893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a3ea20a-1e31-476d-b0fa-535cd70f75ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1477 microversion: 2.25 time: 0.380876 Aug 27 20:55:35.759489 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 878/1835] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:35 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:35.775996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fa716b-74f5-4fd6-8406-8b2bc87a2c54", "name": "network-vif-deleted", "tag": "dbc60c68-865c-49b0-87a6-e8bffca0988a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:35.799991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.800840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.801465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.824839 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] Creating event network-vif-deleted:dbc60c68-865c-49b0-87a6-e8bffca0988a for instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 on nch1-master-1 Aug 27 20:55:35.832806 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-874660d3-613b-4175-8407-f052748d6d74 req-d290930f-714d-4aeb-b6dc-f62c605667e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068076 Aug 27 20:55:35.833669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 879/1836] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:35.840406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-plugged", "status": "completed", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:35.852050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.852533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.852965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.867557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Creating event network-vif-plugged:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:55:35.874615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:55:35.882862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6472ce67-0248-4cb0-a87e-09f80ac4e549 req-390ec4e3-1384-40b6-87a4-589b09e21d90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047354 Aug 27 20:55:35.884242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 880/1837] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:35.890291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:35.891253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:35.899934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.900870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.901660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.903575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:35.904200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:35.904814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:35.921335 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 HTTP/1.1 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '39fa716b-74f5-4fd6-8406-8b2bc87a2c54'} Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:35.924228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:55:35.930299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:35.931765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:35.932816 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-449b7b86-fa81-4f67-830f-23dc1755793d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 404 len: 111 microversion: 2.1 time: 0.047342 Aug 27 20:55:35.937101 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 881/1838] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:35 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:55:36.086474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:36.098522 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b02a7f40-4116-4ed0-bb9d-1175130ac1d8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.377568 Aug 27 20:55:36.103791 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 958/1839] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:35 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:36.117441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:36.118095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:36.128210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.128793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.131484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.135027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.135747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.136361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.155955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:36.156670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:36.163803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.164295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.164739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.165449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.166092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.166907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.374838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:36.646193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:36.662941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba6c4cd2-b048-4a6f-9039-9ee9216c44f3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1470 microversion: 2.1 time: 0.555199 Aug 27 20:55:36.663924 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 959/1840] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:36 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:36.683624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:36.684553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:36.691833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.692850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.693555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.694524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.695233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.695785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.784619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:55:36.812194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-644698c9-6dab-4709-ba98-b806f898d9ec tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1970 microversion: 2.25 time: 0.870183 Aug 27 20:55:36.815478 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 882/1841] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:35 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1970 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:36.830907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:36.831563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:36.860175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.860705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.861156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:36.861893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:36.862361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:36.862799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:37.256749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:37.271188 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7cd98c94-0f80-4849-8616-8c2395919a45 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.605802 Aug 27 20:55:37.273605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 960/1842] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:36 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:37.286303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea294e9b-8451-4526-b15b-afb1c9cee9dd", "tag": "866419e8-7e88-4363-9e3d-364029997067"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:37.301810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:37.304052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:37.304735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:37.312464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:37.338068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:37.356648 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6981bdcb-7697-41d6-b129-615ae17cca53 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.539919 Aug 27 20:55:37.357694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 883/1843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:36 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:37.361026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] Creating event network-changed:866419e8-7e88-4363-9e3d-364029997067 for instance ea294e9b-8451-4526-b15b-afb1c9cee9dd on nch2-master-1 Aug 27 20:55:37.366761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:37.371714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:37.372436 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-844ae772-048f-45cd-add2-288c37fc635e req-369f313c-b190-4f43-a688-4af6592fb400 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095959 Aug 27 20:55:37.373577 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 961/1844] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:37.380828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:37.385230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:37.387187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:37.387723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:37.388168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:37.388906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:37.389345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:37.389773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:37.392600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:37.393936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:37.394625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:37.395996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:37.396721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:37.397521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:38.174121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:38.187483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae89f04b-cc41-483d-906f-b5b7e9ad06f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.808609 Aug 27 20:55:38.188455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 962/1845] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:37 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:38.199764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:38.201884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:38.216262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:38.220533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:38.220998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:38.230949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:38.231537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:38.236070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:38.357693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:55:38.381307 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39fc3ce9-9e09-4d86-b9b3-684ab688d3b4 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1970 microversion: 2.25 time: 1.019851 Aug 27 20:55:38.382309 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 884/1846] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:37 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1970 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:38.416900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ce3926-f2c1-4496-b23e-75b4cecb0c72", "tag": "d55137d0-09b1-440b-b481-cdb396b038bf"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:38.440773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:38.441257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:38.441944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:38.462941 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] Creating event network-changed:d55137d0-09b1-440b-b481-cdb396b038bf for instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 on nch2-master-1 Aug 27 20:55:38.470084 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c11f1c25-0ebc-49b4-ada3-139a4488ab86 req-e16e0fd4-40da-4bf0-a247-7669bb33d354 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083982 Aug 27 20:55:38.471210 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 885/1847] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:38.478570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:38.485946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:38.498287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:38.499097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:38.499747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:38.500719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:38.501386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:38.501969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.180060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:39.189253 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0aab3cf6-c315-4b71-90af-2e1ca186e264 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 0.999555 Aug 27 20:55:39.190700 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 963/1848] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:38 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:39.196760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:39.197374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:39.210535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.211389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.212118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.213085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.213606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.214185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.260908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:39.271814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d68ea07-8702-4d74-8979-378940605961 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.799173 Aug 27 20:55:39.273043 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 886/1849] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:38 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:39.278955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:39.284890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.285608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.286418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.287236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.288630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.289126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.317421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ffe8d2c-ee1d-44aa-9fe5-33e249d30ac9 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043025 Aug 27 20:55:39.323865 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 887/1850] 10.222.0.40 () {60 vars in 1217 bytes} [Sat Aug 27 20:55:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:55:39.329053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:39.330393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:39.337712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.338331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.338832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:39.339922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:39.340811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:39.342104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:40.045045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:40.057736 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88da27d8-ee76-4183-806a-2f126b5fae78 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.731425 Aug 27 20:55:40.058359 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 888/1851] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:39 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:40.070493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:40.074864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:40.095603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:40.096010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:40.096299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:40.097152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:40.097469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:40.097898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:40.176017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'flavor' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:55:40.198481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Going to try to live migrate instance to nch2-master-1 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:55:40.214771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:40.224583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:40.257683 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c439e422-2d19-4351-a8b3-33837c0abb96 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 1.062561 Aug 27 20:55:40.260344 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 964/1852] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:39 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:40.268183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdaac22-8a21-418f-ab77-cbb26b190d0b", "tag": "1f9fc837-0bee-49f3-8111-da1f0adba093"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:40.291579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:40.292535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:40.293089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:40.309037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] Creating event network-changed:1f9fc837-0bee-49f3-8111-da1f0adba093 for instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b on nch2-master-1 Aug 27 20:55:40.314321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8027484c-ca89-44bc-a1ff-89d302576e11 req-46eef82f-608f-4e0c-af97-b2c530db8064 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049748 Aug 27 20:55:40.316098 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 965/1853] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:40.322938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:40.324039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:40.338184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:40.338688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:40.339207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:40.339965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:40.340424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:40.341152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:41.111074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:41.122121 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e207027a-bcbc-4477-a13d-4e5528bb8d95 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 0.802162 Aug 27 20:55:41.122968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 966/1854] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:40 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:41.137410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:41.139679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:41.153243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:41.153743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:41.154176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:41.154888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:41.155361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:41.158311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:41.567152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:41.578862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae0feca4-5aae-4c67-a429-4cf0a3f6fe0c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.450128 Aug 27 20:55:41.580200 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 967/1855] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:41 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:41.587973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:41.589725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:41.596753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:41.597490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:41.597925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:41.598631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:41.599263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:41.599725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:42.077963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:42.088039 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db928bbb-eaed-4087-836b-4828cef43579 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.506359 Aug 27 20:55:42.092102 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 968/1856] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:41 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:42.106539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:42.107629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:42.126128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:42.126762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:42.127506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:42.128493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:42.129673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:42.130800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:42.692222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:42.701465 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b76adc23-4a0a-43be-bd20-31ba861466c1 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.605430 Aug 27 20:55:42.702063 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 969/1857] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:42 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:42.706994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-unplugged", "status": "completed", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:42.717150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:42.717632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:42.718060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:42.730894 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Creating event network-vif-unplugged:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:55:42.736747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:55:42.743466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8bda6206-a32d-43a3-9f8d-ce4085eedd76 req-7fe73b98-b8fc-42c2-9dc3-06e3d420e123 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039963 Aug 27 20:55:42.744447 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 970/1858] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:42.751563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:42.752522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:42.759935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:42.760864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:42.761844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:42.762771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:42.763697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:42.764474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:43.769019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:43.793352 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c4e002a-5978-4088-81f7-49c0f353fa06 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 1.047429 Aug 27 20:55:43.793965 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 971/1859] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:42 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:43.806634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:43.807559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:43.827065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:43.827606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:43.828053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:43.830288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:43.831788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:43.832243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:44.273915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:44.290231 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bdfee392-c77e-48bd-9f2d-97a4bdfda4e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.493645 Aug 27 20:55:44.293322 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 972/1860] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:43 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:44.299734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:44.300850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:44.314620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:44.330229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:44.330816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:44.333606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:44.336087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:44.340553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:44.409037 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-93cb4d99-3931-4012-84be-bb0a09cd2777 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565/action" status: 202 len: 0 microversion: 2.25 time: 4.345282 Aug 27 20:55:44.411521 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 889/1861] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:55:40 2022] POST /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565/action => generated 0 bytes in 4348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:55:44.421657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:44.423971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:44.489459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:44.491834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:44.497532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:44.498760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:44.499962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:44.501558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:44.687681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:44.704957 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be31f0d7-9445-42d7-a5ce-8832fc943e32 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.407154 Aug 27 20:55:44.715436 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 973/1862] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:44 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:44.726274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-264826782", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0415b159-4283-46c5-85ad-934516019be1"}], "security_groups": [{"name": "tempest-securitygroup--1241394771"}], "key_name": "tempest-keypair-1667229588", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:44.829494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:44.839334 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8719d9b-0634-43be-8f83-d9d15cb364bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.425189 Aug 27 20:55:44.843886 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 890/1863] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:44 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:44.854261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1651807581", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "e376da24-a9f3-4947-a931-4b89b996246b"}, {"uuid": "bf60ceab-b762-40ba-81ad-3b1a580b8572"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:44.939238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] validate_networks() for [('0415b159-4283-46c5-85ad-934516019be1', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:44.981596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] validate_networks() for [('e376da24-a9f3-4947-a931-4b89b996246b', None, None, None, None, None), ('bf60ceab-b762-40ba-81ad-3b1a580b8572', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:45.672255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=18 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:45.822073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for project bba5d28e239340c29ec8f7d9f9bd2653. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:45.827481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for user bebb885925d646d7bbfe523109df7c56 and project bba5d28e239340c29ec8f7d9f9bd2653. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:45.846634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:45.847652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:45.848342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:45.850160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:45.851009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:45.884236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:45.884963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:45.885736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:45.886709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:45.887535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:45.888149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:45.921017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for project bba5d28e239340c29ec8f7d9f9bd2653. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:45.934433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Getting quotas for user bebb885925d646d7bbfe523109df7c56 and project bba5d28e239340c29ec8f7d9f9bd2653. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:45.950782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:45.958495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:46.025911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e1701bb-2ff0-4489-9161-4c5a0bb958da tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.316386 Aug 27 20:55:46.027262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 974/1864] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:46.035375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:46.037233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:46.045995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.046807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.047506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.048453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.049119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.049752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.506425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:46.530090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:46.540628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:46.542054 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-410d415f-fd85-43d6-82a1-a83b10895e7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.513393 Aug 27 20:55:46.568245 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 975/1865] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:46 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:46.593427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:46.594082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:46.606500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.607087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.607632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.608362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.608822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.612113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.743170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:46.745071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:46.749663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:46.750331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:46.750757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:46.774774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.778569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.779278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.780429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:46.782303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:46.788725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:46.841233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Getting quotas for project fe4f6d64a7bc40adb889fa76c3e13bf5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:46.854168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Getting quotas for user 5840825b0d3341c1ad511f2646c975a2 and project fe4f6d64a7bc40adb889fa76c3e13bf5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:46.875088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:46.878352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:46.944850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:46.958212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed310fb5-256f-470d-854c-9d0d37e14e0b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 0.388870 Aug 27 20:55:46.958899 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 976/1866] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:46 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:46.971146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:46.983213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:46.989359 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-54465ae9-14b4-4c63-ad78-63500e0c7219 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142740 Aug 27 20:55:46.990031 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 891/1867] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:47.008715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.020991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:47.022461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.022920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.023758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.026750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.027769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.028440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:47.052266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.052895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.055740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.057854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.059094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.062956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.560303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:47.577617 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0559a7c-b6ef-4eb9-8373-f6bc93e98d95 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.617265 Aug 27 20:55:47.579141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 977/1868] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:46 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:47.587815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:47.608225 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44275cdb-943f-4af4-bac2-72a8f42d6e04 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.608008 Aug 27 20:55:47.615420 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 892/1869] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:46 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:47.625317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:47.626094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:47.636702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:47.638073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:47.649319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.652978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.653658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.654731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.655515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.656144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.656597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.661041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.662188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.663377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.664008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.664699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:47.828147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:47.836865 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fbf50b8-9658-486e-9d96-13b5af362d66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1329 microversion: 2.1 time: 0.218879 Aug 27 20:55:47.846046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 893/1870] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:47 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1329 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:47.851095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc4ff93b-b9d0-47f2-997e-13cf14a047fd tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:47.851735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fc4ff93b-b9d0-47f2-997e-13cf14a047fd tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:47.965320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc4ff93b-b9d0-47f2-997e-13cf14a047fd tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:47.971369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:47.978399 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc4ff93b-b9d0-47f2-997e-13cf14a047fd tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1213 microversion: 2.1 time: 0.130954 Aug 27 20:55:47.979217 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 894/1871] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:47 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1213 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:47.984262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ce3926-f2c1-4496-b23e-75b4cecb0c72", "name": "network-vif-plugged", "status": "completed", "tag": "d55137d0-09b1-440b-b481-cdb396b038bf"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:47.990690 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e23704e6-956e-4d8c-8b1b-b00d6805b685 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.391284 Aug 27 20:55:47.991553 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 978/1872] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:47 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:47.998426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:47.999011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:47.999558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.000746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:48.001436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:48.008505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.009005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.009445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.010152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.010605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.011028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.012398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] Creating event network-vif-plugged:d55137d0-09b1-440b-b481-cdb396b038bf for instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 on nch2-master-1 Aug 27 20:55:48.018094 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-571ac6e0-4482-486b-9dd0-3628c866c6ec req-075bf191-db38-4c26-8256-a52c3205b2e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037463 Aug 27 20:55:48.018803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 895/1873] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:48.074703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-328946430", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "3766caa3-fb64-4e72-99bd-8b880792f22b"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:48.188554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:48.198829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:48.200738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:48.205132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] validate_networks() for [('3766caa3-fb64-4e72-99bd-8b880792f22b', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:48.208288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a69f05a-f9de-4bb7-bcd4-d17ba7a4f274 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.215574 Aug 27 20:55:48.211232 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 979/1874] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:47 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:48.247788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:48.248708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:48.256317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.256910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.257419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.258243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.258774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.259270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.264794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:48.544095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:48.559955 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5cdea78-0433-49de-b645-cfe71695cf6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 0.339660 Aug 27 20:55:48.562140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 980/1875] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:48 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:48.603658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:48.604268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:48.614697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.614946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.615187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.615934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.616385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.616899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.905557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:48.914345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37559454-0cf6-46a8-983c-448b28f0f58f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 0.314311 Aug 27 20:55:48.931748 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 981/1876] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:48 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:48.939663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:48.941107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:48.951275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.952172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.952931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:48.954487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:48.955495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:48.956217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.243141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:49.243714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:49.244061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:49.244469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:49.244876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:49.261116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.262182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.262182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.262735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.263196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.263645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.297044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:49.323611 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22ca4e26-27e1-4a56-bb9c-f3588cc34502 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.390212 Aug 27 20:55:49.324871 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 982/1877] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:48 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:49.342185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:49.342811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:49.354962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.355490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.355977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.356779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.357219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.357692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.360724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Getting quotas for project abfbd78b6106432aafeac0de1bca48b1. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:49.366897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Getting quotas for user 40fd3bf837314e5899b824a20e29ad1e and project abfbd78b6106432aafeac0de1bca48b1. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:49.390195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:49.400625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:49.505100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b6ee93b-7be6-48d7-bcbc-cebc159bbaea tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484833 Aug 27 20:55:49.505897 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 896/1878] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:49.518090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:49.519055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:49.528047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.528881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.529474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.530345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.531033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.531654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.618619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:49.630912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd8534b0-c2ca-4d1f-bef1-0326103187e6 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.304640 Aug 27 20:55:49.633582 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 983/1879] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:49 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:49.667677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:49.680875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:49.681548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:49.688848 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e370c13-2ecd-4ae0-b13f-51dcf48e404c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1283 microversion: 2.1 time: 0.174604 Aug 27 20:55:49.690121 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 897/1880] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:49 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:49.695665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:49.696513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:49.699680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.700202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.700656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.701379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.701839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.702932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.704259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.704990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.712209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.714408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:49.714945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:49.715414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:49.722381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:50.011416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.013316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.024072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.026259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.032100 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e79291f-0e29-4deb-8a3d-aa49c16d749d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.379248 Aug 27 20:55:50.036568 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 984/1881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:49 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:50.041414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f4d6ff4-4026-4e9c-b721-d0346be357cb tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:50.042035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f4d6ff4-4026-4e9c-b721-d0346be357cb tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:50.046152 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81978286-ecfe-46a2-89d5-524278650954 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.353889 Aug 27 20:55:50.049217 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 898/1882] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:49 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:50.060511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:50.077504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:50.078157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:50.105527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.106265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.110154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:50.111203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.114544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.117697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:50.128799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f4d6ff4-4026-4e9c-b721-d0346be357cb tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.142400 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f4d6ff4-4026-4e9c-b721-d0346be357cb tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1215 microversion: 2.1 time: 0.103848 Aug 27 20:55:50.157291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 985/1883] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:50 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:50.166807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:50.169302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:50.179067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.179839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.180496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:50.181645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.182265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.182876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:50.789107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:50.800652 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e94119dc-c55d-49ce-8dbb-06e5d133f3b5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1536 microversion: 2.1 time: 0.750038 Aug 27 20:55:50.803963 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 899/1884] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:50 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1536 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:50.821042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:50.821943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:50.835658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.836434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.837104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:50.838363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:50.839094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:50.839972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.469590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:51.492119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c30ee830-c6de-4366-8ace-8c7d1919d7fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1307 microversion: 2.1 time: 1.330534 Aug 27 20:55:51.493347 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 986/1885] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:50 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1307 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:51.503553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:51.513773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:51.527530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.528694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.531462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.536954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.539156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.540694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.787525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:51.798391 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82c03e41-72c9-427c-b21e-00e14143aae2 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.993116 Aug 27 20:55:51.802292 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 900/1886] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:50 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:51.820411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:51.821825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:51.857017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:51.862839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.865787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.866392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.867716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.869537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83a0b184-8daa-4341-9c01-f11d54ea4b6f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.374807 Aug 27 20:55:51.870146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.870294 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 987/1887] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:51 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:51.871085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.890213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:51.891152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:51.899500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.900228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.900852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:51.902464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:51.903139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:51.903753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.320358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.334569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79876737-a418-4707-b136-5d62324a9638 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1313 microversion: 2.1 time: 0.530604 Aug 27 20:55:52.335436 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 901/1888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:51 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:52.340142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:52.340747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:52.343059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.350250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.351010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.351865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.352231 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d50f6abe-a0eb-41f2-926b-35dd43c4634d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.468201 Aug 27 20:55:52.354171 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 988/1889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:51 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:52.354777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.356676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.357468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.360244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:52.361426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:52.371389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.371892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.372870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.373074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.373457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.374079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.494396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.515331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b2405008-b2df-442c-ba06-5756d3fbf499 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1273 microversion: 2.1 time: 0.155647 Aug 27 20:55:52.516009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 989/1890] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:52 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:52.528899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54664521-0e6f-4816-a130-9d1eb527c73e", "tag": "a2838871-c26a-43fd-a359-77dd82e54c7d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:52.542782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.543265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.546821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.573391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] Creating event network-changed:a2838871-c26a-43fd-a359-77dd82e54c7d for instance 54664521-0e6f-4816-a130-9d1eb527c73e on nch1-master-1 Aug 27 20:55:52.578741 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aa08fba1-7bb1-42d2-8350-abca467348cf req-0e10e176-1a06-4af7-87fc-06393ef2af4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061039 Aug 27 20:55:52.580237 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 990/1891] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:52.592450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-plugged", "status": "completed", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:52.607171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.608056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.608639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.632341 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] Creating event network-vif-plugged:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:55:52.639015 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9852cad0-63a7-4fce-a03e-ea1e6a49c08b req-85047159-f5c8-4dd5-8210-80e888078c32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056435 Aug 27 20:55:52.640051 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 991/1892] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:52.648975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:52.651091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:52.663750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.664273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.664721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.669178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.671590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.672266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.791682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.803189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.805475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.807265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f3f806f-ba7f-411f-a8fe-1271965205cf tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.470505 Aug 27 20:55:52.824492 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 902/1893] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:52 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:52.830801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:52.831543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:52.840144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.841358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.842100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.843223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.844148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.845160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.897975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:52.906756 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a454b3e-ee7e-420e-a53f-cd1ad042aff6 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1529 microversion: 2.1 time: 0.264874 Aug 27 20:55:52.915534 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 992/1894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:52 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1529 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:52.921936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:52.922813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:52.930794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.931861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.932466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:52.933349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:52.933964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:52.934547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.064585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.077980 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fafc392a-d011-4234-bd3b-4b199ecf6f37 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1487 microversion: 2.1 time: 0.251907 Aug 27 20:55:53.080545 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 903/1895] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:52 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1487 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.086784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.092698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.112951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.113721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.114476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.115468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.116097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.116767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.157595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.166914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06797c79-d835-423c-a663-b0ca3aaba365 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.249176 Aug 27 20:55:53.168116 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 993/1896] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:52 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.186344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.187791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.197651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.198456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.199078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.200634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.201272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.201857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.352181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.361148 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-153f2ae7-c445-411e-b0e3-15a053d35f4e tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.280901 Aug 27 20:55:53.361734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 904/1897] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.369775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:53.370474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.383987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.384485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.384923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.385633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.386094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.386503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.412260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.422004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cfc4a01-7de8-4f90-bc08-6fe8f728a5e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1529 microversion: 2.1 time: 0.252801 Aug 27 20:55:53.422950 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 994/1898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1529 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.428321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.429320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.437184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.438002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.438606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.439705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.440316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.441268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.471985 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27eb335d-3900-4847-8b37-c3a12a0ac625 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72/action" status: 202 len: 0 microversion: 2.1 time: 0.108627 Aug 27 20:55:53.474376 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 905/1899] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:55:53 2022] POST /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:55:53.481935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.482650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.490578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.491179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.491702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.492940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.493860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.494557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.682565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.691685 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-182f3ff9-3150-4666-b3eb-9eb7015d1015 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1313 microversion: 2.1 time: 0.267357 Aug 27 20:55:53.692638 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 995/1900] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.712973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b45b6ce6-e292-4489-8dff-c4eaa5fca42d tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.719442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:53.720979 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b45b6ce6-e292-4489-8dff-c4eaa5fca42d tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] HTTP exception thrown: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. Aug 27 20:55:53.729878 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f979f5ad-5bc9-4fc7-aa79-32af564d7333 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.253649 Aug 27 20:55:53.730866 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 906/1901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:53.736938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.737590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.753727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b45b6ce6-e292-4489-8dff-c4eaa5fca42d tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Request method failure captured: Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/flavors/a00ab627-416a-4fbc-8a09-8c603df7a452 HTTP/1.1 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoPiZgR1e8Gha6lAZicsCApL0noTyY_I1ufI6aA_7rkn0fb5CoR6d5k7CWNiyK32LGJ-HGUDf2FxE59Ma4enek6uLafnxCOX94dCBaTT-U2IHtB7fKZbCYzGqPzs-cRLohBUC08KTP69ZROLn0jXI54A8BVwS-6a1DDP4x08gp_QjNk Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ab3656ebdac94b4796c8750cb68dc686 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-MigrationsAdminTest-1992869928 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab3656ebdac94b4796c8750cb68dc686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab3656ebdac94b4796c8750cb68dc686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab3656ebdac94b4796c8750cb68dc686", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab3656ebdac94b4796c8750cb68dc686"}]}] Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-MigrationsAdminTest-1992869928 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ab3656ebdac94b4796c8750cb68dc686 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-MigrationsAdminTest-1992869928 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-MigrationsAdminTest-1992869928-project-admin Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2347ae915fad4b4faaf73d02bac8d3b9 Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-MigrationsAdminTest-1992869928-project-admin Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: exception: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a00ab627-416a-4fbc-8a09-8c603df7a452'} Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:53.758146 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b45b6ce6-e292-4489-8dff-c4eaa5fca42d tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Returning 404 to user: Flavor a00ab627-416a-4fbc-8a09-8c603df7a452 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b45b6ce6-e292-4489-8dff-c4eaa5fca42d tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/a00ab627-416a-4fbc-8a09-8c603df7a452" status: 404 len: 109 microversion: 2.1 time: 0.052967 Aug 27 20:55:53.763485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 996/1902] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:55:53 2022] DELETE /compute/v2.1/flavors/a00ab627-416a-4fbc-8a09-8c603df7a452 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:55:53.764427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.764427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.766614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.767295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.768256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.798655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:53.799633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:53.823184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.823989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.827205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:53.828210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:53.832959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:53.835707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.026538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:54.038474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0e5aa9a-9025-48d9-b017-34ee1a3b1bb5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1273 microversion: 2.1 time: 0.247126 Aug 27 20:55:54.041574 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 997/1903] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:54.048691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:54.049625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:54.057927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.058628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.059234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.060334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.061002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.061609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.136047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:54.148627 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6af63baf-31d8-45fb-bd9d-514d716eeba4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1492 microversion: 2.1 time: 0.416363 Aug 27 20:55:54.149688 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 907/1904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:53 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1492 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:54.156392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1550248894", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:54.270648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:54.656275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:54.672497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:54.674263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:54.675737 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc280e56-37c6-4cec-a16e-dd9ac11f6b30 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.632833 Aug 27 20:55:54.680460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 998/1905] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:54 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:54.684856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:54.685504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:54.686226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:54.686824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:54.687551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:54.687733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:54.688250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:54.695617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.696309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.696922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.697802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.698400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.699052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.740334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.744913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.756236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.758414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:54.761523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:54.762002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:54.808309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:54.836757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:54.856511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Getting quotas for user 513ac3d6ab864589b6b03554fc0ce9a8 and project e287f0565aa445f38277a34a29b94c9d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:54.908448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:54.915823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:54.996787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.013932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f58134a-1dce-43df-9fb2-6239c90ee581 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862525 Aug 27 20:55:55.017824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5c8f0425-5843-4ffa-8500-894bb321c441 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.334075 Aug 27 20:55:55.018694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 908/1906] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:55.019417 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 999/1907] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:54 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.027163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdaac22-8a21-418f-ab77-cbb26b190d0b", "name": "network-vif-plugged", "status": "completed", "tag": "1f9fc837-0bee-49f3-8111-da1f0adba093"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:55.028928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.030978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.041400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.043444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.044110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.046035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.046668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.047799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.068947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.069683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.070316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.078482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:55.090732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] Creating event network-vif-plugged:1f9fc837-0bee-49f3-8111-da1f0adba093 for instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b on nch2-master-1 Aug 27 20:55:55.107212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fb57be4c-b5b9-4ab1-b0dc-f0970ac1909f req-c6aa2298-7976-4d1d-b1b3-c6a0d4f2a2ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086221 Aug 27 20:55:55.109193 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1000/1908] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:55.115025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.124363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.139963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.148893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.149352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.150112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.154811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.155544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.304720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.314153 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8783176c-d268-489e-b633-34b4395e594c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.293351 Aug 27 20:55:55.331960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 909/1909] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.342276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.342900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.366608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.366829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.367651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.370610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.371138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.371620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.536014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.549625 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75b040ff-23c1-4c84-b836-b2af7005b486 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.437900 Aug 27 20:55:55.552538 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1001/1910] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.566296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28a7d938-5ce8-4b5a-8b9f-32c7bd2d93eb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.575578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28a7d938-5ce8-4b5a-8b9f-32c7bd2d93eb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.608165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.619314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40c18054-c21e-4888-9236-d37ca75d4213 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.283946 Aug 27 20:55:55.621026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 910/1911] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.629422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.633773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.640360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.640848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.641283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.641977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.642429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.642900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.669935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28a7d938-5ce8-4b5a-8b9f-32c7bd2d93eb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.682214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28a7d938-5ce8-4b5a-8b9f-32c7bd2d93eb tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1213 microversion: 2.1 time: 0.128516 Aug 27 20:55:55.682805 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1002/1912] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.688167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.689395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.697068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.697918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.698732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.701245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.702940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.703483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.815110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:55.824853 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5013e6e-0be3-44f6-b988-b4c849c1e962 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.200998 Aug 27 20:55:55.825803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 911/1913] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:55.831426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:55.837852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:55.848619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.849478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.850761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.852408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:55.853099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:55.853527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:55.973864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:56.054476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.069625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.071697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.073129 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3b59fc7-35f4-4175-99c4-dc5c19e9cbdd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.246167 Aug 27 20:55:56.074040 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 912/1914] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:56.078526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.079138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.098333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.098896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.099623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.100355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.100814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.101462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.120168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.129028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4462980f-6225-47f3-ba51-265279281fdc tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 200 len: 1472 microversion: 2.1 time: 0.444723 Aug 27 20:55:56.130893 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1003/1915] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:55 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:56.150346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2032305755"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:56.154323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.165071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.165603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.166019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.166741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.167650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.168311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.263518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.274032 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48dcfafc-e95b-4933-8917-869868e0279f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1319 microversion: 2.1 time: 0.198722 Aug 27 20:55:56.274813 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 913/1916] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:56.336924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.337762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.346098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.346597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.347040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.347784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.348247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.348711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.365681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:56.390054 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63df8b21-765b-459c-948a-b867276d4c3b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72/action" status: 202 len: 0 microversion: 2.1 time: 0.243032 Aug 27 20:55:56.391167 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1004/1917] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:55:56 2022] POST /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 20:55:56.405265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0df96c9-46bb-4ad1-b524-9fef6f954e55 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857d3e700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.477685 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0df96c9-46bb-4ad1-b524-9fef6f954e55 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.076008 Aug 27 20:55:56.479289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1005/1918] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:56.548177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.562432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6c3971c-c846-4852-ae99-e094252a0a18 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.230698 Aug 27 20:55:56.563567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 914/1919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:56.577372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.577372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.589973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.593839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.594404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.596449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.599879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.600414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.644886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.646136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.656589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.657427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.658044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.658945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.659480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.659909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.858427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.880493 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77f07da9-2749-4768-a5ca-320b658e24bf tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.308781 Aug 27 20:55:56.881256 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1006/1920] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:56.891098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:56.894136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.894766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.905173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9df3f05-cf57-4873-9bd3-a76615d27d7b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.266161 Aug 27 20:55:56.905173 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 915/1921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:56.920488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.921720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.923196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:56.924026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.924233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:56.927049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.927963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.929586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.934047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.934709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.935157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:56.936427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:56.936796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:56.937358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.103457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.126504 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20e32f1a-c44d-4acf-8720-d465c3e90e99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1265 microversion: 2.1 time: 0.244112 Aug 27 20:55:57.131514 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1007/1922] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:57.147156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.148968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.164967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.168359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.168934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.170159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.170880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.171751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.225112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.240545 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be9658b7-9208-48c7-880c-977bf5dbba3c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.331141 Aug 27 20:55:57.258209 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 916/1923] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:56 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:57.278083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea294e9b-8451-4526-b15b-afb1c9cee9dd", "name": "network-vif-plugged", "status": "completed", "tag": "866419e8-7e88-4363-9e3d-364029997067"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:57.287600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:57.326959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.327504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.327933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.342336 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] Creating event network-vif-plugged:866419e8-7e88-4363-9e3d-364029997067 for instance ea294e9b-8451-4526-b15b-afb1c9cee9dd on nch2-master-1 Aug 27 20:55:57.347458 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ae28b82b-34a9-4c84-8cce-d09ea10fc35e req-2ec5a6c2-2428-4de8-ab13-631d455618ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087861 Aug 27 20:55:57.352797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 917/1924] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:57.358576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.359536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.367660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.368423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.368905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.370040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.370670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.371371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.411629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.425835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.427874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.429173 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f1799fc-effa-470d-bba6-0b95b6d440c8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.294349 Aug 27 20:55:57.430049 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1008/1925] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:57.496397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b94936e-7359-4eaa-8da9-d07f77125ec1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857db9790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.528957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.539951 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dc6bb72-8e2f-4648-a7f6-3254526fcd13 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1469 microversion: 2.1 time: 0.185609 Aug 27 20:55:57.541141 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 918/1926] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:57.601203 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b94936e-7359-4eaa-8da9-d07f77125ec1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.110554 Aug 27 20:55:57.602441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1009/1927] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:57.616085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.616848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.625435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.626502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.627127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.629409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.630352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.631019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.766464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-37558870", "block_migration": true, "disk_over_commit": false}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:57.771189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.781707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.782562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.783198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.784153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.784765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.786039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.824663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lazy-loading 'flavor' on Instance uuid 9fdaac22-8a21-418f-ab77-cbb26b190d0b {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:55:57.842792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Going to try to live migrate instance to tempest-host-37558870 {{(pid=140433) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:55:57.850149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:57.854209 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] HTTP exception thrown: Compute host tempest-host-37558870 could not be found. Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Request method failure captured: Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b/action HTTP/1.1 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 105 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS5186G_-QinuemHlWU7K_ywNByzhncnl_hBi7StnEhtrDAzxveUOIfcKPCn-DEYWUzPGZF1AxXRN89sssvzHPXn8voKZako9JRJCplfiJO46Xv290O5mNqYbIOFJaXE9_GTAOdVdJPvW_ze_z4SGBaSA3MeV_YHDzoNsiwboiUjEk Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: ad3ec1b4ed3845668403d37b7a67f09f Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad3ec1b4ed3845668403d37b7a67f09f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ad3ec1b4ed3845668403d37b7a67f09f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ad3ec1b4ed3845668403d37b7a67f09f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad3ec1b4ed3845668403d37b7a67f09f"}]}] Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: ad3ec1b4ed3845668403d37b7a67f09f Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-LiveMigrationNegativeTest-2143604114-project-admin Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5626d07632a04e4e94bdcb2bbee9f555 Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-LiveMigrationNegativeTest-2143604114-project-admin Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: {"os-migrateLive": {"host": "tempest-host-37558870", "block_migration": true, "disk_over_commit": false}} Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: exception: Compute host tempest-host-37558870 could not be found. Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9fdaac22-8a21-418f-ab77-cbb26b190d0b', 'body': {'os-migrateLive': {'host': 'tempest-host-37558870', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 20:55:57.860356 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-37558870 could not be found. Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-37558870 could not be found. Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-37558870 could not be found. Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Returning 400 to user: Compute host tempest-host-37558870 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19cdb4b5-9047-4093-91b6-f600fbdb1a81 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b/action" status: 400 len: 98 microversion: 2.1 time: 0.301402 Aug 27 20:55:57.867849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 919/1928] 10.222.0.40 () {60 vars in 1279 bytes} [Sat Aug 27 20:55:57 2022] POST /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b/action => generated 98 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:55:57.873247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.874441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.876170 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-027f8752-501d-4efb-907b-164334c3e872 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.272195 Aug 27 20:55:57.877309 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1010/1929] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:57.885919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.886414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.886959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.887746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.888196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.888619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.904211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:57.905366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:57.917177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.918311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.919032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:57.920502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:57.921191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:57.921914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.120144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:58.130043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b49a9856-65f5-4523-8903-b232422d1adb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1469 microversion: 2.1 time: 0.262554 Aug 27 20:55:58.130658 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 920/1930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:58.160716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:58.162370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:58.168712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.169520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.170164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.171106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.171812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.172478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.187709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:58.198101 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-99f7aac0-d81c-4f17-a5b5-752942160b4a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.298460 Aug 27 20:55:58.198735 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1011/1931] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:57 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:55:58.217167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:58.217789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:58.227679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.232229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.232933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.233827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.234561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.235579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.371740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:58.383862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8352127-5f73-447e-83dd-8d6bd9b51225 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1271 microversion: 2.1 time: 0.183508 Aug 27 20:55:58.385428 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1012/1932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:58 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:58.391999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:58.393007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:58.401001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.401508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.402000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.402941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.403700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.404368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.426240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:58.436888 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99f00112-19ef-4549-a998-614608fcc0b0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.291719 Aug 27 20:55:58.445791 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 921/1933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:58 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:58.445791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-879688181", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:58.503403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:55:58.737899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:58.753367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15959b73-4b0c-4312-a1a5-49017a876a12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.366664 Aug 27 20:55:58.769007 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1013/1934] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:58 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:58.780226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:58.781045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:58.788260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.788947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.789518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.790301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.790927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.791664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.907807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:55:58.908218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:55:58.908709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:55:58.909128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:55:58.909547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:55:58.921654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.923744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.924951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.925998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:58.926667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:58.927155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:58.951992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Getting quotas for project c709ec9938bd48179cb71ac25c6f7256. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:55:58.957435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Getting quotas for user dff9c89bfd3b44908a44a5f4726d2d39 and project c709ec9938bd48179cb71ac25c6f7256. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:55:58.976910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:55:58.980652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:55:59.002314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.014462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.016512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.017853 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aed3502d-ce35-40f3-8bf7-e6685b6a0a67 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.258209 Aug 27 20:55:59.018708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1014/1935] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:55:58 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:55:59.024983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "tag": "194f5c4d-2c46-410d-8f4b-baa3bd0181d0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:55:59.038137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.043690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.045442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.060845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-033ffa12-2a70-44c9-b655-9e3d92d8df4f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621272 Aug 27 20:55:59.063559 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 922/1936] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:55:59.070375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] Creating event network-changed:194f5c4d-2c46-410d-8f4b-baa3bd0181d0 for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:55:59.072722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-899323f9-e49e-470b-826a-bfedcdba8f1e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857b941f0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.097586 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a65beabe-82aa-405e-8629-2c9fb6e693c6 req-46900133-26de-458f-af03-61b3cf733402 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076639 Aug 27 20:55:59.098861 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1015/1937] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:55:59.105330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.106028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.127964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.129222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.130313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.141412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.142591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.143226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.181520 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-899323f9-e49e-470b-826a-bfedcdba8f1e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.114963 Aug 27 20:55:59.182401 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 923/1938] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:59.199736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e869ff8-8560-48b3-b889-baaf0dc1b0de tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.200695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e869ff8-8560-48b3-b889-baaf0dc1b0de tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.292603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e869ff8-8560-48b3-b889-baaf0dc1b0de tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.307495 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e869ff8-8560-48b3-b889-baaf0dc1b0de tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1218 microversion: 2.1 time: 0.118858 Aug 27 20:55:59.309089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 924/1939] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:59.320440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.322416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.338260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.338706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.339260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.339902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.340354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.340775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.401930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.412556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a340394f-c533-451b-90f8-27cc5c57a019 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.312300 Aug 27 20:55:59.414619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1016/1940] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:59.431330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.432261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.439891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.440650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.441283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.442349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.443032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.443696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.545877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.554867 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d07ee553-60b6-45b7-8708-ae6240803c14 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1271 microversion: 2.1 time: 0.136967 Aug 27 20:55:59.555748 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1017/1941] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:59.575501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.586297 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dce28a99-cd82-4e2b-8e31-a43fa07f8211 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.276062 Aug 27 20:55:59.594164 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 925/1942] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:55:59.713865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.714499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.721579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.722403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.723021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.723864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.724327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.724859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.779018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:55:59.780206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:55:59.790514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.791495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.792547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.793884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:55:59.794554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:55:59.795312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:55:59.945939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:55:59.955999 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9bd67f2-4119-4608-9961-aedc1b75ff66 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1197 microversion: 2.1 time: 0.383793 Aug 27 20:55:59.956802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1018/1943] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1197 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:00.012674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.021979 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e513a68-b542-460f-99e3-e3ad83caff2a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.247879 Aug 27 20:56:00.022936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 926/1944] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:55:59 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:00.052488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.053104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:00.061738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.062286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.062679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.063567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.064307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.064739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.197719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59983c61-dffb-40b7-bf3a-8aad85e0bc98 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c0f9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.249913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.256259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:00.265952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.267610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.269081 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8b0e37a-34ff-46a1-9b1d-d87265acca3b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.222130 Aug 27 20:56:00.270298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1019/1945] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:00.332112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.333170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:00.340170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59983c61-dffb-40b7-bf3a-8aad85e0bc98 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.146736 Aug 27 20:56:00.346155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.346682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.347115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.347864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.348474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.349139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.349565 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 927/1946] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:00.436554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.437480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:00.448545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.450453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.450972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.451486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.452238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.452700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.453157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.459997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7dcff15-331c-4ee2-9ce2-a426a06410f4 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1270 microversion: 2.1 time: 0.132437 Aug 27 20:56:00.462596 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1020/1947] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1270 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:00.525031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54664521-0e6f-4816-a130-9d1eb527c73e", "name": "network-vif-plugged", "status": "completed", "tag": "a2838871-c26a-43fd-a359-77dd82e54c7d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:00.539686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.540663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.541288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.555956 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] Creating event network-vif-plugged:a2838871-c26a-43fd-a359-77dd82e54c7d for instance 54664521-0e6f-4816-a130-9d1eb527c73e on nch1-master-1 Aug 27 20:56:00.563888 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4f2e6eba-c34f-4be7-8530-88cdf61a1f50 req-f3e440e3-b59e-4ddd-9c64-f4c6f71f4579 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046365 Aug 27 20:56:00.565179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1021/1948] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:56:00.579142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.580734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:00.589497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.590114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.590739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.591991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.592689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.593469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.676722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.695187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3be4aa04-b1fd-484f-835f-d2bc317151e7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.264513 Aug 27 20:56:00.713016 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 928/1949] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:00.719595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:00.720548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:00.731862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.734037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.735263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.736621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:00.737555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:00.739226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:00.977841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:00.992306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-518f828a-f728-4bb1-aa3e-b3308c64c1a1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.274976 Aug 27 20:56:00.994239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 929/1950] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.013730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.014468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.028288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.029886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.031962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.032410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.037734 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b977f14-22d2-4c46-a446-664fa74c5e2f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.464381 Aug 27 20:56:01.038232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.038731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.039322 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1022/1951] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:01.044633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.045059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.045837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.055206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.056979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.057851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.058799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.060030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.060710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.272975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.283583 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfe5ce71-85d0-44b3-9307-d6450c5b85df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.242755 Aug 27 20:56:01.283991 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1023/1952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.296827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01b32240-8638-4266-b298-ec34596b6544", "tag": "15a3285e-1b8f-4eca-b6d1-b656787f96c4"}, {"name": "network-changed", "server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "tag": "3ff63124-4441-486f-a107-fcd63c25468e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:01.322263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.322982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.324436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.334360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.343689 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Creating event network-changed:15a3285e-1b8f-4eca-b6d1-b656787f96c4 for instance 01b32240-8638-4266-b298-ec34596b6544 on nch1-master-1 Aug 27 20:56:01.344299 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] Creating event network-changed:3ff63124-4441-486f-a107-fcd63c25468e for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:56:01.347536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64e60a8c-139c-4ddb-a25e-ffd43affa070 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1381 microversion: 2.1 time: 0.350794 Aug 27 20:56:01.348734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 930/1953] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:00 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1381 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.361856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9dc76008-2ef2-47bc-87d5-e4a926165c80 req-fcea92f8-ea0f-4187-9527-03db6a590a1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072814 Aug 27 20:56:01.362465 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1024/1954] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:01.365985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.366880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.374742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.375330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47e24326-5b3e-4b4a-b374-cbcf5751628c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f214d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.375791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.376405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.377529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.378203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.378867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.451951 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47e24326-5b3e-4b4a-b374-cbcf5751628c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.079709 Aug 27 20:56:01.454643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1025/1955] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.465021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.465879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.477338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.480969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.483137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.484981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.485748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.487175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.655736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.678618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.686851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.689036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae4843d1-e054-4438-b2fd-43d7ef1e0ffc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.338900 Aug 27 20:56:01.705421 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 931/1956] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:01.711821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.712940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.715869 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf9b72c2-3108-48b1-a4b5-5d54f826e540 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1532 microversion: 2.1 time: 0.254640 Aug 27 20:56:01.716824 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1026/1957] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1532 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.725661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.726464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.728252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.728543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.728877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.729795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.730951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.735435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.743553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.744542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.745193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.746399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.747145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.747956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.862706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.874089 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-951c537d-7e69-4e86-831b-0caa86dab6f0 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1270 microversion: 2.1 time: 0.171048 Aug 27 20:56:01.874890 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 932/1958] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:01.879799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:01.881106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:01.891857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.892401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.892861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.893629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:01.894091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:01.894713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:01.986453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:01.996053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a3c02675-42e1-43b1-a544-b3aebb4ba9a7 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.278157 Aug 27 20:56:01.996650 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1027/1959] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:02.019451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.020083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:02.026748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.027589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.027589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.028295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.028990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.029211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.058203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-276d6663-1873-4c59-8753-b3b2a5c3182a tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1532 microversion: 2.1 time: 0.182118 Aug 27 20:56:02.059442 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 933/1960] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:01 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1532 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:02.064282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.064901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:02.075270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.075801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.076248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.076966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.077433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.077878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.283059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.288584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.292423 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cec603bc-f0bd-4b5f-b756-ea88ed9ac119 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.276854 Aug 27 20:56:02.293959 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1028/1961] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:02.297965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d61fd3ed-2482-435b-add6-d2d10f455ca7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.237251 Aug 27 20:56:02.298551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 934/1962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:02.298991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.303154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.303688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.304128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.304860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.305322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.305715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.311302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.312067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:02.320606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.321181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.321663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.322542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.323022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.323629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.328169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:02.334012 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d963e8a8-22c9-473d-bd68-77102eb9f2d5 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038800 Aug 27 20:56:02.334641 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1029/1963] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:02.347291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:02.350070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:02.356419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.357156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.357597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.358316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.358779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.359211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.385080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lazy-loading 'flavor' on Instance uuid ea294e9b-8451-4526-b15b-afb1c9cee9dd {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:02.399660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Going to try to live migrate instance to nch1-master-1 {{(pid=140434) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 20:56:02.471929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.481288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d562eb33-c148-4a09-af55-f352bc7a9803 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.178672 Aug 27 20:56:02.481852 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 935/1964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:02.504231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46818c86-c9f6-4bb7-a564-1c51fc0fb9fe tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c0ff70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.557388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46818c86-c9f6-4bb7-a564-1c51fc0fb9fe tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.073993 Aug 27 20:56:02.558538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 936/1965] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:02.713716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:02.714354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:02.722859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.723877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.724966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.725819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:02.726512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:02.726969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:02.967973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.995834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.997654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:02.999301 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a351016b-93da-4ca4-a918-3389281aab92 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.290006 Aug 27 20:56:03.015657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 937/1966] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:02 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:03.015657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:03.015657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:03.024682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.025196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.025636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.026869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.027725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.028483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.152698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:03.164785 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa6c42c0-69cc-44c1-8c45-58c1bb0613d9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1270 microversion: 2.1 time: 0.162478 Aug 27 20:56:03.165408 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 938/1967] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:03 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:03.172188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:03.173827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:03.182811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.183314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.183972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.184686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.185138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.185560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.347900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:03.358575 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dde77012-ab02-4942-8ac3-22ff66f1bb4f tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.191553 Aug 27 20:56:03.359281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 939/1968] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:03 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:03.365350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:03.366217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:03.374039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.375060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.375605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.376520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.376996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.377404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.682491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:03.694373 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e064592-e111-4cbc-b2d0-4dfe9d10f92e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.333393 Aug 27 20:56:03.695405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 940/1969] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:03 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:03.701692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:03.703232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:03.715592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.717261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.718100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:03.719205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:03.719904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:03.720907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.075910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:04.098004 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4961b31-9338-469b-b2e6-1dd9a7a6195d tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.400081 Aug 27 20:56:04.100689 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 941/1970] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:03 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:04.107734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:04.108942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:04.119226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.119848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.120248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.121658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.122129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.122590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.769977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:04.780953 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc0ee0ec-9b27-4a0d-847a-55def454e570 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.678892 Aug 27 20:56:04.781862 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 942/1971] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:04 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:04.801007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bbac41-db58-4ad1-8fe6-0c0d28bd6565", "name": "network-vif-unplugged", "status": "completed", "tag": "15d8e2f3-f9e5-462a-9557-9c924e65e52f"}, {"name": "network-changed", "server_uuid": "d6bbac41-db58-4ad1-8fe6-0c0d28bd6565", "tag": "15d8e2f3-f9e5-462a-9557-9c924e65e52f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:04.806030 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c31c4c67-8692-45ba-b33a-12a1e44a415c tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd/action" status: 202 len: 0 microversion: 2.1 time: 2.462042 Aug 27 20:56:04.809403 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1030/1972] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:56:02 2022] POST /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd/action => generated 0 bytes in 2466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:56:04.812891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.813454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.814632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.820348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfd4047c-46d4-4c75-8961-9c84700a4906 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec65d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:04.832653 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Creating event network-vif-unplugged:15d8e2f3-f9e5-462a-9557-9c924e65e52f for instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 on nch1-master-1 Aug 27 20:56:04.832653 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] Creating event network-changed:15d8e2f3-f9e5-462a-9557-9c924e65e52f for instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 on nch1-master-1 Aug 27 20:56:04.836849 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a5d5dcf0-c3d4-4aa3-bc37-a428148360fb req-0575b854-de68-4ed8-af4f-09e17fabb90e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.039214 Aug 27 20:56:04.838062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 943/1973] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:04.847193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:04.849078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:04.857240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.858132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.858758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.859832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.860710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.861534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.904070 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfd4047c-46d4-4c75-8961-9c84700a4906 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.093264 Aug 27 20:56:04.905316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1031/1974] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:04 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:04.920413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:04.921045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:04.929699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.930280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.930771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:04.931505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:04.931961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:04.932385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.026239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.037264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-956def98-6275-45b5-8375-10c23698c39c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1276 microversion: 2.1 time: 0.129655 Aug 27 20:56:05.038188 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1032/1975] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:04 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:05.044638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:05.045339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:05.054023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.055036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.055747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.057161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.057834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.058696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.241617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.272338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.274385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.285088 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f568de30-91d2-4e71-b0cc-f4dd61e6f4eb tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.443861 Aug 27 20:56:05.286493 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 944/1976] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:04 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:05.311022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:05.311777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:05.336919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.338114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.338776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.339948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.343532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.344310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.358831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.367490 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b491a155-f565-4b25-a898-e087abafd8e2 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1403 microversion: 2.1 time: 0.327907 Aug 27 20:56:05.372778 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1033/1977] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:05 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1403 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:05.378140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:05.381895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:05.407564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.408462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.409114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.410084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.410774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.411504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.677593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:05.874268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.890778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-317c1149-70bb-4a37-8b80-a9d1586f1f3f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.516497 Aug 27 20:56:05.892723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1034/1978] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:05 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:05.899788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:05.919251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:05.921457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c347ee5f-0245-44fd-84d6-5a9b64cf0702 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.631345 Aug 27 20:56:05.926475 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 945/1979] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:05 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:05.928460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:05.945096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ce3926-f2c1-4496-b23e-75b4cecb0c72", "name": "network-vif-plugged", "status": "completed", "tag": "d55137d0-09b1-440b-b481-cdb396b038bf"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:05.960124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.961299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.961795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.962918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.963695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.964494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:05.977459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:05.978016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:05.978455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.008758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] Creating event network-vif-plugged:d55137d0-09b1-440b-b481-cdb396b038bf for instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 on nch2-master-1 Aug 27 20:56:06.028962 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8d44343a-0a2a-4bdf-b6c1-7cbdddea0a18 req-68143b4e-4160-4baf-aea5-8f75c892e4f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099195 Aug 27 20:56:06.029626 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 946/1980] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:06.034774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:06.035472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:06.049325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.049799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.050234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.050937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.051524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.051955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.494492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:06.518025 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-33aef9b4-96d7-44e7-ba0d-76b42d750e9a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.623730 Aug 27 20:56:06.522826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1035/1981] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:05 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:06.529264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9cf6fd0-b05d-4ead-8cac-1dbe3cec0ead tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ed15280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:06.612193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9cf6fd0-b05d-4ead-8cac-1dbe3cec0ead tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.088011 Aug 27 20:56:06.617737 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1036/1982] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:06 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:06.628861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:06.630272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:06.634046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:06.643931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.644874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.645413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.646305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.651983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.652455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.765894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:06.784322 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-83dd4d2f-e5d6-4978-b7b1-066f99f05bc5 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.753093 Aug 27 20:56:06.785199 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 947/1983] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:06 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:06.800348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:06.801276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:06.811221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.814605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.815282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:06.816070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:06.816532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:06.817002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.231456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.244358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0b541d71-4f83-486f-9f9b-5934de070e3e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.625389 Aug 27 20:56:07.244982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1037/1984] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:06 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:07.264743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:07.265672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:07.282791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.283675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.284542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.288059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.288899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.289507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.397104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.410712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.412430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.416540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70a146d7-adad-49d9-9014-509d68a773cd tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.620322 Aug 27 20:56:07.417396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 948/1985] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:06 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:07.422757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:07.433088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.434042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.434660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.453826 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] Creating event network-changed:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:56:07.459459 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6cc4426f-047a-44f2-987b-c694cd87bf2d req-0ec3811d-6ceb-47bc-a230-da7ad1114372 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040452 Aug 27 20:56:07.460317 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 949/1986] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:07.466922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:07.468039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:07.475461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.476061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.476611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.477428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.477973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.478667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.603217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.617228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1af675dd-3f4d-484d-a624-885cfd78a9e3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1589 microversion: 2.1 time: 0.358138 Aug 27 20:56:07.617869 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1038/1987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:07 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1589 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:07.635074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:07.635991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:07.653695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.654767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.655748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.657175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.657876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.658477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.700790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:07.816095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.827247 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b40ed379-5adb-472b-ae3d-3a9fdc0972f0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.365505 Aug 27 20:56:07.828142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 950/1988] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:07 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:07.834286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:07.835040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:07.842465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.843249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.844053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.845056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:07.845736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:07.846390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:07.981462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:07.999531 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4fd91db4-597c-4dc5-83d9-bd3c23ded5ec tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.376930 Aug 27 20:56:08.000876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1039/1989] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:07 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:08.007131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b45b681-cfa8-4348-8d3e-6efd59ef950f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec09820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.082445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b45b681-cfa8-4348-8d3e-6efd59ef950f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.079632 Aug 27 20:56:08.083304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1040/1990] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:08.089829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.090800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:08.103066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.104528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.105931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.106680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.107168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.107644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.169259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.179187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c33acbcc-e272-409f-85b9-c42d75e147f0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.349571 Aug 27 20:56:08.180022 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 951/1991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:07 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:08.184484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.185163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:08.193346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.193938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.194468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.195526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.196043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.196535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.238996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3958ce2f-980c-4711-9b38-a94891dab4f1 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154249 Aug 27 20:56:08.240899 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1041/1992] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:08.260557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b32240-8638-4266-b298-ec34596b6544", "name": "network-vif-plugged", "status": "completed", "tag": "15a3285e-1b8f-4eca-b6d1-b656787f96c4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:08.276287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.276942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.277448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.291760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] Creating event network-vif-plugged:15a3285e-1b8f-4eca-b6d1-b656787f96c4 for instance 01b32240-8638-4266-b298-ec34596b6544 on nch1-master-1 Aug 27 20:56:08.297696 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9548f407-e073-4bbd-82ee-2820c9cb1f0f req-539b3760-b507-4003-9ba1-3191a232c582 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054981 Aug 27 20:56:08.304451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1042/1993] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:08.311915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9a87d1-3b7c-4840-8f7c-00bfca879c78", "tag": "76a9e586-9fde-4386-a84e-3df85e5c106a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:08.337954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.338629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.340056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.373269 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] Creating event network-changed:76a9e586-9fde-4386-a84e-3df85e5c106a for instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 on nch1-master-1 Aug 27 20:56:08.381700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1de9a3eb-a82d-4ef2-8b1a-678e9095cc5c req-9555681e-fc9d-42ec-aef7-8d3f530ad894 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075956 Aug 27 20:56:08.387779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1043/1994] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:08.401170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.402343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:08.416493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.422646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.423470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.423939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.425008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.425639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.426641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.436033 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55558fc3-9c38-4986-9ddc-1170da588c12 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.254381 Aug 27 20:56:08.437383 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 952/1995] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:08.453936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.454884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:08.475768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.476741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.480955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.482209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.482913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.483488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.746032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.756311 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7a388ab-7d90-4fbb-b587-18dcb0f203f3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.366897 Aug 27 20:56:08.761285 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1044/1996] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:08.774481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.783476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.785405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:08.786971 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c9ee9c1-3c87-47f1-b39b-849920248ff9 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.337530 Aug 27 20:56:08.788104 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 953/1997] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:08.850532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:08.851891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:08.861060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.862328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.863378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:08.866256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:08.866979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:08.867645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.022377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.024143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:09.033115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:09.042492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.043434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.044135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.047060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.047869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.056465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.094061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:09.109201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2007300c-f595-4db6-95a5-03788ac84e7d tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.263547 Aug 27 20:56:09.119375 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1045/1998] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:08 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:09.119375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d597909f-82c6-4a9b-a823-4ad7e75cec4a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec09e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.206260 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d597909f-82c6-4a9b-a823-4ad7e75cec4a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.093226 Aug 27 20:56:09.207237 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1046/1999] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:09.214156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.214401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:09.224878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.224878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.224878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.225370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.225768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.226663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.296045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:09.298681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:09.304538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=28 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:09.321248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b475432f-e1ee-4504-96aa-8f8fa31228b2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.302830 Aug 27 20:56:09.322199 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 954/2000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:09.458445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.459181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:09.467772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:09.479514 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b6a27d6-344a-4095-a83d-3b13823353eb tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.270519 Aug 27 20:56:09.480398 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1047/2001] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:09.485491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.485989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.486428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.487142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.487627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.488229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.691444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:09.704139 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-801f220e-d73e-4459-b4b1-50c9dccfbd8c tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.249305 Aug 27 20:56:09.704716 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 955/2002] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:09.785214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.786038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:09.802964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.805578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.806313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.807498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.808205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.808877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.811370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:09.812138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:09.827434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.827937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.828375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:09.829098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:09.829545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:09.835249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.085472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.107892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.117338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.118808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.120083 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c13b500-38b2-4cf5-8f38-f7f3910e2b22 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.313827 Aug 27 20:56:10.121064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 956/2003] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:10.123929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0e635db-9dd1-423a-a165-35e87b74293e tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.343266 Aug 27 20:56:10.131230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1048/2004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:09 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:10.142467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.142995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:10.146119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.150295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.150801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.151252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.152021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.152417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.152857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.156168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:10.163962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.164466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.164906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.165622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.166098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.166500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.423385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.434650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.437127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dad36b15-f289-4194-9932-d877c5dbef47 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.298478 Aug 27 20:56:10.439162 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1049/2005] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:10.443710 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da4403ca-3957-4b71-9a0b-356f091ab28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1589 microversion: 2.1 time: 0.313805 Aug 27 20:56:10.444257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54664521-0e6f-4816-a130-9d1eb527c73e", "tag": "a2838871-c26a-43fd-a359-77dd82e54c7d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:10.460609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.460938 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 957/2006] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1589 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:10.462447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.463092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.465736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4f21734-7b13-4224-b09c-841a7daa79dd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857b94ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.527906 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] Creating event network-changed:a2838871-c26a-43fd-a359-77dd82e54c7d for instance 54664521-0e6f-4816-a130-9d1eb527c73e on nch1-master-1 Aug 27 20:56:10.542655 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4f21734-7b13-4224-b09c-841a7daa79dd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.080329 Aug 27 20:56:10.548920 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-36613fd9-d1c9-4033-a0fe-c2f13847d47f req-0ff5d5cf-6b6d-4ab4-9664-59d2bbfdd7b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107913 Aug 27 20:56:10.549802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1050/2007] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:10.551776 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 958/2008] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:10.558765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.559980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:10.563267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.567558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:10.569683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.570583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.571515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.572606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.573227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.573834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.588460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.588977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.590405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.591534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.591998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.596135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.874283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.887755 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10d1f10c-699e-4d41-868d-6a7644671d75 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.331906 Aug 27 20:56:10.916979 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 959/2009] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:10.928458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:10.931625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:10.941264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.942258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.942860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.943740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:10.944434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:10.944843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:10.974054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:10.994020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68729f20-25b6-4548-bbe0-01798a3f2c24 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.442713 Aug 27 20:56:10.995803 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1051/2010] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:11.144750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:11.145473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:11.164801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.165422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.165829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.166608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.170258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.170712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.189847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:11.205601 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c150ef7-46c3-4807-b95d-3fc0f7608910 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.287336 Aug 27 20:56:11.221149 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 960/2011] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:10 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:11.231729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:11.233588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:11.243908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.245271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.246002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.247626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.248523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.249396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.539208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:11.554616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f424e71c-707d-4e8a-a9d5-f7a0e9fddb67 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.329129 Aug 27 20:56:11.555498 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 961/2012] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:11 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:11.564409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:11.565221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:11.582984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.587053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.595174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.596345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.597015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.597793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.628153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:11.639702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:11.643693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:11.648856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-521f638f-4bb9-42ec-a660-cd32c74e01ca tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.508139 Aug 27 20:56:11.650150 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1052/2013] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:11 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:11.657756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-841b2967-1cad-40f3-b9d2-3dbad2e7084e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec5aee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:11.748295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-841b2967-1cad-40f3-b9d2-3dbad2e7084e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.096799 Aug 27 20:56:11.763751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1053/2014] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:11 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:11.910084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:11.911062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:11.930291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.933445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.934050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:11.934970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:11.936081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:11.940195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:12.317875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:12.401988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:12.435589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e3c732b-988c-4aae-9ca9-971af882aeed tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.875567 Aug 27 20:56:12.438935 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 962/2015] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:11 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:12.459300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:12.463003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:12.467376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:12.475124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:12.479080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:12.480106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:12.480721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:12.481267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e22cc216-c402-47e3-93e9-55bd7696d8d1 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.574995 Aug 27 20:56:12.495200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:12.495485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1054/2016] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:11 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:12.495485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:12.495485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:12.500303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:12.501014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:12.503036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:12.509009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:12.512112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:12.513095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:12.513769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:12.515681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.038121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.059757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.063978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-982929d9-29ca-4f9e-ab59-9b6eb99f58e6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1315 microversion: 2.1 time: 0.576634 Aug 27 20:56:13.068727 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1055/2017] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:12 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:13.080759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-676ac026-67e1-4721-ba38-d6655fd94f7c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.639792 Aug 27 20:56:13.081392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:13.085549 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 963/2018] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:12 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:13.088413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:13.104116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:13.104772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:13.104993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.105652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.106323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.107326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.107973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.109252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.145444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.146086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.148999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.149774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.153915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.156955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.537522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.559515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.565653 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0b81c00-ab7b-4586-9a1c-7a6aee9095bb tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.495552 Aug 27 20:56:13.566257 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1056/2019] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:13 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:13.579510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.579510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:13.579510 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-978daa37-3bc4-41e2-860c-03a3cf219f43 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.491280 Aug 27 20:56:13.579510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 964/2020] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:13 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:13.585701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-023c756a-a215-4c7d-b995-c320891d51aa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec375e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:13.618309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:13.619473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:13.651638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.653094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.654465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.657791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.660629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.662032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.676580 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-023c756a-a215-4c7d-b995-c320891d51aa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.108921 Aug 27 20:56:13.679954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1057/2021] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:13 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:13.702571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:13.704472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:13.734968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.743662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.745037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:13.753412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:13.756572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:13.763708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:14.984035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:15.002453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-917dae13-0642-4acc-8de9-e1c9141722d4 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 1.313264 Aug 27 20:56:15.005286 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1058/2022] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:13 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:15.014125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:15.015581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:15.031099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.032289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.032964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.034717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.036446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.037534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.055113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:15.075589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0462d273-9db6-40b4-94ab-9f3763ac624f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 1.495850 Aug 27 20:56:15.076417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 965/2023] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:13 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:15.100509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:15.101792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:15.136551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.137562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.140919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.145321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.150147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.154487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.635058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:15.649430 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-57e1352a-af12-437d-a196-af98a4f888e8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.570892 Aug 27 20:56:15.654671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:15.663752 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 966/2024] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:15 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:15.673750 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-620fc605-55a9-41c8-8268-a75fa6408c52 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1502 microversion: 2.1 time: 0.660654 Aug 27 20:56:15.677978 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1059/2025] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:15 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1502 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:15.680828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:15.681250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:15.688007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.691604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.692585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.693337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.693827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:15.693961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.694481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.706024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:15.742286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.745334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.749635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:15.754804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:15.755950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:15.756412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.105633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.132690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.139024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.141345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-733cb6a9-a303-48e7-8590-d61fa8420b85 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.462365 Aug 27 20:56:16.144297 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1060/2026] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:15 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:16.164091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc7c629e-9f98-42c1-be5b-b2adc2970910 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ecaeee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.178429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.197267 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad351221-a83b-4fae-9020-a71100435812 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.525197 Aug 27 20:56:16.205574 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 967/2027] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:15 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:16.224167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "name": "network-vif-plugged", "status": "completed", "tag": "194f5c4d-2c46-410d-8f4b-baa3bd0181d0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:16.225538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc7c629e-9f98-42c1-be5b-b2adc2970910 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.079807 Aug 27 20:56:16.226329 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1061/2028] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:16 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:16.240092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.244481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:16.245903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.246450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.246932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.261984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.262293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] Creating event network-vif-plugged:194f5c4d-2c46-410d-8f4b-baa3bd0181d0 for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:56:16.262485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.262924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.263735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.264142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.264578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.268185 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5e0db306-ee4c-4038-b778-2cdb4bc5d412 req-1feeea1b-750c-440c-8c30-2549f8f9426c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059659 Aug 27 20:56:16.269207 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 968/2029] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:16.275483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.276219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:16.283206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.283923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.284367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.285115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.286567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.287252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.326999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:16.365050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:16.451149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d59f7872-6b40-4457-9dfa-30dab71c6e78 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 204 len: 0 microversion: 2.1 time: 0.216295 Aug 27 20:56:16.452246 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1062/2030] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:16 2022] DELETE /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:16.461109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.461903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:16.469386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.469865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.470510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.471703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.472232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.472789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.550431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.578927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cdb77817-b225-435f-bcba-98bce9e91816 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.308127 Aug 27 20:56:16.579567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 969/2031] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:16 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:16.586038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.625635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.688764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.693131 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9523741-3eea-44bc-974e-56179a47a72e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.239254 Aug 27 20:56:16.697041 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1063/2032] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:16 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:16.709546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:16.710529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:16.719687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.723968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.724784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.725665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:16.726437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:16.726973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:16.919698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:16.931048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f99a849-eac9-488a-8814-eae0c254afe7 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.349996 Aug 27 20:56:16.948319 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 970/2033] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:16 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:17.026362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.041443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42be0ae8-e879-4137-9038-b83c624316f7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.345818 Aug 27 20:56:17.053396 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1064/2034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:16 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:17.170894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.171569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:17.187867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.188557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.189650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.190087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.190528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.190968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.225205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.225771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:17.240972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.241481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.241926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.242650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.243766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.243766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.493356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.504074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.511309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.516607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9e38132-b4d7-4957-ad77-b9e84b1d7c79 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.295437 Aug 27 20:56:17.517254 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1065/2035] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:17.521740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.522174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9dc2b09-e0ca-411c-a383-480f64919e39 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec5aaf0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.523967 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0974a64f-7206-45b4-883a-2f3ecfe434bc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1487 microversion: 2.25 time: 0.356835 Aug 27 20:56:17.525264 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 971/2036] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1487 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:17.599281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9dc2b09-e0ca-411c-a383-480f64919e39 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.080802 Aug 27 20:56:17.600085 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1066/2037] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:17.646678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.647410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:17.659023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.662200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.662726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.663557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.664096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.664530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.715865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.717083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:17.732594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.734867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.735559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.740091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.740752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.741361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.895602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:17.906210 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ecb79626-1211-44ff-a4ff-6c15598e9567 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.263828 Aug 27 20:56:17.907954 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 972/2038] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:17.954006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:17.954762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:17.963311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.967113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.968247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.970758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:17.973418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:17.974025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:17.985644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:17.989764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.003819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6224bb5c-eca0-424a-9f1c-ad1f733bbeb2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.292919 Aug 27 20:56:18.008515 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1067/2039] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:18.067375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.068452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:18.078333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.079122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.080032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.081186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.081863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.082696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.201314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.210064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36b7ef40-1ed1-4391-8199-194556abf672 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.260504 Aug 27 20:56:18.224876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 973/2040] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:17 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:18.297028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "name": "network-vif-plugged", "status": "completed", "tag": "3ff63124-4441-486f-a107-fcd63c25468e"}, {"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-plugged", "status": "completed", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:18.334819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.336016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.336968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.339006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.374216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f3be564-bb3e-4f6e-8f61-267770966adc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.309783 Aug 27 20:56:18.378024 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1068/2041] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:18.383442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Creating event network-vif-plugged:3ff63124-4441-486f-a107-fcd63c25468e for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:56:18.384190 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] Creating event network-vif-plugged:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:56:18.398988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-45a5a6d5-cdd1-4ffc-a0f9-d12be7018978 req-00569a56-1e16-41b9-86be-1796215a3b63 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104691 Aug 27 20:56:18.401984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 974/2042] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:56:18.540673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.541209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:18.547402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.547912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.548707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.549417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.549861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.550277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.552917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.553621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:18.560137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.560635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.561066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.561920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.562381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.562988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.834406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.841345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.853483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.854935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:18.855423 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bef3ab3-468a-4578-be40-96ce4bb5b48b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.318259 Aug 27 20:56:18.856154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-13231d8f-7f5f-483d-a0bc-13c19784fd7b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1477 microversion: 2.25 time: 0.307963 Aug 27 20:56:18.865050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 975/2043] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:18.868140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1069/2044] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:18.871632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ccce1422-0b94-448c-842e-00e05335ce2e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857bab040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.888066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96368b1f-bef4-4c10-9d0a-008f218dbab1 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '.version_select at 0x7ff84ed155e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.892709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96368b1f-bef4-4c10-9d0a-008f218dbab1 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.893624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96368b1f-bef4-4c10-9d0a-008f218dbab1 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.894276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96368b1f-bef4-4c10-9d0a-008f218dbab1 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.944789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96368b1f-bef4-4c10-9d0a-008f218dbab1 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 5137 microversion: 2.25 time: 0.061018 Aug 27 20:56:18.945949 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1070/2045] 10.222.0.40 () {60 vars in 1184 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/os-migrations => generated 5137 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:56:18.971854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:18.974433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:18.983705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.984785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.985466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.986375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:18.987089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:18.987727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:18.989739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ccce1422-0b94-448c-842e-00e05335ce2e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.122986 Aug 27 20:56:18.990706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 976/2046] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:19.004656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.005790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.014365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.015265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.015998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.017036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.017836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.018673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.246038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:19.256712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18c81302-960d-4727-b2a0-8cf03f6c3b42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.289151 Aug 27 20:56:19.257605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1071/2047] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:19.262632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.263486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.270434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.271246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.271972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.272889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.273548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.274175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.279805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] Lazy-loading 'services' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:19.301835 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-898ca904-d9b8-41fc-b7a4-210838ab9b64 tempest-LiveAutoBlockMigrationV225Test-1218965138 tempest-LiveAutoBlockMigrationV225Test-1218965138-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1970 microversion: 2.25 time: 0.301647 Aug 27 20:56:19.308951 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 977/2048] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:18 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1970 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:19.308951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.308951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.361873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.365613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.371878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.373912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.377090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.377690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.588081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:19.622930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f872c895-73af-4dfd-98f4-f6361228acfa tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.363786 Aug 27 20:56:19.624491 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1072/2049] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:19 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:19.632311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.633434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.641884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.642660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.643103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.643840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.644289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.645038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.645600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:19.656866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05a7f174-72b8-41fc-bd53-82c968b6697b tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.351495 Aug 27 20:56:19.666458 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 978/2050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:19 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:19.666458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.666458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.675220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.675220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.675568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.676293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.677034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.677659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.714069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:19.900495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 204 len: 0 microversion: 2.25 time: 0.274225 Aug 27 20:56:19.904734 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1073/2051] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:56:19 2022] DELETE /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:56:19.910686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.911556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.918902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.919461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.919917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.920649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.921831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.922112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.923186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:19.933963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b836e81e-48f1-4627-ad3f-947495833d99 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.274148 Aug 27 20:56:19.947366 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 979/2052] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:19 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:19.947366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:19.947366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:19.948854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.948854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.949133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:19.949878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:19.950633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:19.951258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.196218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.199656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.206703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.208414 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8371013e-ab8f-4b8f-8141-9f502321dbb9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.302303 Aug 27 20:56:20.208868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.209015 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1074/2053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:19 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:20.210269 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f899eef-c23a-4b28-a011-d8f8ae7e08ec tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1483 microversion: 2.25 time: 0.273842 Aug 27 20:56:20.210950 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 980/2054] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:19 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1483 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:20.215388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85f538a6-7e35-4c35-ad19-baf66792da40 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ec73f70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:20.269715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85f538a6-7e35-4c35-ad19-baf66792da40 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1412 microversion: 2.1 time: 0.059641 Aug 27 20:56:20.270579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1075/2055] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:20 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:20.281771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:20.283010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:20.290196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.290958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.291435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.292152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.292613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.293039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.518029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.526919 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0938786c-ec48-4d96-a3fe-d6285ab75872 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.249029 Aug 27 20:56:20.527913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 981/2056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:20 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:20.646528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:20.647106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:20.653810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.654831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.655756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.656562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.657107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.657609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.682739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:20.683493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:20.708134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.710953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.712577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.714341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.715535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.717075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.906391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.918362 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad669838-41a6-4d1d-ac5b-21732c368346 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.275950 Aug 27 20:56:20.919139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1076/2057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:20 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:20.940744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:20.950952 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7aedd02-50a6-44c1-ad21-bb8f3d581955 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.271842 Aug 27 20:56:20.951656 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 982/2058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:20 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:20.960388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:20.961490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:20.971579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.972444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.973323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:20.975073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:20.976140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:20.976949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.130727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.139323 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e66d77c-3604-4f6b-81be-b974870d6af2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.186663 Aug 27 20:56:21.139946 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1077/2059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:20 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:21.230162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.230889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:21.234965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.235804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:21.237859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.238426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.239192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.240213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.240734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.241241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.243982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.248089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.248727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.249659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.250288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.250891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.491273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.500445 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a29fbfb-4b96-4b7a-9381-55df0a903143 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.274646 Aug 27 20:56:21.506897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.514779 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 983/2060] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:21.517569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.519806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab7153ef-d22e-486f-bacf-6d26207dd12f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ea8bca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.520987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.522642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-302cd95f-99ed-4100-94bc-a3732441cc37 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1483 microversion: 2.25 time: 0.291728 Aug 27 20:56:21.540932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1078/2061] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1483 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:56:21.549537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.550437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:21.565125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.567481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.568218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.569187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.570397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.571044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.573995 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab7153ef-d22e-486f-bacf-6d26207dd12f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1421 microversion: 2.1 time: 0.058002 Aug 27 20:56:21.574594 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 984/2062] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:21.589646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-659d74ec-4268-431e-89be-ea940db62330 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ea87430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.593168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:21.638620 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-659d74ec-4268-431e-89be-ea940db62330 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 200 len: 1421 microversion: 2.1 time: 0.054011 Aug 27 20:56:21.639396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 985/2063] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 1421 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:21.652677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2724737f-5112-4112-b0c6-482197088074 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c63dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.744071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:21.753066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0e08aa0-9d84-482b-b0aa-50186d4a961f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.208619 Aug 27 20:56:21.753910 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1079/2064] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:21.842667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bbac41-db58-4ad1-8fe6-0c0d28bd6565", "name": "network-vif-deleted", "tag": "15d8e2f3-f9e5-462a-9557-9c924e65e52f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:21.852949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.853444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.853919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.866343 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] Creating event network-vif-deleted:15d8e2f3-f9e5-462a-9557-9c924e65e52f for instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 on nch2-master-1 Aug 27 20:56:21.871717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c4f9ce0c-6e47-4e14-9013-ca1a48a4c542 req-f8445dfc-7b00-4d6d-a211-dc3e4e9cfa70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Aug 27 20:56:21.873220 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1080/2065] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:56:21.940317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:21.941022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:21.951608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.952342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.952889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:21.954087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:21.954691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:21.955315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.121760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.130208 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95a0776f-80f8-4d28-aaf9-f6ca55352a69 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.194155 Aug 27 20:56:22.131380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1081/2066] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:21 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:22.136292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.137163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.149982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.152638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.153344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.154275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.155006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.155682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.169220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2724737f-5112-4112-b0c6-482197088074 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 204 len: 0 microversion: 2.1 time: 0.520370 Aug 27 20:56:22.170075 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 986/2067] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:21 2022] DELETE /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:56:22.176475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.179395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.189511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.190517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.191113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.192191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.193043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.193580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.462302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.476605 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21944ec1-69bf-4e4d-a206-fa2dc06690b2 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.343788 Aug 27 20:56:22.477923 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1082/2068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:22 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:22.483830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.484664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.485438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.500783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.501410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.501951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.504482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.504661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-083c66d5-91b6-49b8-96b0-329a57aff23e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.325752 Aug 27 20:56:22.506118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.506858 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 987/2069] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:22 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:22.507517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.512603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9a87d1-3b7c-4840-8f7c-00bfca879c78", "name": "network-vif-plugged", "status": "completed", "tag": "76a9e586-9fde-4386-a84e-3df85e5c106a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:22.523668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.536175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.536946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.553274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:22.571805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] Creating event network-vif-plugged:76a9e586-9fde-4386-a84e-3df85e5c106a for instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 on nch1-master-1 Aug 27 20:56:22.582143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-34752dbd-2f4c-48c2-8992-3eff7b2ceb35 req-4d1f10c3-7580-424f-8f40-fda223a374f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073815 Aug 27 20:56:22.586065 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 988/2070] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:22.594076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.597524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.604813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.605227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.605857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.606863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.607724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.608546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.767370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b8b230f-f2fd-496e-81bb-5d163ea86434 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 204 len: 0 microversion: 2.1 time: 0.287531 Aug 27 20:56:22.771782 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1083/2071] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:22 2022] DELETE /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:22.780582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.780582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.793119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.798028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.800727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.802564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.804152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.805251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.854321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.855518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.856276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.857209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:22.926413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.929672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.938049 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46b17c40-e9fc-434a-abb1-f5b23bab09cf tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.350696 Aug 27 20:56:22.938646 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 989/2072] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:22 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:22.938954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.940541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:22.942037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-896b623c-1253-45d8-9001-d5eb642888db tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1271 microversion: 2.25 time: 0.171960 Aug 27 20:56:22.943362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:22.944133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:22.950119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.950596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.951045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.951641 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1084/2073] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:22 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:22.951775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:22.952203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:22.952623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:22.959114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1661482895", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5b97881f-89ac-4440-8b19-f267ffb14088"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:22.969061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:23.028117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] validate_networks() for [('5b97881f-89ac-4440-8b19-f267ffb14088', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:56:23.174899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:23.183590 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1532b13-f640-4436-a3b2-278762a8070a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.243853 Aug 27 20:56:23.184169 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 990/2074] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:22 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:23.188781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.189398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.195590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.196357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.197073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.198006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.198466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.198895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.431108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:23.439377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82d537cf-4095-4893-a8f2-9110b0c5d791 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.254179 Aug 27 20:56:23.440030 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 991/2075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:23.498681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.499321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.506008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.506633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.506914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.507654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.508102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.508514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.544383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:56:23.544815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:56:23.545292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:56:23.545736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:56:23.546156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:56:23.555771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.556257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.556704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.557440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.557897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.558328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.576064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:56:23.580809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for user ede90e55159a4d3192505c74a2a69a51 and project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:56:23.593665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:56:23.596115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:56:23.645706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d91e714-fabd-4d7b-8044-fb3e4b88d6b4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692440 Aug 27 20:56:23.646456 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1085/2076] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:56:23.648018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:23.652233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.652749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.657360 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4098697-5a6b-40d2-9010-b266d739908a tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.163007 Aug 27 20:56:23.658034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 992/2077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.666092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.674474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9eb77819-69cf-4eff-b5ac-7216a056e6fa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.675330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9eb77819-69cf-4eff-b5ac-7216a056e6fa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.768892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9eb77819-69cf-4eff-b5ac-7216a056e6fa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:23.777982 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9eb77819-69cf-4eff-b5ac-7216a056e6fa tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1208 microversion: 2.1 time: 0.109631 Aug 27 20:56:23.794461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 993/2078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1208 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:23.854005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:23.864485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c000d44-5d62-41c9-ad36-6b42446d40be tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1313 microversion: 2.1 time: 0.216972 Aug 27 20:56:23.867850 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1086/2079] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:23.958545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.959306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.967726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:23.968431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.968829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:23.968964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.969445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.970131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.970751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.971377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.978904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.979455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:23.979985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:23.980901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:23.981445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.007554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.067588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.068262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.069277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.070011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:24.174350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.189826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.191378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.192819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ebf5f4e7-addf-4195-a912-4a42973371dc tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1271 microversion: 2.25 time: 0.231443 Aug 27 20:56:24.193400 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1087/2080] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:56:24.236444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:24.237602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:24.245505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.246849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.247703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.248692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.249611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.250236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.314446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.333627 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21e499f1-3e8f-4c5a-9c3b-30adc311025f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.379215 Aug 27 20:56:24.343888 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 994/2081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:23 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:24.461636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:24.462402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:24.469783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.470399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.471071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.472044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.472564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.473695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.484469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.496462 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e8dd175-e99b-4ab2-9255-596c56e79452 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1334 microversion: 2.1 time: 0.271780 Aug 27 20:56:24.498254 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1088/2082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:24 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1334 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:24.620813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea294e9b-8451-4526-b15b-afb1c9cee9dd", "name": "network-vif-unplugged", "status": "completed", "tag": "866419e8-7e88-4363-9e3d-364029997067"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:24.649453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.650947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.652744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.668780 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] Creating event network-vif-unplugged:866419e8-7e88-4363-9e3d-364029997067 for instance ea294e9b-8451-4526-b15b-afb1c9cee9dd on nch2-master-1 Aug 27 20:56:24.681237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e8d3fc82-fe73-4df4-b3d5-7d85c656f2aa req-aa9358cd-8b81-476c-b12f-c27a99fe96f6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063869 Aug 27 20:56:24.682557 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1089/2083] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:24.712801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:24.713563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:24.722673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.723152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.723738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.724353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.724882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.725483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.744194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.752237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:24.758777 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-71e5a7c6-9ad4-4cde-b697-0a2e722e523b tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.301799 Aug 27 20:56:24.760939 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 995/2084] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:24 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:24.805231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:24.806871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:24.816265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.817125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.817821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.818819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.820538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.821247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.947541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:24.959600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d737d1dc-1578-4b5b-a18e-4dd7a65de1d9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1204 microversion: 2.1 time: 0.164476 Aug 27 20:56:24.960846 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 996/2085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:24 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1204 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:24.968684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:24.969940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:24.981006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.981744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.982399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:24.984267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:24.985635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:24.986570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.022695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.034935 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ea18d092-15c1-48da-85da-178b33c8a1c3 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1508 microversion: 2.1 time: 0.350627 Aug 27 20:56:25.039804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1090/2086] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:24 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:25.185008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.194697 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06a40630-7fb1-4be2-a806-8c72ef503f93 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1462 microversion: 2.1 time: 0.232581 Aug 27 20:56:25.195653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 997/2087] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:24 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1462 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:25.216691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:25.217321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.229123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:25.229847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.230301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.230428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.230850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.231723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.232645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.233086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.239731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.240592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.241285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.242554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.243247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.244171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.282185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.283331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.284098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.284768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:25.351989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.361060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.362566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.363887 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ec00f85-9ff2-4216-b42b-aa042c2e42ad tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 200 len: 1271 microversion: 2.25 time: 0.138643 Aug 27 20:56:25.364725 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 998/2088] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:25 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:25.369548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:25.370073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.376643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.377329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.377967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.379323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.379822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.380353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.425093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-272e43c0-ff1e-4a0f-a3fd-521e7cc76789 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1613 microversion: 2.1 time: 0.212501 Aug 27 20:56:25.426334 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1091/2089] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:25 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1613 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:25.454050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:25.455881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.469614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.470212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.470882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.471705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.472275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.473414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.533068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2347ae915fad4b4faaf73d02bac8d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3656ebdac94b4796c8750cb68dc686', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.533625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] flavor_id is None. Assuming migration. {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 20:56:25.534398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 20:56:25.776132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:25.789768 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dda0f70b-4b43-4ee9-93eb-72cd84c34297 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.423475 Aug 27 20:56:25.790546 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 999/2090] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:25 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:25.796279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:25.797200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.805002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.805933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.806624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.807779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.808566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.810715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.878547 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a432b2b-9445-4a78-ba5c-4bcf5874f15b tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa/action" status: 202 len: 0 microversion: 2.1 time: 0.432958 Aug 27 20:56:25.880930 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1092/2091] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:56:25 2022] POST /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:56:25.899045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:25.901831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:25.908972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.909573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.910021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:25.917331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:25.918843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:25.919521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.136908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:26.150624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-545c5087-5409-497d-95b4-f435d3b9be9c tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1670 microversion: 2.1 time: 0.358537 Aug 27 20:56:26.165105 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1000/2092] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:25 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:26.180766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.181494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.188076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.188647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.189091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.189808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.190280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.190722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.211980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:26.221112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-833b08a5-ea21-4090-bbeb-0e9c75198ada tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.336063 Aug 27 20:56:26.227392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1093/2093] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:25 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:26.228417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.229025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.235232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.235842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.236165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.236910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.237371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.237787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.250745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:26.365553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:26.395216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3725fb02-3139-4353-a768-4e2ee3b16d9c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1260 microversion: 2.1 time: 0.168351 Aug 27 20:56:26.396844 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1094/2094] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:26.413004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.414364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.423833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.424122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.424527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.425364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.425834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.426556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.467641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.468136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.468571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.469030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lazy-loading 'fault' on Instance uuid 01b32240-8638-4266-b298-ec34596b6544 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:26.588308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:26.604144 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c38f8237-b6c1-44a0-949e-9eb6277d8a64 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1471 microversion: 2.1 time: 0.435608 Aug 27 20:56:26.606657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1001/2095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:26.608964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:26.624439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.625196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.627314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b925dc68-02f8-46bb-9432-4ced4effe5c6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1305 microversion: 2.1 time: 0.225323 Aug 27 20:56:26.628165 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1095/2096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1305 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:26.638496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.639266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.640738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.641463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: d6bbac41-db58-4ad1-8fe6-0c0d28bd6565] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.643181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.644271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.644986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.645629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.670027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.671671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.673077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.675713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.676593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.677163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.678534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9803827-de93-40ec-b9d9-6582262d1da9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6/ips" status: 200 len: 180 microversion: 2.1 time: 0.069416 Aug 27 20:56:26.679557 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1002/2097] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6/ips => generated 180 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:26.691055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.692274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.702632 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] HTTP exception thrown: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Request method failure captured: Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 HTTP/1.1 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNsBQmcK3NRGa-rUchJRZsWk9V0FMyu9rwWzsXz-an7wpfAnZ38p1Rps1m6OdB0q8xtZQWdBhY3Rp68yZ_Ft5fNkJCtDUrmk1eCdd7MD8mCl2pICI4d6IMwEHcpSljY7UNTSHAl4DlI4rCIPm-eeVE7jxtq1W5-lDYFLsn5vjrq_co Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5718b7012004d30983db126ff75e348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5718b7012004d30983db126ff75e348", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}] Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c75d7c2bf734450886113fe48be6c44e Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd6bbac41-db58-4ad1-8fe6-0c0d28bd6565'} Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. Aug 27 20:56:26.706395 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Returning 404 to user: Instance d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:26.713295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62f61c4a-66c7-465d-9f08-a29dce87ef7f tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565" status: 404 len: 111 microversion: 2.25 time: 0.077548 Aug 27 20:56:26.715785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.715785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.715785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.715785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.715785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.723529 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1096/2098] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/d6bbac41-db58-4ad1-8fe6-0c0d28bd6565 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:56:26.727484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.732986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01b32240-8638-4266-b298-ec34596b6544", "name": "network-vif-deleted", "tag": "15a3285e-1b8f-4eca-b6d1-b656787f96c4"}, {"name": "network-changed", "server_uuid": "ea294e9b-8451-4526-b15b-afb1c9cee9dd", "tag": "866419e8-7e88-4363-9e3d-364029997067"}, {"server_uuid": "22ce3926-f2c1-4496-b23e-75b4cecb0c72", "name": "network-vif-deleted", "tag": "d55137d0-09b1-440b-b481-cdb396b038bf"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:26.750656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.762252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.763081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.779218 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Creating event network-vif-deleted:15a3285e-1b8f-4eca-b6d1-b656787f96c4 for instance 01b32240-8638-4266-b298-ec34596b6544 on nch1-master-1 Aug 27 20:56:26.779798 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Creating event network-changed:866419e8-7e88-4363-9e3d-364029997067 for instance ea294e9b-8451-4526-b15b-afb1c9cee9dd on nch2-master-1 Aug 27 20:56:26.780296 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] Creating event network-vif-deleted:d55137d0-09b1-440b-b481-cdb396b038bf for instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 on nch2-master-1 Aug 27 20:56:26.786092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:26.792549 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c79df1ca-f7d3-485e-b1ff-c45e766e97c0 req-fc79124c-b3c4-4550-b10c-70c66daa08d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.066870 Aug 27 20:56:26.793621 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1097/2099] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:26.812361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.813090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.822102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.823042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.824250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.825159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.825818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.826696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.909448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07d8d89d-5b3c-4d30-90d1-a280065ca8b9 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 204 len: 0 microversion: 2.1 time: 0.222069 Aug 27 20:56:26.910892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1003/2100] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:26 2022] DELETE /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:56:26.921195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:26.922425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:26.945912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.946469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.946917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:26.949570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:26.950122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:26.953149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.149085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.158501 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6049524-7673-473f-b932-7748696348a3 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1318 microversion: 2.1 time: 0.350692 Aug 27 20:56:27.163139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1098/2101] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:27.252335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:27.253177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:27.267580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.272410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.274348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.276469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.279585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.280705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d5090e66-670c-4c6a-b7be-a924e15a79b0 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1676 microversion: 2.1 time: 0.363706 Aug 27 20:56:27.282140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.282857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.296562 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1004/2102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:26 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1676 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:27.421316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:27.421961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:27.430089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.430601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.431082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.431859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.432349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.432795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.526932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.536419 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d5b2980-47d8-4666-9509-6321e7d73c7d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1266 microversion: 2.1 time: 0.123008 Aug 27 20:56:27.537628 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1005/2103] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:27 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:27.558847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.567773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-def1a415-fe6d-4b21-8efe-4a1ee3ba3adf tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.321953 Aug 27 20:56:27.568529 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1099/2104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:27 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:27.631378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:27.632375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:27.639243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.639765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.640411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.641121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.641674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.642184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.653437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:27.654164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:27.665728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.666217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.666644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.671516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.674505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.675234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.721790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.722458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.723090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.724032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lazy-loading 'fault' on Instance uuid 01b32240-8638-4266-b298-ec34596b6544 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:27.791424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.804551 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f831284a-6ec5-4e9d-968a-24ad8472c1df tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1305 microversion: 2.1 time: 0.156389 Aug 27 20:56:27.806753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1100/2105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:27 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:27.855721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:27.865133 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2358e294-cacd-48d1-8fc6-434c11a9093c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1471 microversion: 2.1 time: 0.237690 Aug 27 20:56:27.876435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1006/2106] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:27 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:27.919200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:27.919752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:27.929050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.929705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.930150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.930963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:27.931466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:27.932090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:27.961172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:28.057281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f0dde07-5d21-4423-92c9-fce9f289b96b tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 204 len: 0 microversion: 2.25 time: 0.141655 Aug 27 20:56:28.057952 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1101/2107] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:56:27 2022] DELETE /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:56:28.066197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:28.066950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.073270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.073799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.074226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.074938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.075429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.075874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.184083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:28.184832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.192191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.192945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.193757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.194547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.195007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.195507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.218396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:28.228855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:28.230697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:28.232941 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7bb60f3c-691e-44f5-9ba2-6d48ae8477e7 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1730 microversion: 2.25 time: 0.170033 Aug 27 20:56:28.234202 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1007/2108] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:28 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:28.304877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:28.305506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.320046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.320783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.321440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.322477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.323302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.323960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.358755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:28.367812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0039a598-2b14-4658-9941-720d46392830 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1468 microversion: 2.1 time: 0.188376 Aug 27 20:56:28.368660 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1102/2109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:28 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:28.393196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:28.393744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.401496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.401987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.402531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.403249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.403826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.404289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.435634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lazy-loading 'flavor' on Instance uuid 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:28.519222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:28.530889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b69374d-f2f4-4bf2-b565-1a6d805758f7 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1676 microversion: 2.1 time: 0.231092 Aug 27 20:56:28.532188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1008/2110] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:28 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:28.562528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:28.564038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2be605b1-b64c-4a7d-b2cd-6f0fa97cce88 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78/action" status: 202 len: 0 microversion: 2.1 time: 0.174458 Aug 27 20:56:28.565559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.567912 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1103/2111] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:56:28 2022] POST /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 20:56:28.574011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.574807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.575444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.575574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:28.576301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:28.576841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.577296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.577725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.587062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.588105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.588603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:28.589602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:28.590172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:28.591317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.118755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.129329 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6b9a263-7dbe-463a-8558-5fa4737e371e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.573035 Aug 27 20:56:29.134666 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1009/2112] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:28 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:29.140279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:29.141281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:29.149804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.150408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.150981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.151925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.152490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.153019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.160175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.172633 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ab604c3-12a2-4ef5-adb8-2889865493f1 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1476 microversion: 2.1 time: 0.602658 Aug 27 20:56:29.173256 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1104/2113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:28 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1476 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:29.186827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:29.187813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:29.197399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.197899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.198339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.199051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.199544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.199974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.239527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.240029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.240471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.241141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lazy-loading 'fault' on Instance uuid 01b32240-8638-4266-b298-ec34596b6544 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:29.297149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.322630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ed9b5c9-b3f4-441c-950b-1f9fd5c1adf4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1305 microversion: 2.1 time: 0.143955 Aug 27 20:56:29.335383 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1105/2114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:29 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1305 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:29.335383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:29.335383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:29.337886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.338787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.338941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.339685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.340102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.340520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.346644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.349238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:29.357779 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ec33b55-96f6-4598-af6e-24de2d236c4f tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.221266 Aug 27 20:56:29.372197 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1010/2115] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:29 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:29.378319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:29.379390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:29.388666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.389172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.389615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.390333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.390790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.391218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.529349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.540083 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41e1cb1b-5a69-48f5-91bb-390a47b443cc tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1471 microversion: 2.1 time: 0.215520 Aug 27 20:56:29.543723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1106/2116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:29 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:29.564241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:29.564919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:29.574576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.575873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.576697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.577706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.578402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:29.578846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:29.579423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:29.588344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.594085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.595603 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c3e2728-8fa2-452d-ab63-10797cfc3742 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1730 microversion: 2.25 time: 0.222151 Aug 27 20:56:29.598681 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1011/2117] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:29 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:29.740551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:29.744640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:29.749872 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c0c8393-e048-484c-8845-3880b7bbb56a tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1676 microversion: 2.1 time: 0.198159 Aug 27 20:56:29.750676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1107/2118] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:29 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:30.085284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0df002a9-8f41-4e21-be95-8c45b19650d4", "tag": "47546445-4ed3-45b8-9cd5-87701a0d33c3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:30.092689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:30.098244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.098825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.099377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.117634 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] Creating event network-changed:47546445-4ed3-45b8-9cd5-87701a0d33c3 for instance 0df002a9-8f41-4e21-be95-8c45b19650d4 on nch2-master-1 Aug 27 20:56:30.125993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e226b2e3-bebb-4190-b9a8-7b240fc23f9c req-fb6ceeb3-6e1e-45ef-ad78-a2cd115c3068 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045043 Aug 27 20:56:30.126941 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1012/2119] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:30.154663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.155264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.162507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.163401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.163819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.164520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.165134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.165715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.194977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.195982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.202590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.203089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.203549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.204258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.204711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.205138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.364475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.373486 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-463db6a1-d7d8-49c3-98e6-01938d294780 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.222563 Aug 27 20:56:30.374074 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1108/2120] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:30.379079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.379954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.386573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.387081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.387580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.388320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.388763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.389475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.407934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.417364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b73292ed-7a9a-4b31-b10f-a36e8d2800b9 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1476 microversion: 2.1 time: 0.226954 Aug 27 20:56:30.423512 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1013/2121] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:30.423689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.423972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.424634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.425263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lazy-loading 'fault' on Instance uuid 01b32240-8638-4266-b298-ec34596b6544 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:30.439122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.439394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.450077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.450077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.450077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.450077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.450640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.451040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.475665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40fd3bf837314e5899b824a20e29ad1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abfbd78b6106432aafeac0de1bca48b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.485521 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a79f7833-fb7e-49a5-8b67-7cb6e8bfacec tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 200 len: 1305 microversion: 2.1 time: 0.109724 Aug 27 20:56:30.492831 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1109/2122] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:30.568236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.568952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.576687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.577337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.577955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.579087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.579695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.580462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.612273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.623222 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9046aba-a30b-4815-af06-e9fd98583d7e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.202753 Aug 27 20:56:30.623973 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1014/2123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:30.630776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.631424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.646739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.647738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.648640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.650463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.651206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.651840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.814839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.825479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1410b9ef-9edb-484b-bdac-228bff08e905 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1471 microversion: 2.1 time: 0.260918 Aug 27 20:56:30.826618 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1110/2124] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:30.835887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:30.837190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:30.845918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.846864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.850029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.851160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:30.852238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:30.852848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:30.924489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.937920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.940055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:30.941333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa5428b5-d9c8-4826-b986-0aea51c761c4 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1730 microversion: 2.25 time: 0.316194 Aug 27 20:56:30.942120 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1015/2125] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:31.051879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:31.061082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4296cc2b-3ea2-437d-82c3-20676c568b94 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1676 microversion: 2.1 time: 0.232749 Aug 27 20:56:31.062078 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1111/2126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:30 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:31.394662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:31.395921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:31.402811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.403307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.403813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.404629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.405090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.405519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.449031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:31.449662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:31.467066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.468049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.468699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.469666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.471571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.483197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.779222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:31.788810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be64b094-ae5a-4506-ba39-cf3abf326612 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.398301 Aug 27 20:56:31.806085 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1016/2127] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:31 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:31.816769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:31.819976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:31.830612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.831377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.832594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.833501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.834618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.835231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.857740 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 HTTP/1.1 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '01b32240-8638-4266-b298-ec34596b6544'} Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:31.860167 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:31.865668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:31.868524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:31.870512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d09b538-fdfc-4490-9197-784fc7d4d7d9 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 404 len: 111 microversion: 2.1 time: 0.060488 Aug 27 20:56:31.871662 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1017/2128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:31 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:31.878631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:31.880509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:31.892469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.893262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.894453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.895938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.897370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.897999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.912082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:31.924606 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50dea063-3056-47ac-896f-44d548944c25 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1459 microversion: 2.1 time: 0.490095 Aug 27 20:56:31.926568 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1112/2129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:31 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1459 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:31.941688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:31.942199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:31.962799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.965598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.966412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:31.972204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:31.972915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:31.973438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.342830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:32.349860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:32.353385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40a0722c-bb48-4301-8b1e-f48b23713d8e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.480361 Aug 27 20:56:32.355134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1018/2130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:31 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:32.372035 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ec1a987-b021-4766-a7c2-047b9aad9630 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1471 microversion: 2.1 time: 0.432956 Aug 27 20:56:32.372035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1113/2131] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:31 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:32.372035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-972811961", "metadata": {"image_type": "test"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:32.384594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:32.404301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.404818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.405345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.406039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.406497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.406727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:32.407210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.407362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:32.416367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.416871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.417453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.418072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.418572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.429700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.441031 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544/action HTTP/1.1 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 111 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-972811961", "metadata": {"image_type": "test"}}} Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '01b32240-8638-4266-b298-ec34596b6544', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-972811961', 'metadata': {'image_type': 'test'}}}} Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 20:56:32.445776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d215997-c7d8-48ee-aa9c-d86ba6b1b7b6 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "POST /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544/action" status: 404 len: 111 microversion: 2.1 time: 0.082136 Aug 27 20:56:32.450836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1114/2132] 10.222.0.40 () {60 vars in 1279 bytes} [Sat Aug 27 20:56:32 2022] POST /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:32.463289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:32.464840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:32.474636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.475488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.475924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.477073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.478535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.479187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.659857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:32.672573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:32.675333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:32.678873 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75a95b2c-c346-484d-bede-c05f705c99d6 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1662 microversion: 2.25 time: 0.228603 Aug 27 20:56:32.680555 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1115/2133] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:32 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1662 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:32.686117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:32.687016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:32.697294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.697940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.698472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:32.699389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:32.700124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:32.700776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.029056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:33.037170 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfa89932-ce0c-4cf5-9409-342c45f4a4c3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1655 microversion: 2.1 time: 0.355201 Aug 27 20:56:33.037740 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1116/2134] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:32 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1655 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:33.051680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf3df6e-498a-45d2-a2a2-cf0c33558f1d", "name": "network-vif-deleted", "tag": "fefad939-37bf-408d-aee1-d46f4c2d30a6"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.062588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.063066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.063540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.074974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] Creating event network-vif-deleted:fefad939-37bf-408d-aee1-d46f4c2d30a6 for instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d on nch2-master-1 Aug 27 20:56:33.079925 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-74896a80-a289-4410-9613-5a66840ae6dc req-f28d8cd3-1486-4734-b65f-71046df28ea7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041046 Aug 27 20:56:33.080515 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1117/2135] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:33.086539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-201950453", "metadata": {"image_type": "test"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.089625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Failed to fetch instance by id tempest-invalid-830896280 {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 20:56:33.090171 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance tempest-invalid-830896280 could not be found. Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/tempest-invalid-830896280/action HTTP/1.1 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 111 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-201950453", "metadata": {"image_type": "test"}}} Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance tempest-invalid-830896280 could not be found. Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'tempest-invalid-830896280', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-201950453', 'metadata': {'image_type': 'test'}}}} Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-830896280 could not be found. Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:33.092154 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-830896280 could not be found. Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-830896280 could not be found. Aug 27 20:56:33.097279 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.099415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance tempest-invalid-830896280 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.100269 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0b09cf0-1901-4e7d-af3d-23b8c7259860 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "POST /compute/v2.1/servers/tempest-invalid-830896280/action" status: 404 len: 100 microversion: 2.1 time: 0.018474 Aug 27 20:56:33.101011 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1118/2136] 10.222.0.40 () {60 vars in 1246 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/servers/tempest-invalid-830896280/action => generated 100 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:33.103112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f56fba55-a44c-422c-b74a-149f8619c354 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1610 microversion: 2.1 time: 0.701230 Aug 27 20:56:33.104406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1019/2137] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:32 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1610 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:33.106453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "name": "network-vif-deleted", "tag": "3ff63124-4441-486f-a107-fcd63c25468e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.109672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.110291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.117230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.117596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.118245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.126851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.128092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.129048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.129388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] Creating event network-vif-deleted:3ff63124-4441-486f-a107-fcd63c25468e for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:56:33.130154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.130625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.131123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.134385 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-5806ba40-64bb-47b8-bc1d-6835546b6fc5 req-01209b41-9480-4357-9dcf-ba5e08c9b8e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 Aug 27 20:56:33.135090 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1119/2138] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:33.140152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-830904152"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.142339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 20:56:33.142859 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 56 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "tempest-test-snap-830904152"}} Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-830904152'}}} Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.144530 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-975856f3-ca33-4a58-a0fc-e90586bc5913 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009881 Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1120/2139] 10.222.0.40 () {60 vars in 1275 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:33.152149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.155625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.155625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.155625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.156133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.156569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.156991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.169363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:33.190829 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a4e33635-57d5-4fcf-9591-69d70c6a216f tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042764 Aug 27 20:56:33.191896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1121/2140] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:33.197452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1040069613"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.200204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 20:56:33.200786 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 57 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: {"createImage": {"name": "tempest-test-snap-1040069613"}} Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1040069613'}}} Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.202386 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.207521 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e1b970a-5ad3-49a2-adb3-7193cdce8c21 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012494 Aug 27 20:56:33.208321 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1122/2141] 10.222.0.40 () {60 vars in 1281 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:33.214547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:33.218008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.228291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.228864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.229575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.230557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.231138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.231658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.266096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Lazy-loading 'flavor' on Instance uuid 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:33.283453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 while it is in vm_state suspended Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Request method failure captured: Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78/action HTTP/1.1 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 97 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS5186G_-QinuemHlWU7K_ywNByzhncnl_hBi7StnEhtrDAzxveUOIfcKPCn-DEYWUzPGZF1AxXRN89sssvzHPXn8voKZako9JRJCplfiJO46Xv290O5mNqYbIOFJaXE9_GTAOdVdJPvW_ze_z4SGBaSA3MeV_YHDzoNsiwboiUjEk Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ad3ec1b4ed3845668403d37b7a67f09f Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad3ec1b4ed3845668403d37b7a67f09f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ad3ec1b4ed3845668403d37b7a67f09f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ad3ec1b4ed3845668403d37b7a67f09f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ad3ec1b4ed3845668403d37b7a67f09f"}]}] Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ad3ec1b4ed3845668403d37b7a67f09f Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2143604114 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveMigrationNegativeTest-2143604114-project-admin Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5626d07632a04e4e94bdcb2bbee9f555 Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveMigrationNegativeTest-2143604114-project-admin Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'os-migrateLive' instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 while it is in vm_state suspended Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '3c9a87d1-3b7c-4840-8f7c-00bfca879c78', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.286186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 while it is in vm_state suspended Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 while it is in vm_state suspended Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 while it is in vm_state suspended {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-67dcddd1-9be7-4eb1-94be-618f0d1d0090 tempest-LiveMigrationNegativeTest-2143604114 tempest-LiveMigrationNegativeTest-2143604114-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78/action" status: 409 len: 155 microversion: 2.1 time: 0.077832 Aug 27 20:56:33.291659 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1123/2142] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:56:33 2022] POST /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78/action => generated 155 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:56:33.293946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.293946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.304398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.305188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.305835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.306817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.307451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.308033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.324309 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 HTTP/1.1 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '01b32240-8638-4266-b298-ec34596b6544'} Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:33.326374 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98f40548-6fa0-4eb6-a815-f1d52fa4dad4 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "DELETE /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 404 len: 111 microversion: 2.1 time: 0.038663 Aug 27 20:56:33.331188 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1124/2143] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:33 2022] DELETE /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:33.336902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.337404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.344488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.344935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.345562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.346443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.347181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.348002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.376554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:33.388002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:33.396488 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2eb2548e-9551-4b2f-ba6f-1f36d6503e20 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.290943 Aug 27 20:56:33.407807 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1020/2144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:33.415097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.415712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] [instance: 01b32240-8638-4266-b298-ec34596b6544] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.422805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.423376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.424163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.424929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.425659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.426257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.454843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] HTTP exception thrown: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Request method failure captured: Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 HTTP/1.1 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoTTE00OZaiLfyUvIqkyjQDmPmT8YhkgnJJ-haZG3QKZlQC5gmOIADDPcRB5W8-F7Wgd8mS_LF_puYAPdQPSSJSRLUvWcnObhQ2tcf5hQB_iBbByGXGlmYBYxkGOgtEIAVeI3kbYPUMFMOZchcZYkKmBD60lBDFsC9nZFnyJNSlCwE0 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/abfbd78b6106432aafeac0de1bca48b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_abfbd78b6106432aafeac0de1bca48b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/abfbd78b6106432aafeac0de1bca48b1"}]}] Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: abfbd78b6106432aafeac0de1bca48b1 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1126745865 Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 40fd3bf837314e5899b824a20e29ad1e Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesNegativeTestJSON-1126745865-project Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '01b32240-8638-4266-b298-ec34596b6544'} Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:33.456980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] Returning 404 to user: Instance 01b32240-8638-4266-b298-ec34596b6544 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8151d9f9-0873-4f8b-a0b3-b67885bda3d0 tempest-ImagesNegativeTestJSON-1126745865 tempest-ImagesNegativeTestJSON-1126745865-project] 10.222.0.40 "GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544" status: 404 len: 111 microversion: 2.1 time: 0.049790 Aug 27 20:56:33.464277 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1021/2145] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/01b32240-8638-4266-b298-ec34596b6544 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:33.485491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.487031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.496809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.497610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.498310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.499270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.500484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.501314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.523944 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d648cdf0-9fee-4c09-b8b1-46ec43755fbe tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 204 len: 0 microversion: 2.1 time: 0.190107 Aug 27 20:56:33.527076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1125/2146] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:33 2022] DELETE /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:33.537501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.539160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.547409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.548250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.548923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.550015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.562915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.564192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.609311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:33.775154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:33.822176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:33.823250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:33.837405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc3033e3-bf69-42e5-abc1-1e72732a6215 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.305824 Aug 27 20:56:33.840092 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c158a75-2c5c-428a-a48f-55c392f45acd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.378402 Aug 27 20:56:33.853563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1022/2147] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:33.854020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1126/2148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:33.859655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.860609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.860740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:33.862147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:33.868706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.869314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.869865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.870729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.871730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.872671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.880737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.881457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.881898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.882971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.883868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.884478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.917155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:33.917645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:33.918109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:33.919151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid ecf3df6e-498a-45d2-a2a2-cf0c33558f1d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:34.021858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.037615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.040836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.043121 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a063dffd-770b-47c4-a140-6dfd75aebbe5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 200 len: 1372 microversion: 2.25 time: 0.187627 Aug 27 20:56:34.044821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1127/2149] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:34.066708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:34.068578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:34.079193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.080096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.081197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.081874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.082653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.083413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.096775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.112525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc4390b2-039d-43be-b2b6-f8393d711f41 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1465 microversion: 2.1 time: 0.261729 Aug 27 20:56:34.113103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1023/2150] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:33 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1465 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:34.124015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:34.179283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.187983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f0965a5-cadc-441b-b363-8c6c26f5c5ec tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1455 microversion: 2.1 time: 0.127966 Aug 27 20:56:34.188842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1128/2151] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:34 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:34.421830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:34.422461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:34.431093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.431738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.432506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.433773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.434673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.435109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.620676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:34.631203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9e20581-d373-425f-86e8-8392e387d15e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.213298 Aug 27 20:56:34.632095 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1024/2152] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:34 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:34.868954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:34.871097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:34.871558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:34.873891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:34.885805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.887508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.889385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.890224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.891192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.892060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.892742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.894252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.895256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:34.895475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:34.896770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:34.898580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.153545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:35.168067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:35.171197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52f0cb49-f2c7-4e70-9308-148530dc8fe0 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.306953 Aug 27 20:56:35.172078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1025/2153] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:34 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:35.190057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:35.191298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: ecf3df6e-498a-45d2-a2a2-cf0c33558f1d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:35.202606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.204729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.205562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.206638 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3cfaa4fe-444d-4108-935f-6a83d090c619 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.347620 Aug 27 20:56:35.206822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.207380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1129/2154] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:34 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:35.207652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.207944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.217734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:35.218443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:35.232813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.233348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.233867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.234776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.235450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.236034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.237053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] HTTP exception thrown: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Request method failure captured: Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d HTTP/1.1 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNsBQmcK3NRGa-rUchJRZsWk9V0FMyu9rwWzsXz-an7wpfAnZ38p1Rps1m6OdB0q8xtZQWdBhY3Rp68yZ_Ft5fNkJCtDUrmk1eCdd7MD8mCl2pICI4d6IMwEHcpSljY7UNTSHAl4DlI4rCIPm-eeVE7jxtq1W5-lDYFLsn5vjrq_co Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5718b7012004d30983db126ff75e348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5718b7012004d30983db126ff75e348", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}] Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c75d7c2bf734450886113fe48be6c44e Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ecf3df6e-498a-45d2-a2a2-cf0c33558f1d'} Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. Aug 27 20:56:35.240022 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. Aug 27 20:56:35.249358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:35.254764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Returning 404 to user: Instance ecf3df6e-498a-45d2-a2a2-cf0c33558f1d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:35.257471 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d6db78e-e771-410d-afee-604a4a4b1c81 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d" status: 404 len: 111 microversion: 2.25 time: 0.083020 Aug 27 20:56:35.259395 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1026/2155] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:35 2022] GET /compute/v2.1/servers/ecf3df6e-498a-45d2-a2a2-cf0c33558f1d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:56:35.270925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4b48c8-86ab-48d6-8842-14eb49327cb6", "name": "network-vif-deleted", "tag": "194f5c4d-2c46-410d-8f4b-baa3bd0181d0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:35.288364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.289259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.289977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.316602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] Creating event network-vif-deleted:194f5c4d-2c46-410d-8f4b-baa3bd0181d0 for instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 on nch1-master-1 Aug 27 20:56:35.329989 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a519963a-bcd1-4f84-9400-0ed6ddbec75c req-937da77a-685c-4e75-9f82-e42a5087ba61 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068775 Aug 27 20:56:35.331719 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1027/2156] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:35.340274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:35.341519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:35.350190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.350746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.351181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.352140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.352667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.353267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.415470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.415968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.416691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.417371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lazy-loading 'fault' on Instance uuid 5e4b48c8-86ab-48d6-8842-14eb49327cb6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:35.523135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5840825b0d3341c1ad511f2646c975a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4f6d64a7bc40adb889fa76c3e13bf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:35.535441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-173b8c35-2cab-4ccd-bd1a-76e84c7a1817 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 200 len: 1303 microversion: 2.1 time: 0.201952 Aug 27 20:56:35.538774 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1028/2157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:35 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 1303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:35.553248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-101f7142-2b1c-408a-986c-6aa2d16b1b76 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '.version_select at 0x7ff84ea8d0d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:35.596661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-101f7142-2b1c-408a-986c-6aa2d16b1b76 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2772792" status: 204 len: 0 microversion: 2.25 time: 0.054520 Aug 27 20:56:35.596932 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1029/2158] 10.222.0.40 () {60 vars in 1253 bytes} [Sat Aug 27 20:56:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2772792 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:56:35.625897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:35.636623 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f1517ed-dbc1-41bc-b8d0-1dedc6019842 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1465 microversion: 2.1 time: 0.427627 Aug 27 20:56:35.637737 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1130/2159] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:35 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1465 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:35.655251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:35.656232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:35.664710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.665761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.666393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.667701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:35.668331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:35.669001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:35.877305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:35.886096 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-abdc790d-3a45-4e12-9088-6827551a5633 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.236098 Aug 27 20:56:35.904661 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1030/2160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:35 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:36.196753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:36.197481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:36.212396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.212900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.217121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.219879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.221045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.222306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.244291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:36.245295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:36.259573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.264252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.265205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.268530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.269493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.270241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.324855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:36.641899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:36.659313 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56b17153-03b9-4bab-aa57-4ea229b3eff8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.429994 Aug 27 20:56:36.660168 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1031/2161] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:36 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:36.664344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:36.677428 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f215fa39-02ef-4965-abdd-c988f8400f61 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.485578 Aug 27 20:56:36.679112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:36.679788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1131/2162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:36 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:36.680047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:36.689291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.689986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.690514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.691244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.691496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:36.694263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.694263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.694520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:36.711064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 HTTP/1.1 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5e4b48c8-86ab-48d6-8842-14eb49327cb6'} Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:36.712770 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7b0389d9-4c06-4b12-9a34-7f887e207a20 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 404 len: 111 microversion: 2.1 time: 0.041553 Aug 27 20:56:36.720202 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1032/2163] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:36 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:36.721751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.721751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.721751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.721751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.722328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.723172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.765885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.766506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.767378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.767742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lazy-loading 'fault' on Instance uuid 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:36.886240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:36.903878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02ff8d08-0729-47f5-9c47-a8dd0577374f tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 200 len: 1308 microversion: 2.1 time: 0.222409 Aug 27 20:56:36.905561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1132/2164] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:36 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:36.910816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:36.911745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:36.923082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.923597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.924035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:36.924738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:36.925226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:36.925880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.178737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:37.188632 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3251221-c6bc-480b-b98c-8417b4448131 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.282107 Aug 27 20:56:37.189546 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1033/2165] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:36 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:37.382336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9a87d1-3b7c-4840-8f7c-00bfca879c78", "name": "network-vif-deleted", "tag": "76a9e586-9fde-4386-a84e-3df85e5c106a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:37.399480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.408804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.411098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.428382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] Creating event network-vif-deleted:76a9e586-9fde-4386-a84e-3df85e5c106a for instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 on nch1-master-1 Aug 27 20:56:37.434693 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-889b4c7a-0cad-4684-9415-dc080549bfaf req-c2369c8a-4537-4736-b926-435de6eaa668 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057691 Aug 27 20:56:37.439518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1133/2166] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:37.607360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:37.607975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:37.638674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.639195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.639663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.640398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.640858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.641282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.683368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:37.684094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:37.690639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.691133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.692386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.693136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.696831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.697297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.719507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:37.856994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80e7701f-4df5-482d-85c3-e23e11275182 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 204 len: 0 microversion: 2.25 time: 0.256398 Aug 27 20:56:37.858005 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1034/2167] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:56:37 2022] DELETE /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:56:37.881962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:37.884795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:37.895116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.908125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.909325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:37.910349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:37.911158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:37.911854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.710136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:38.724054 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-31fab331-d973-482b-ad85-4ba28d7688b2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1391 microversion: 2.1 time: 0.864946 Aug 27 20:56:38.734102 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1035/2168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:37 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1391 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:38.742401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:38.748547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:38.749563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:38.755330 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44adc390-a1cd-4478-a4f2-195102d30053 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 1.076816 Aug 27 20:56:38.759631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.760726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.761601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.763130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.763942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.764599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.769067 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1134/2169] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:37 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:38.780516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:38.782576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 3c9a87d1-3b7c-4840-8f7c-00bfca879c78] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:38.789889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.790689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.791426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.792352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.793009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.793648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.815289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] HTTP exception thrown: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Request method failure captured: Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 HTTP/1.1 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS4oA4XAZt3P1VFT0HF-yj507hRiGRq6X2FCt4giw_UqSkpKO8vgkNOusfvgjbayZ1NWgjqAdtU7Nklg3U6W9dfzoDqkfIqh6V1p39BvExQD3VomssEd7T02Jkz2qW-3jJoDekiYJsMYBGGxeu2BYxFT_UKLCMzyueKrgKHnZXR9ZA Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c709ec9938bd48179cb71ac25c6f7256 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c709ec9938bd48179cb71ac25c6f7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c709ec9938bd48179cb71ac25c6f7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c709ec9938bd48179cb71ac25c6f7256", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c709ec9938bd48179cb71ac25c6f7256"}]}] Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c709ec9938bd48179cb71ac25c6f7256 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveMigrationNegativeTest-210586720-project Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: dff9c89bfd3b44908a44a5f4726d2d39 Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveMigrationNegativeTest-210586720-project Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '3c9a87d1-3b7c-4840-8f7c-00bfca879c78'} Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:38.818156 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Returning 404 to user: Instance 3c9a87d1-3b7c-4840-8f7c-00bfca879c78 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-699831b9-ad39-4c3c-b54d-baa67b14c178 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78" status: 404 len: 111 microversion: 2.1 time: 0.050234 Aug 27 20:56:38.824927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1135/2170] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:38 2022] GET /compute/v2.1/servers/3c9a87d1-3b7c-4840-8f7c-00bfca879c78 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:38.828073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df002a9-8f41-4e21-be95-8c45b19650d4", "name": "network-vif-plugged", "status": "completed", "tag": "47546445-4ed3-45b8-9cd5-87701a0d33c3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:38.839959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.841614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.842235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.855937 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] Creating event network-vif-plugged:47546445-4ed3-45b8-9cd5-87701a0d33c3 for instance 0df002a9-8f41-4e21-be95-8c45b19650d4 on nch2-master-1 Aug 27 20:56:38.861943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-98513fd0-9e4a-46ce-ae6d-6ca632bd3a99 req-420140e7-265f-479f-b65c-026f837d5f9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038922 Aug 27 20:56:38.862553 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1136/2171] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:38.871388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:38.872451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:38.881480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.882325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.882948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:38.883887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:38.884512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:38.885103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.265489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:39.277344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:39.279027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:39.283659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cedb9dfa-30b6-4077-bb44-b72f005a3aa1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1549 microversion: 2.25 time: 0.544722 Aug 27 20:56:39.285489 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1036/2172] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:38 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1549 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:39.299667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:39.301015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:39.316670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.317715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.318365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.319400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.320071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.321399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.358705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:39.413623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:39.429832 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a5138a98-3570-4d35-8d97-97aa6dc72971 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.564735 Aug 27 20:56:39.431065 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1137/2173] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:38 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:39.436631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fb87b3-f2e5-4d84-a7e9-d5d2a4860709", "name": "network-vif-deleted", "tag": "ad523f22-e411-4656-b109-5125c1ccd60b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:39.449812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.450359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.450861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.470921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4184c3d-2301-46b2-b658-bfd2411c2991 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 204 len: 0 microversion: 2.1 time: 0.183843 Aug 27 20:56:39.471784 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1037/2174] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:39 2022] DELETE /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:39.478447 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] Creating event network-vif-deleted:ad523f22-e411-4656-b109-5125c1ccd60b for instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 on nch2-master-1 Aug 27 20:56:39.481958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:39.482788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:39.484503 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c988078d-6a58-4052-8367-e1a298762c83 req-bb9edf1a-506f-4414-b1ef-8610844d39ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051814 Aug 27 20:56:39.486168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1138/2175] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:39.492802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.493379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.493816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.494536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.494962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.495447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.743644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:39.751113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:39.751928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:39.753751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a62c3c41-1338-4951-ba9c-2fd9b12e1a4d tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1475 microversion: 2.1 time: 0.276259 Aug 27 20:56:39.755353 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1038/2176] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:39 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1475 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:39.759819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.760519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.761214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.762144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.763065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.763741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.784616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:39.785861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:39.793019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.793899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.794823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:39.796702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:39.797697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:39.798433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.291391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.330291 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f812829-18e8-4641-9ee7-12dad2763e81 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.550014 Aug 27 20:56:40.334543 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1039/2177] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:39 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:40.351235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:40.353061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:40.374012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.374893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.375474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.376248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.376809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.377320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.414802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.433115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3dc549fd-6f50-460f-9d05-253c85fe6f9c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1381 microversion: 2.1 time: 0.689134 Aug 27 20:56:40.438015 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1139/2178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:39 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1381 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:40.460909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:40.463223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:40.485899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.504278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.505064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.505865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.507279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.508485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.510680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.513185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.515468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.516979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:40.636856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.648322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.650122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.651775 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6e68417-2c24-49ff-b95b-798594a1c76a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1352 microversion: 2.25 time: 0.315099 Aug 27 20:56:40.652564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1040/2179] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:40 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:40.657733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a85231fa-c18b-44fd-92dd-36c56a60e6e3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '.version_select at 0x7ff84eaaeca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:40.661900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a85231fa-c18b-44fd-92dd-36c56a60e6e3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.662389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a85231fa-c18b-44fd-92dd-36c56a60e6e3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.662835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a85231fa-c18b-44fd-92dd-36c56a60e6e3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.677319 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a85231fa-c18b-44fd-92dd-36c56a60e6e3 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/os-migrations" status: 200 len: 3891 microversion: 2.1 time: 0.022463 Aug 27 20:56:40.678106 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1041/2180] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:56:40 2022] GET /compute/v2.1/os-migrations => generated 3891 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:40.701387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:40.702709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:40.713002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.713851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.714509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.715549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.716786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.717442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.926697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:40.945138 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6800209-ac00-4a67-855d-ab5ad250d417 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1308 microversion: 2.1 time: 0.490320 Aug 27 20:56:40.946315 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1140/2181] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:40 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:40.952764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:40.954005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:40.964508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.964508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.965295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:40.966614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:40.967480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:40.968396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.027822 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc1131aa-50b7-4c87-9753-5798dc507e07 tempest-LiveMigrationTest-613315971 tempest-LiveMigrationTest-613315971-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1532 microversion: 2.1 time: 0.330651 Aug 27 20:56:41.031448 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1042/2182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:40 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1532 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:41.060581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.061511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.074237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.083870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.085966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.086902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.089224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.089922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.123213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:41.251037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.260950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7cce07ec-0a3d-4416-a261-22f2829a1bfe tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 204 len: 0 microversion: 2.1 time: 0.206174 Aug 27 20:56:41.261854 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1043/2183] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:41 2022] DELETE /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:56:41.266304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-037859fd-92de-4de3-8903-3c99ad73183b tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1475 microversion: 2.1 time: 0.314302 Aug 27 20:56:41.272195 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1141/2184] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:40 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:41.274186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.274787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.279096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.280073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.287982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.288634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.290045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.291096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.292123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.292777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.293239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.293490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.294061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.295173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.297082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.297752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.318006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:41.320165 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 HTTP/1.1 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5e4b48c8-86ab-48d6-8842-14eb49327cb6'} Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:41.322788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.328081 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.330131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:41.331966 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11ba4824-1c9e-43c4-bef4-8a2eea9f8e42 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 404 len: 111 microversion: 2.1 time: 0.067995 Aug 27 20:56:41.333431 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1044/2185] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:41 2022] DELETE /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:41.345425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.346323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 5e4b48c8-86ab-48d6-8842-14eb49327cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.359935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.360691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.362450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.363527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.364649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.365418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.391366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 HTTP/1.1 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5e4b48c8-86ab-48d6-8842-14eb49327cb6'} Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.393916 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 5e4b48c8-86ab-48d6-8842-14eb49327cb6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b09f77da-039d-48f6-9eed-d804383d5eab tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6" status: 404 len: 111 microversion: 2.1 time: 0.057308 Aug 27 20:56:41.402508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1045/2186] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/5e4b48c8-86ab-48d6-8842-14eb49327cb6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:41.411433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.412100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.419247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.419828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.420363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.421187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.421685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.422249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.481330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.493061 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59591ced-2fc4-4416-8c3f-f11dabd29ede tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1387 microversion: 2.1 time: 0.219089 Aug 27 20:56:41.494247 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1142/2187] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1387 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:41.500483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.501089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.509118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.509998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.510563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.511708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.512229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.512763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.531897 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 HTTP/1.1 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '39fa716b-74f5-4fd6-8406-8b2bc87a2c54'} Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:41.533948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.539671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.541872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:41.543110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6f3dc25-6963-471e-8ac9-c8a6b57aacb3 tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "DELETE /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 404 len: 111 microversion: 2.1 time: 0.047734 Aug 27 20:56:41.543713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1143/2188] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:41 2022] DELETE /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:41.555832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.556805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] [instance: 39fa716b-74f5-4fd6-8406-8b2bc87a2c54] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.564080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.565395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.566204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.568993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.569711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.570501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.606753 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] HTTP exception thrown: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Request method failure captured: Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 HTTP/1.1 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoSDSW8WwIVeAgBBO_2Lny61PUpiQQkZGNt3ejwwhCjx0xj_wVRQC286vRkQzfaAdSpxLBSpRbzW3Sk7muiUXn4fMkYbjhj0yz3WfPci4FImjSRkvX8XI4pJskLi0usZCewg-gXi7u02WjCjgXV0uFvn_rYWA2tAXfur1UGY6e7ApBg Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fe4f6d64a7bc40adb889fa76c3e13bf5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fe4f6d64a7bc40adb889fa76c3e13bf5"}]}] Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fe4f6d64a7bc40adb889fa76c3e13bf5 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestMultiNic-416425781 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5840825b0d3341c1ad511f2646c975a2 Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestMultiNic-416425781-project Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '39fa716b-74f5-4fd6-8406-8b2bc87a2c54'} Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:41.608838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] Returning 404 to user: Instance 39fa716b-74f5-4fd6-8406-8b2bc87a2c54 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1c238ec-4c96-4f4f-8685-038f6f39809f tempest-ServersTestMultiNic-416425781 tempest-ServersTestMultiNic-416425781-project] 10.222.0.40 "GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54" status: 404 len: 111 microversion: 2.1 time: 0.062207 Aug 27 20:56:41.615678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1144/2189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/39fa716b-74f5-4fd6-8406-8b2bc87a2c54 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:56:41.619805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.627668 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8057261-71b6-427f-a784-227fe657ac91 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.227089 Aug 27 20:56:41.628547 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1046/2190] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:41.674639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.675287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.681721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.682220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.682696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.683434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.683895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.684324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.719466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.720241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.720730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.721262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:41.774371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.783283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.784864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:41.786247 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82b5d798-e892-4935-8e62-7abfa4d240c2 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1352 microversion: 2.25 time: 0.115998 Aug 27 20:56:41.786884 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1145/2191] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:41.969765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:41.971149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:41.983884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.984802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.985475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:41.986455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:41.987314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:41.987936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.156891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:42.171536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3a66ef8-76a2-4194-8c25-d5487e153c15 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1487 microversion: 2.1 time: 0.208175 Aug 27 20:56:42.172352 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1047/2192] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:41 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1487 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:42.192450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:42.212011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.212997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.213616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.289939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:42.290817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:42.294164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 20:56:42.318815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.319925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.321164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.322148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.322990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.323643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.390542 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0c022b7d-b0b0-45cc-86ae-7cb858990a3f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4/action" status: 202 len: 0 microversion: 2.1 time: 0.202091 Aug 27 20:56:42.394226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1146/2193] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:56:42 2022] POST /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:56:42.418803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:42.419553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:42.428905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.429935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.430392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.431433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.432096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.432693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.460706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:42.584153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:42.600161 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44318676-7b81-41ac-9229-98aea4c9037c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1475 microversion: 2.1 time: 0.316046 Aug 27 20:56:42.602844 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1048/2194] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:42 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:42.620779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:42.621795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:42.674406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:42.684535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d06186ed-b44d-4367-bb8f-f0ae61c3ee90 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.272309 Aug 27 20:56:42.686160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.692540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.694105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.696962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.699177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1147/2195] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:42 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:42.701493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.702445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.706484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:42.707852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:42.719481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.720293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.720927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.722332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:42.723490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:42.724300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:42.992221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.000910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-806be3f5-5c63-485a-a665-adcc0979a7e4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.300219 Aug 27 20:56:43.002015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.014897 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1148/2196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:42 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:43.015384 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-237c25df-6bb7-4f6a-90ee-17ae5b0d3486 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1387 microversion: 2.1 time: 0.410770 Aug 27 20:56:43.016189 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1049/2197] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:42 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1387 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:43.033269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:43.033901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:43.040344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.040846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.045090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.045090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.045090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.045090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.075940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.076579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.077120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.077674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:43.120332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.130535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.132523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.133917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d19cdc62-9bab-4151-9c70-ce69a72d80a8 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 200 len: 1352 microversion: 2.25 time: 0.117460 Aug 27 20:56:43.134471 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1149/2198] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:43 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:43.623661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:43.625071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:43.628649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:43.641150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.642084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.642891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.646228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.647022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.647655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.746702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:43.758495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b1e10532-abc0-4a45-b348-a9f81df75fd8 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1433 microversion: 2.1 time: 0.139709 Aug 27 20:56:43.760324 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1150/2199] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:43 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1433 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:43.775883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea294e9b-8451-4526-b15b-afb1c9cee9dd", "name": "network-vif-deleted", "tag": "866419e8-7e88-4363-9e3d-364029997067"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:43.794793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.799789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.800448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.823035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce265aa7-bb3c-4047-894b-20f90469be11 tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] Calling method '.version_select at 0x7ff84ea40550>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:43.837996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] Creating event network-vif-deleted:866419e8-7e88-4363-9e3d-364029997067 for instance ea294e9b-8451-4526-b15b-afb1c9cee9dd on nch1-master-1 Aug 27 20:56:43.846593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2eff1a6a-79a1-4c92-ace3-6d6532ab6b02 req-61a9fce7-574f-4163-990d-3143f673a379 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084702 Aug 27 20:56:43.847264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1151/2200] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:43.860326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:43.865336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:43.877495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.878104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.878474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.879297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:43.887170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:43.888095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:43.919920 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce265aa7-bb3c-4047-894b-20f90469be11 tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] 10.222.0.40 "GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e" status: 200 len: 784 microversion: 2.1 time: 0.445099 Aug 27 20:56:43.923818 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1050/2201] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:56:43 2022] GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e => generated 784 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:43.965658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f97dbfdc-b335-49b2-8fbb-b5b6a4a18865 tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] Calling method '.version_select at 0x7ff84ea40c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.121154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:44.133714 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2d53e0a-4c2c-40dc-9aac-1e5d39b7f827 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.282854 Aug 27 20:56:44.139759 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1152/2202] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:43 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:44.146394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.147516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.156372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.157219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.157886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.158957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.159795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.160507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.244271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f97dbfdc-b335-49b2-8fbb-b5b6a4a18865 tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] 10.222.0.40 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.297890 Aug 27 20:56:44.247664 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1051/2203] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Aug 27 20:56:43 2022] GET /compute/v2.1/images => generated 445 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:44.262033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.263263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.291440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.294034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.295021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.296016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.297079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.299356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.411873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:44.421248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.423563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.425150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.427168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lazy-loading 'fault' on Instance uuid ea294e9b-8451-4526-b15b-afb1c9cee9dd {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:44.512894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:44.518566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:44.521982 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8544c83c-28ce-4448-825a-88dabc0328b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.380635 Aug 27 20:56:44.522589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1153/2204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:44.527434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.528056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.528749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce059454-5cb1-48b1-bcf3-5899cfd7a10c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 200 len: 1141 microversion: 2.1 time: 0.276877 Aug 27 20:56:44.534222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.534734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.535308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.536201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.536684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.537125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.544253 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1052/2205] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 1141 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:44.550222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d7e2451-0ecb-43e9-b218-d6c270482f8a tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] Calling method '.version_select at 0x7ff84ea403a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.552248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] HTTP exception thrown: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Request method failure captured: Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 HTTP/1.1 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoNsBQmcK3NRGa-rUchJRZsWk9V0FMyu9rwWzsXz-an7wpfAnZ38p1Rps1m6OdB0q8xtZQWdBhY3Rp68yZ_Ft5fNkJCtDUrmk1eCdd7MD8mCl2pICI4d6IMwEHcpSljY7UNTSHAl4DlI4rCIPm-eeVE7jxtq1W5-lDYFLsn5vjrq_co Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5718b7012004d30983db126ff75e348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5718b7012004d30983db126ff75e348", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}] Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c75d7c2bf734450886113fe48be6c44e Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '97fb87b3-f2e5-4d84-a7e9-d5d2a4860709'} Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. Aug 27 20:56:44.553965 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Returning 404 to user: Instance 97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a71eb731-f561-44ca-a540-6be39fed906a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709" status: 404 len: 111 microversion: 2.25 time: 0.031856 Aug 27 20:56:44.558863 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1154/2206] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/servers/97fb87b3-f2e5-4d84-a7e9-d5d2a4860709 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:56:44.564028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.564541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.571987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.572612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.573065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.573892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.574417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.574898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.609780 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d7e2451-0ecb-43e9-b218-d6c270482f8a tempest-ListImagesTestJSON-26395057 tempest-ListImagesTestJSON-26395057-project] 10.222.0.40 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.063561 Aug 27 20:56:44.610743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1053/2207] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:44.617471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:44.747895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1029cb0a-c013-4a58-84a0-7154eac21e84 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "DELETE /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 204 len: 0 microversion: 2.25 time: 0.187168 Aug 27 20:56:44.749995 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1155/2208] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:56:44 2022] DELETE /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:56:44.760747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.761411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.778008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.778008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.788515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.791533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.793295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.794886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:44.795902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.798227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:44.815068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.815596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.816034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.820181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.820741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.821279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.910697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:44.911970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:44.912629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:44.913677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lazy-loading 'fault' on Instance uuid 9fdaac22-8a21-418f-ab77-cbb26b190d0b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:45.046188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff9c89bfd3b44908a44a5f4726d2d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c709ec9938bd48179cb71ac25c6f7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.059757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ce715d6-d34c-4d51-a28b-0b738ff82794 tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 200 len: 1309 microversion: 2.1 time: 0.275521 Aug 27 20:56:45.060461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1156/2209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:45.104841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.121319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.124689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.126176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f90dcbaa-b428-43fb-8e13-1dc73b116808 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1563 microversion: 2.25 time: 0.371599 Aug 27 20:56:45.126955 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1054/2210] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:44 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1563 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:45.159781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:45.160962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:45.168328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.169006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.169551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.170964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.171590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.172127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.392711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.409657 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14dfb3da-e2c9-40f7-9912-237f89e9381c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.253453 Aug 27 20:56:45.425583 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1157/2211] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:45 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:45.544187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:45.544811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:45.550718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:45.552503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: ea294e9b-8451-4526-b15b-afb1c9cee9dd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:45.553092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.553590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.561756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.562939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.563374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.563524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.563928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.566223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.566892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.569547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.570119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.570562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.587863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] HTTP exception thrown: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Request method failure captured: Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd HTTP/1.1 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOrlsj_m3q3HfyHlyqJjKTsOYqBaPSLnLL-Dk9EhTAtAIOgyhMPe-yzRtW8jzqREnRpKb_PqDXMuUkzsCnhE-YBnO82DsgOyl-INVDzpJiKG7hNViSjr2zbo7o0bMjBl6sRMqJI3NkF7zqV-D6iWzAXcHzXt3oSiFg4ZMbBPbFfDeU Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/459a7cdda740490a900289697e84372b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_459a7cdda740490a900289697e84372b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}] Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 43dd6f015403486491e8140062f43bee Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ea294e9b-8451-4526-b15b-afb1c9cee9dd'} Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:45.589624 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Returning 404 to user: Instance ea294e9b-8451-4526-b15b-afb1c9cee9dd could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-43179446-1909-43f1-9d4f-284dedf01ad6 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd" status: 404 len: 111 microversion: 2.1 time: 0.044409 Aug 27 20:56:45.595358 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1158/2212] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:45 2022] GET /compute/v2.1/servers/ea294e9b-8451-4526-b15b-afb1c9cee9dd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:56:45.813534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:45.824714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ceb74e8a-8167-493b-80ac-f06297938ad5 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.284241 Aug 27 20:56:45.825309 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1055/2213] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:45 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:45.910332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdaac22-8a21-418f-ab77-cbb26b190d0b", "name": "network-vif-deleted", "tag": "1f9fc837-0bee-49f3-8111-da1f0adba093"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:45.928467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:45.929506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:45.929506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:45.944325 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] Creating event network-vif-deleted:1f9fc837-0bee-49f3-8111-da1f0adba093 for instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b on nch2-master-1 Aug 27 20:56:45.949481 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-44894fa1-421b-4220-b07c-669d381bd78e req-7a03189a-6619-4a0a-bf24-0eacd2ecddfb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043462 Aug 27 20:56:45.950088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1159/2214] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:46.089291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:46.093521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] [instance: 9fdaac22-8a21-418f-ab77-cbb26b190d0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:46.115275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.117123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.117799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.118803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.119689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.121136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.151213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:46.152150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:46.154642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:46.171249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.172514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.175218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.177524 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] HTTP exception thrown: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. Aug 27 20:56:46.178042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.180500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.181126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Request method failure captured: Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b HTTP/1.1 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS4oA4XAZt3P1VFT0HF-yj507hRiGRq6X2FCt4giw_UqSkpKO8vgkNOusfvgjbayZ1NWgjqAdtU7Nklg3U6W9dfzoDqkfIqh6V1p39BvExQD3VomssEd7T02Jkz2qW-3jJoDekiYJsMYBGGxeu2BYxFT_UKLCMzyueKrgKHnZXR9ZA Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c709ec9938bd48179cb71ac25c6f7256 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c709ec9938bd48179cb71ac25c6f7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c709ec9938bd48179cb71ac25c6f7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c709ec9938bd48179cb71ac25c6f7256", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c709ec9938bd48179cb71ac25c6f7256"}]}] Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c709ec9938bd48179cb71ac25c6f7256 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-210586720 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-LiveMigrationNegativeTest-210586720-project Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: dff9c89bfd3b44908a44a5f4726d2d39 Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-LiveMigrationNegativeTest-210586720-project Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9fdaac22-8a21-418f-ab77-cbb26b190d0b'} Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:46.182429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] Returning 404 to user: Instance 9fdaac22-8a21-418f-ab77-cbb26b190d0b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:46.190823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce64c48a-986a-4c04-b05d-92b9e7c6ee0c tempest-LiveMigrationNegativeTest-210586720 tempest-LiveMigrationNegativeTest-210586720-project] 10.222.0.40 "GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b" status: 404 len: 111 microversion: 2.1 time: 0.108690 Aug 27 20:56:46.193233 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1056/2215] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:46 2022] GET /compute/v2.1/servers/9fdaac22-8a21-418f-ab77-cbb26b190d0b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:46.432929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:46.433796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:46.444457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.445398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.446143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.447435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.448092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.448898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.587677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:46.608173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:46.612296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:46.617142 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef6eb75f-c18d-4062-9de5-a72558c3486a tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1563 microversion: 2.25 time: 0.469816 Aug 27 20:56:46.617953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1160/2216] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:46 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1563 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:56:46.669767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:46.688714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17ee8df3-85fb-475c-bfa6-861145fc64eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.259287 Aug 27 20:56:46.690190 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1057/2217] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:46 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:46.815571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:46.819878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:46.841834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.842379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.843445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.844299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:46.849098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:46.849885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:46.885130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:47.032720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-568e7720-6c2f-46a1-8193-9d3290c03e46 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 204 len: 0 microversion: 2.1 time: 0.230465 Aug 27 20:56:47.033785 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1161/2218] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:46 2022] DELETE /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:47.044389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:47.045397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:47.054352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.055256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.056863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.058025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.059485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.060160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.264747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:47.265966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:47.279911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.280407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.281010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.281937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.282392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.282813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.422730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:47.426446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:47.439402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b1151ab-5def-4790-8573-fe233878a9bd tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1667 microversion: 2.1 time: 0.401802 Aug 27 20:56:47.440125 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1162/2219] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:47 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1667 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:47.592327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:47.608376 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-719666ae-8bf1-4c13-a5be-31a07c52969a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.761900 Aug 27 20:56:47.622439 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1058/2220] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:46 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:47.642333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:47.643199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:47.653052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.660273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.660821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.661675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.662379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.662741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.713367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.713989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.714307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.714755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lazy-loading 'fault' on Instance uuid 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:47.725446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:47.726093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:47.737607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.740289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.740804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.741559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:47.742026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:47.742917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:47.776476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:47.786805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:47.789027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5718b7012004d30983db126ff75e348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:47.790639 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82fd7048-f2bf-4a22-9f09-776620b5d2e5 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 200 len: 1351 microversion: 2.25 time: 0.153696 Aug 27 20:56:47.791953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1163/2221] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:47 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:56:48.016218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c", "name": "network-vif-deleted", "tag": "de4c6c4c-48ba-4c87-9fb2-90044336c2dc"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:48.031258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:48.032119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:48.033280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:48.042068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:48.058608 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f49351ec-4007-436e-90f8-9c8a159ffddb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.348094 Aug 27 20:56:48.062505 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1059/2222] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:47 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:48.072011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] Creating event network-vif-deleted:de4c6c4c-48ba-4c87-9fb2-90044336c2dc for instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c on nch2-master-1 Aug 27 20:56:48.077863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9469c331-6d6a-4805-9a08-263a0e8ed9de req-73eae0f1-277f-4876-9aca-ca393d5a0425 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069111 Aug 27 20:56:48.079043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1164/2223] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:48.463677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:48.464846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:48.485057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:48.486535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:48.487487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:48.489191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:48.490197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:48.490875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:48.631572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:48.632200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:48.641389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:48.642138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:48.642973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:48.643882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:48.644844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:48.645739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:49.058717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:49.071170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f4f92b9-3d00-486a-841c-b6331317a459 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1667 microversion: 2.1 time: 0.612404 Aug 27 20:56:49.072259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1060/2224] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:48 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1667 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:49.078639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:49.080705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] [instance: 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:49.089227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:49.093661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:49.094344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:49.095248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:49.100736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:49.101995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:49.129955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] HTTP exception thrown: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Request method failure captured: Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c HTTP/1.1 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoNsBQmcK3NRGa-rUchJRZsWk9V0FMyu9rwWzsXz-an7wpfAnZ38p1Rps1m6OdB0q8xtZQWdBhY3Rp68yZ_Ft5fNkJCtDUrmk1eCdd7MD8mCl2pICI4d6IMwEHcpSljY7UNTSHAl4DlI4rCIPm-eeVE7jxtq1W5-lDYFLsn5vjrq_co Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a5718b7012004d30983db126ff75e348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a5718b7012004d30983db126ff75e348", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a5718b7012004d30983db126ff75e348"}]}] Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a5718b7012004d30983db126ff75e348 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-547847934 Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c75d7c2bf734450886113fe48be6c44e Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-547847934-project Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c'} Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. Aug 27 20:56:49.136998 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. Aug 27 20:56:49.142641 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:56:49.146854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] Returning 404 to user: Instance 55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:49.147993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ded5ba0-d34d-402d-96e4-2062267e16e1 tempest-LiveAutoBlockMigrationV225Test-547847934 tempest-LiveAutoBlockMigrationV225Test-547847934-project] 10.222.0.40 "GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c" status: 404 len: 111 microversion: 2.25 time: 0.074427 Aug 27 20:56:49.152407 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1061/2225] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:56:49 2022] GET /compute/v2.1/servers/55fbc5c8-ef27-4bf0-b86c-2e4553c2c92c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:56:49.162590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:49.163507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:49.177095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:49.180692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:49.181904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:49.184607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:49.188146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:49.188603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:49.189752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:49.203912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f33e95ad-7214-4eea-86e4-b646695a26b7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.574031 Aug 27 20:56:49.204937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1165/2226] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:48 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:50.094355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:50.095390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:50.114940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:50.116814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:50.118576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:50.137106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:50.138557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:50.140917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:50.290614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:50.323608 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12e87afb-98f1-4f90-a73a-1c21d2491e57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 1.170241 Aug 27 20:56:50.325737 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1062/2227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:49 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:50.341703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:50.347432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:50.355194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:50.355856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:50.372907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:50.380159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:50.380660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:50.381099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:50.384108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:50.433735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5bfb4cf6-7484-45c1-8738-5ce918ff995c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1599 microversion: 2.1 time: 0.342133 Aug 27 20:56:50.447777 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1166/2228] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:50 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1599 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:50.484875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1125bf-71bf-4cca-a222-b5d4099ccd42", "name": "network-vif-deleted", "tag": "2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:50.517394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:50.519079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:50.519942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:50.538564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] Creating event network-vif-deleted:2dd3354b-005f-4a1f-aaa7-f01ae42ed8a1 for instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 on nch2-master-1 Aug 27 20:56:50.548077 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-08d17ae1-e4e9-47cf-b9c1-f7dc6cad4984 req-025457d4-ede0-4985-8405-ffca9a49d098 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094876 Aug 27 20:56:50.550041 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1167/2229] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:50.884976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:50.905718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-478beab4-7318-4a2e-b63e-bbb93c8c6ad4 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.574235 Aug 27 20:56:50.908552 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1063/2230] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:50 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:51.361599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:51.369532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:51.409153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.409845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.416254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.417348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.417846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.418287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.474898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:51.475777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:51.531472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.531472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.531472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.532775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.534388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.537222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.643940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.646136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.647286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.649037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lazy-loading 'fault' on Instance uuid cf1125bf-71bf-4cca-a222-b5d4099ccd42 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:51.786584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:51.797249 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19a7fe81-fea5-448b-831f-fb03d42af130 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 200 len: 1323 microversion: 2.1 time: 0.328416 Aug 27 20:56:51.798247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1064/2231] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:51 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:51.927804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:51.928612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:51.942983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.943544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.945621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:51.946351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:51.949531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:51.950234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:52.354418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:52.364600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79dc0b42-ff17-4f4a-bb5f-d53c3b3db15d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 1.017451 Aug 27 20:56:52.367669 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1168/2232] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:51 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:52.641378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:52.645487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:56:52.655274 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a1a7f4f-34d5-455b-85f4-8a961dd4b133 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.731798 Aug 27 20:56:52.656158 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1065/2233] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:51 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:52.821558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:52.822130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: cf1125bf-71bf-4cca-a222-b5d4099ccd42] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:52.829562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:52.830052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:52.830558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:52.831685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:52.832172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:52.832602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:52.850544 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] HTTP exception thrown: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Request method failure captured: Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 HTTP/1.1 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOrlsj_m3q3HfyHlyqJjKTsOYqBaPSLnLL-Dk9EhTAtAIOgyhMPe-yzRtW8jzqREnRpKb_PqDXMuUkzsCnhE-YBnO82DsgOyl-INVDzpJiKG7hNViSjr2zbo7o0bMjBl6sRMqJI3NkF7zqV-D6iWzAXcHzXt3oSiFg4ZMbBPbFfDeU Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/459a7cdda740490a900289697e84372b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_459a7cdda740490a900289697e84372b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}] Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 43dd6f015403486491e8140062f43bee Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'cf1125bf-71bf-4cca-a222-b5d4099ccd42'} Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:52.851272 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. Aug 27 20:56:52.858046 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:52.859932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Returning 404 to user: Instance cf1125bf-71bf-4cca-a222-b5d4099ccd42 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:52.861424 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1c9615c-ca90-4c66-93ba-c1eaedb2bd5c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42" status: 404 len: 111 microversion: 2.1 time: 0.043787 Aug 27 20:56:52.862228 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1169/2234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:52 2022] GET /compute/v2.1/servers/cf1125bf-71bf-4cca-a222-b5d4099ccd42 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:52.873504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-77f3f599-9e98-4e71-937a-9ebdf94ba866 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '.version_select at 0x7ff84ea40280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:52.899580 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-77f3f599-9e98-4e71-937a-9ebdf94ba866 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336030746" status: 202 len: 0 microversion: 2.1 time: 0.029917 Aug 27 20:56:52.901513 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1066/2235] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 20:56:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336030746 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:56:53.389612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:53.390911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:53.402066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:53.402567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:53.403005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:53.403751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:53.404201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:53.404621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:53.682030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:53.682660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:53.698555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:53.699356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:53.700474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:53.703119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:53.710343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:53.711227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:54.001361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:54.014478 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bad2ebe5-51cd-422b-ab0c-211514137f85 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.629790 Aug 27 20:56:54.015808 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1170/2236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:53 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:54.105742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:54.115732 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fb0a7181-958d-48a8-b51c-6bd87c95a5a8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.441679 Aug 27 20:56:54.119369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1067/2237] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:53 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:54.354724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:54.355246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:54.373370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:54.373889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:54.374327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:54.375069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:54.375564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:54.375998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:54.449922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:54.653976 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8e5a364-9fea-458a-9f98-49ae90127214 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 204 len: 0 microversion: 2.1 time: 0.301322 Aug 27 20:56:54.655870 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1171/2238] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:54 2022] DELETE /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:54.663792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:54.668312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:54.679894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:54.684082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:54.685458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:54.686378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:54.687252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:54.689833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:55.038871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:55.039632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:55.053460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:55.060966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:55.067182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:55.068391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:55.073838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:55.074598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:55.474586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:55.485525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d34a0318-e9c9-4d2a-bca6-f66fb86caef3 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1484 microversion: 2.1 time: 0.825785 Aug 27 20:56:55.486122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1068/2239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:54 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1484 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:55.525070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:55.525667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:55.537572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:55.538607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:55.539206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:55.540120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:55.542241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:55.542889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:55.929743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:55.946007 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28671e44-3edc-4901-9a52-22fb6cd25080 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.911806 Aug 27 20:56:55.952555 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1172/2240] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:55 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:55.976265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:55.990311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9a84d1f-9033-4210-96b9-37f1bfeda7e9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.484994 Aug 27 20:56:55.991753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1069/2241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:55 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:56.506955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:56.510214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:56.522891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:56.523806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:56.524506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:56.526313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:56.526967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:56.528596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:56.878942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:56.907183 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75e1550a-f1c7-44cb-802f-33de3decf3c7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1484 microversion: 2.1 time: 0.404812 Aug 27 20:56:56.923698 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1173/2242] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:56 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1484 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:56.993496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:56.996146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:57.015512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:57.017313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:57.029776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.030138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.030577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.031328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.031800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.032344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.034012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.039797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.040626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.041623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.042612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.043572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.530114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:57.563459 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23276e4b-4052-4b4e-b9fe-c76c140605d5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.593615 Aug 27 20:56:57.564092 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1070/2243] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:56 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:57.580800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9213b4f8-a682-44bb-8771-1ae451404522", "name": "network-vif-deleted", "tag": "4b85e86e-e432-48b9-9f1d-674b5f3deddb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:56:57.614021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.614523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.614965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.654100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] Creating event network-vif-deleted:4b85e86e-e432-48b9-9f1d-674b5f3deddb for instance 9213b4f8-a682-44bb-8771-1ae451404522 on nch2-master-1 Aug 27 20:56:57.655269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:57.673177 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2d76e773-b70b-4d94-86ae-e2791a584da1 req-92b0503c-0950-474c-a876-2a802eab49c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107135 Aug 27 20:56:57.673809 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1071/2244] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:56:57.678014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5123485b-9050-4141-9ef6-69ee35be1516 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.667783 Aug 27 20:56:57.681272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1174/2245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:57 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:57.939062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:57.942742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:57.954918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.956158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.956834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:57.957781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:57.958466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:57.959101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:58.044404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:58.045100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:58.046720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:58.058254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lazy-loading 'fault' on Instance uuid 9213b4f8-a682-44bb-8771-1ae451404522 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:56:58.152968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:58.176861 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec017ca3-e5c6-4437-8387-46163cb6374c tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 200 len: 1300 microversion: 2.1 time: 0.243452 Aug 27 20:56:58.191041 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1072/2246] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:57 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:58.589627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:58.590495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:58.602789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:58.608763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:58.610255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:58.612858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:58.618610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:58.619440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:58.701895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:58.702514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:58.710573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:58.711070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:58.711539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:58.712241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:58.712698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:58.713124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.210687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:59.220230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:59.229207 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85960ebd-693a-4040-a00a-c1c0bf4f041d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.644983 Aug 27 20:56:59.229848 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1175/2247] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:58 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:56:59.241805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc063866-1a03-4c67-944f-4fffa4b1901d tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1476 microversion: 2.1 time: 0.530695 Aug 27 20:56:59.242759 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1073/2248] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:58 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:56:59.252277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:59.252906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 9213b4f8-a682-44bb-8771-1ae451404522] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:59.267229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.267756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.271239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.277885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.280684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.281395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.327637 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] HTTP exception thrown: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Request method failure captured: Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 HTTP/1.1 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoOrlsj_m3q3HfyHlyqJjKTsOYqBaPSLnLL-Dk9EhTAtAIOgyhMPe-yzRtW8jzqREnRpKb_PqDXMuUkzsCnhE-YBnO82DsgOyl-INVDzpJiKG7hNViSjr2zbo7o0bMjBl6sRMqJI3NkF7zqV-D6iWzAXcHzXt3oSiFg4ZMbBPbFfDeU Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/459a7cdda740490a900289697e84372b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_459a7cdda740490a900289697e84372b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}] Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 459a7cdda740490a900289697e84372b Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 43dd6f015403486491e8140062f43bee Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-LiveMigrationTest-1041689321-project Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '9213b4f8-a682-44bb-8771-1ae451404522'} Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:56:59.330328 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. Aug 27 20:56:59.337218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:56:59.339157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Returning 404 to user: Instance 9213b4f8-a682-44bb-8771-1ae451404522 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:56:59.342022 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73866e4e-2c1a-4ac4-8421-8e136eaf953e tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522" status: 404 len: 111 microversion: 2.1 time: 0.108546 Aug 27 20:56:59.346786 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1176/2249] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:59 2022] GET /compute/v2.1/servers/9213b4f8-a682-44bb-8771-1ae451404522 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:56:59.356979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:59.358797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:59.377735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.379620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.380104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.380986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.381460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.381928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.443049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:56:59.613753 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f6a22c89-630a-4bf0-b11f-7e427cb87325 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 204 len: 0 microversion: 2.1 time: 0.262533 Aug 27 20:56:59.615268 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1074/2250] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:56:59 2022] DELETE /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:56:59.623754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:56:59.624879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:56:59.641177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.642033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.642633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.643692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:56:59.644475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:56:59.645275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:56:59.905180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:56:59.922766 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-744fdfec-69d5-45d8-8d69-d6b29bea78d7 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1498 microversion: 2.1 time: 0.303348 Aug 27 20:56:59.926676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1177/2251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:56:59 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:00.251569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:00.251994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:00.267848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:00.272017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:00.277441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.278195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.279008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:00.279933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.285277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.285975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:00.297467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.299540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.301171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:00.304393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.305801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.311959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:00.652249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:00.664410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c7b8ee7-fffc-44cb-b253-2bd3e8c19d35 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1475 microversion: 2.1 time: 0.403607 Aug 27 20:57:00.665553 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1178/2252] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:00 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1475 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:00.949308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:00.949943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:00.963154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.965639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.966886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:00.968257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:00.972258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:00.974206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:01.307810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:01.319989 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb9c1727-3b1d-48e4-a004-b0c60a902363 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 1.073026 Aug 27 20:57:01.321136 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1075/2253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:00 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:01.436066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:01.456114 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d227931-7046-48c3-b946-fae0b9a88ca2 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1498 microversion: 2.1 time: 0.511292 Aug 27 20:57:01.457045 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1179/2254] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:00 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:01.686820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:01.687558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:01.695607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:01.696604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:01.697283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:01.698248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:01.698916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:01.699580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:01.923889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:01.940605 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c2683ae6-c549-41f5-bf01-1fcb633bddea tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1475 microversion: 2.1 time: 0.258199 Aug 27 20:57:01.942062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1076/2255] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:01 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:02.304157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-781250938", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "4f261ca6-acbc-469d-a994-54baa54a161a"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:02.341449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:02.342751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:02.358396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:02.359175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:02.359791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:02.364563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:02.365274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:02.366796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:02.433137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] validate_networks() for [('4f261ca6-acbc-469d-a994-54baa54a161a', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:57:02.999972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:03.008793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-22a35a4a-fa51-47b2-bd41-d16bd829414f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.671953 Aug 27 20:57:03.026771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1077/2256] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:02 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:03.032459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:03.042247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:03.058470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.059076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.059782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.071772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.072721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.073385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.154694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.156382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.157754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.162901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lazy-loading 'fault' on Instance uuid 6a5de354-ac96-4d30-a18c-c7f6334f933d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:03.257090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd6f015403486491e8140062f43bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459a7cdda740490a900289697e84372b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:03.275109 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47154304-3da9-4ebc-a429-1cff0a5f6299 tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 200 len: 1299 microversion: 2.1 time: 0.246454 Aug 27 20:57:03.294941 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1078/2257] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:03 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 1299 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:03.327161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:57:03.329202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:57:03.330040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:57:03.330460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:57:03.330880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:57:03.349858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.350447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.351830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.354822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.358833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.360123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.390156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:03.416996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Getting quotas for project dced4e2c73df4f4485ef8442b0afe00e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:57:03.439901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Getting quotas for user 8c6a5cc460f744ee8b958eafbe2e995b and project dced4e2c73df4f4485ef8442b0afe00e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:57:03.441834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Calling method '.version_select at 0x7ff84ea5d820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:03.465042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:57:03.469510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:57:03.502315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:57:03.503191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Neutron security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 20:57:03.504232 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] HTTP exception thrown: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.504232 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Request method failure captured: Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/12d2b824-4307-4ba4-b6fa-1e1d480be358 HTTP/1.1 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoUe-fAuz_GP_OlrVOfUmjzIlMVBm6PQMop1srQfGBHpvHzXuXI5THz-9JDYMgCedShPtAjNxdG2XU1_9cQTdU2EFk6dsEKesTlWpQWGZ5xiVdco8chq91RINyuB_DnxXPBaLJIsOizaleFR-VSjHuUSyh0nLi-U4sC7Nl3YkNPmQjA Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5c6f747f385c4f89b5af2a1ebc009383", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}] Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8753db80dd4e35bdbb51623731ed4e Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '12d2b824-4307-4ba4-b6fa-1e1d480be358'} Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:57:03.507426 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] Aug 27 20:57:03.512856 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:03.517060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Returning 404 to user: Security group 12d2b824-4307-4ba4-b6fa-1e1d480be358 does not exist Aug 27 20:57:03.517060 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-62acd28c-395b-4c46-afeb-f182b31734e5'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:03.518211 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c9492aa-106b-4426-a090-ac4ee3f2dbc2 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/12d2b824-4307-4ba4-b6fa-1e1d480be358" status: 404 len: 194 microversion: 2.1 time: 0.222057 Aug 27 20:57:03.524505 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1079/2258] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:57:03 2022] DELETE /compute/v2.1/os-security-groups/12d2b824-4307-4ba4-b6fa-1e1d480be358 => generated 194 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:57:03.543721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-unplugged", "status": "completed", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:03.571447 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2e66adae-9374-42ea-bcdf-bbbfbcf32bc0 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441508 Aug 27 20:57:03.574003 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1180/2259] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:57:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:57:03.588323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:03.589334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.589868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.590300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.590605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:03.610571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.611101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.611560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.612343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:03.612877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:03.613518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:03.637593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Creating event network-vif-unplugged:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch2-master-1 Aug 27 20:57:03.656393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:57:03.689256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0c17f7ed-9ff9-4cf6-8981-9b16f1c2c66e req-9ed78983-9eff-4eb1-b686-7102a7a1375e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162520 Aug 27 20:57:03.693726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1080/2260] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:03.702854 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-868f43e7-7890-468b-a455-e5d51b9049ce tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006906 Aug 27 20:57:03.709050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1081/2261] 10.222.0.40 () {58 vars in 1164 bytes} [Sat Aug 27 20:57:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 20:57:03.716868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5fd8a398-eb06-48fb-bd1b-707baf5b4601 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:03.718263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5fd8a398-eb06-48fb-bd1b-707baf5b4601 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:03.877069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fd8a398-eb06-48fb-bd1b-707baf5b4601 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:03.888432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5fd8a398-eb06-48fb-bd1b-707baf5b4601 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1223 microversion: 2.1 time: 0.178018 Aug 27 20:57:03.890955 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1082/2262] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:03 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1223 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:03.912585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de5f53d8-984e-417c-86bf-4f7cf58e0fcf tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Calling method '.version_select at 0x7ff84ea63310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:04.231278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:04.259618 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b974321d-4764-4270-9074-31c1edfe40df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1475 microversion: 2.1 time: 0.683781 Aug 27 20:57:04.260864 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1181/2263] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:03 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1475 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:04.267878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:04.268754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:04.276587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.278290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.279384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:04.280392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.282124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.283044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:04.682585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de5f53d8-984e-417c-86bf-4f7cf58e0fcf tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.775681 Aug 27 20:57:04.683231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1083/2264] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 20:57:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:04.689627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:04.690607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] [instance: 6a5de354-ac96-4d30-a18c-c7f6334f933d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:04.712222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:04.718370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.718943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.720644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:04.725539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41d0275c-b371-4205-b2a3-bc1e84e3933c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.460121 Aug 27 20:57:04.737652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.738942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.740941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:04.741396 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1182/2265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:04 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:04.759123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Calling method '.version_select at 0x7ff84eea4dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:04.801006 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] HTTP exception thrown: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Request method failure captured: Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d HTTP/1.1 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoOrlsj_m3q3HfyHlyqJjKTsOYqBaPSLnLL-Dk9EhTAtAIOgyhMPe-yzRtW8jzqREnRpKb_PqDXMuUkzsCnhE-YBnO82DsgOyl-INVDzpJiKG7hNViSjr2zbo7o0bMjBl6sRMqJI3NkF7zqV-D6iWzAXcHzXt3oSiFg4ZMbBPbFfDeU Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 459a7cdda740490a900289697e84372b Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/459a7cdda740490a900289697e84372b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_459a7cdda740490a900289697e84372b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/459a7cdda740490a900289697e84372b"}]}] Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-LiveMigrationTest-1041689321 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 459a7cdda740490a900289697e84372b Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-LiveMigrationTest-1041689321 Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-LiveMigrationTest-1041689321-project Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 43dd6f015403486491e8140062f43bee Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-LiveMigrationTest-1041689321-project Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '6a5de354-ac96-4d30-a18c-c7f6334f933d'} Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:04.805775 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. Aug 27 20:57:04.812110 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:04.816019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] Returning 404 to user: Instance 6a5de354-ac96-4d30-a18c-c7f6334f933d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:04.820558 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ee96637-bad4-40a0-98e0-f714fb6b93be tempest-LiveMigrationTest-1041689321 tempest-LiveMigrationTest-1041689321-project] 10.222.0.40 "GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d" status: 404 len: 111 microversion: 2.1 time: 0.135895 Aug 27 20:57:04.821736 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1084/2266] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:04 2022] GET /compute/v2.1/servers/6a5de354-ac96-4d30-a18c-c7f6334f933d => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:57:04.920799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:04.922389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:04.934201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.936130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.936807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:04.937887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:04.938859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:04.939797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:05.284765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:05.297256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5baab837-480f-4511-b513-cf1750a5a98c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1275 microversion: 2.1 time: 0.388909 Aug 27 20:57:05.316603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1085/2267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:04 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1275 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:05.332181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:05.367546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:05.375895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:05.376675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:05.377380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:05.378413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:05.379099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:05.379705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:05.401859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:57:05.402595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 20:57:05.402595 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Request method failure captured: Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-security-groups/1f6be6f4-61ca-408a-9154-41e1ec2f3829 HTTP/1.1 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUe-fAuz_GP_OlrVOfUmjzIlMVBm6PQMop1srQfGBHpvHzXuXI5THz-9JDYMgCedShPtAjNxdG2XU1_9cQTdU2EFk6dsEKesTlWpQWGZ5xiVdco8chq91RINyuB_DnxXPBaLJIsOizaleFR-VSjHuUSyh0nLi-U4sC7Nl3YkNPmQjA Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5c6f747f385c4f89b5af2a1ebc009383", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}] Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8753db80dd4e35bdbb51623731ed4e Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: exception: Insufficient rights for removing default security group. Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1f6be6f4-61ca-408a-9154-41e1ec2f3829'} Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:57:05.405281 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-99910b3a-77ea-407f-85ac-d6861d05f68e'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65c95059-adb2-4e66-922b-cfc05e09fc62 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1f6be6f4-61ca-408a-9154-41e1ec2f3829" status: 400 len: 182 microversion: 2.1 time: 0.664184 Aug 27 20:57:05.424111 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1183/2268] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 20:57:04 2022] DELETE /compute/v2.1/os-security-groups/1f6be6f4-61ca-408a-9154-41e1ec2f3829 => generated 182 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:57:05.436287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Calling method '.version_select at 0x7ff84ef32940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:05.972944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:57:05.973585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Neutron security group b61d5658-7fc2-430e-9ed9-6894df71aba7 not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 20:57:05.974093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] HTTP exception thrown: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.974093 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Request method failure captured: Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-security-groups/b61d5658-7fc2-430e-9ed9-6894df71aba7 HTTP/1.1 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUe-fAuz_GP_OlrVOfUmjzIlMVBm6PQMop1srQfGBHpvHzXuXI5THz-9JDYMgCedShPtAjNxdG2XU1_9cQTdU2EFk6dsEKesTlWpQWGZ5xiVdco8chq91RINyuB_DnxXPBaLJIsOizaleFR-VSjHuUSyh0nLi-U4sC7Nl3YkNPmQjA Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5c6f747f385c4f89b5af2a1ebc009383", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}] Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8753db80dd4e35bdbb51623731ed4e Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b61d5658-7fc2-430e-9ed9-6894df71aba7'} Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:57:05.976055 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Returning 404 to user: Security group b61d5658-7fc2-430e-9ed9-6894df71aba7 does not exist Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-cad03aff-5a52-4bab-a5bc-00b835cd49fb'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91ad9572-cdbe-487f-a004-9e309c73c452 tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/b61d5658-7fc2-430e-9ed9-6894df71aba7" status: 404 len: 194 microversion: 2.1 time: 0.547238 Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1184/2269] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 20:57:05 2022] GET /compute/v2.1/os-security-groups/b61d5658-7fc2-430e-9ed9-6894df71aba7 => generated 194 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:05.988694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:05.998088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:05.998088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:05.998088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:05.998088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:05.998576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:05.998890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:06.747315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:06.763243 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a907b5a-18b8-4d1e-bb66-bf1d13356f7e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.783712 Aug 27 20:57:06.773103 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1185/2270] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:05 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:06.781094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5de354-ac96-4d30-a18c-c7f6334f933d", "name": "network-vif-deleted", "tag": "e6309230-7340-4487-a237-df1a5e8f1f9c"}, {"name": "network-changed", "server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:06.803137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:06.804141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:06.805299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:06.832312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:06.836119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:06.849952 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Creating event network-vif-deleted:e6309230-7340-4487-a237-df1a5e8f1f9c for instance 6a5de354-ac96-4d30-a18c-c7f6334f933d on nch1-master-1 Aug 27 20:57:06.850826 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Creating event network-changed:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch2-master-1 Aug 27 20:57:06.855309 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24599633-fae8-437d-865c-30643df628d1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1473 microversion: 2.1 time: 1.532991 Aug 27 20:57:06.856415 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1086/2271] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:05 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1473 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:06.870209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:57:06.873022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Action: 'update', calling method: .version_select at 0x7ff84ea8d4c0>, body: {"security_group": {"name": "tempest-sg-52515714", "description": "tempest-description-287438256"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:06.897878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-539fdffa-77f1-4cda-bdc9-c07724c324c4 req-cf9de7ff-c9c1-44db-af6f-5d748569dfbd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122479 Aug 27 20:57:06.898878 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1186/2272] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:06.912806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:06.913705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:06.932743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:06.936435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:06.936886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:06.938691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:06.939171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:06.944738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:06.985924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:57:06.986657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Neutron security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 20:57:06.987323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] HTTP exception thrown: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.987323 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Request method failure captured: Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/os-security-groups/526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a HTTP/1.1 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 99 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoUe-fAuz_GP_OlrVOfUmjzIlMVBm6PQMop1srQfGBHpvHzXuXI5THz-9JDYMgCedShPtAjNxdG2XU1_9cQTdU2EFk6dsEKesTlWpQWGZ5xiVdco8chq91RINyuB_DnxXPBaLJIsOizaleFR-VSjHuUSyh0nLi-U4sC7Nl3YkNPmQjA Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5c6f747f385c4f89b5af2a1ebc009383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5c6f747f385c4f89b5af2a1ebc009383", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5c6f747f385c4f89b5af2a1ebc009383"}]}] Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 5c6f747f385c4f89b5af2a1ebc009383 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-481594799 Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8753db80dd4e35bdbb51623731ed4e Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-481594799-project Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: {"security_group": {"name": "tempest-sg-52515714", "description": "tempest-description-287438256"}} Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a', 'body': {'security_group': {'name': 'tempest-sg-52515714', 'description': 'tempest-description-287438256'}}} Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:57:06.993122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] Aug 27 20:57:06.998368 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:07.003611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] Returning 404 to user: Security group 526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a does not exist Aug 27 20:57:07.003611 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-25b9cc52-53ca-417d-b527-5d411c6d4e90'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:07.011727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f13ac7dd-5c0d-41be-9f1f-48eb84817d6d tempest-SecurityGroupsNegativeTestJSON-481594799 tempest-SecurityGroupsNegativeTestJSON-481594799-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a" status: 404 len: 194 microversion: 2.1 time: 0.145838 Aug 27 20:57:07.012821 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1087/2273] 10.222.0.40 () {60 vars in 1289 bytes} [Sat Aug 27 20:57:06 2022] PUT /compute/v2.1/os-security-groups/526a4ec5-17ac-4b9a-8cd2-00ec6cbd812a => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:57:07.239499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:07.252700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97a73644-7271-48e4-ba4c-42455a5e9f16 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1281 microversion: 2.1 time: 0.352116 Aug 27 20:57:07.254633 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1187/2274] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:06 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1281 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:07.804111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:07.805339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:07.828211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:07.829152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:07.832023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:07.834300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:07.836094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:07.838758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:07.885610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:07.886320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:07.905550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:07.908162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:07.912042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:07.913321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:07.914047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:07.915595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:08.795090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:08.805351 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d190aae-f915-4ac7-8112-6064f82eaff5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 1.015591 Aug 27 20:57:08.809343 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1088/2275] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:07 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:08.823247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:08.824764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:08.843699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:08.844440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:08.848772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:08.849632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:08.850169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:08.850654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:08.916103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:08.926028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77095f70-f918-45a7-bfff-e759be203762 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1473 microversion: 2.1 time: 1.045373 Aug 27 20:57:08.938202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1188/2276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:07 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1473 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:09.485765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:09.500057 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-299bff7d-a6ad-41bb-80c3-de693ad6f83c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.688772 Aug 27 20:57:09.501893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1089/2277] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:08 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:09.830816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:09.831751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:09.854502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:09.869667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:09.871006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:09.874012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:09.874970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:09.877028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:09.963278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:09.964076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:09.975509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:09.980837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:09.983600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:09.992240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:09.992843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:09.993550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.540763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:10.561624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f546d89-d6bf-47d0-b605-72cb872693c1 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1470 microversion: 2.1 time: 0.606189 Aug 27 20:57:10.562732 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1090/2278] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:09 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:10.569612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:10.570349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:10.582759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.583268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.583736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.584971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.586179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.586632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.673549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:10.690626 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6777a1c-cde8-44e7-bbbe-717448541f28 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.864347 Aug 27 20:57:10.692440 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1189/2279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:09 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:10.697778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:10.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:10.706731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.707844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.708467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.709340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.709964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.710629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.926903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-899c5495-9a79-4ccc-8e14-d0b21eaea89a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "POST /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa/action" status: 202 len: 0 microversion: 2.1 time: 0.232851 Aug 27 20:57:10.931132 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1190/2280] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:57:10 2022] POST /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:57:10.949337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:10.951759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:10.972607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.973517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.975951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:10.976726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:10.978690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:10.979486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:11.183975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:11.196989 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ae428c0-48c2-45e1-b241-dc3995c06502 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.631664 Aug 27 20:57:11.201269 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1091/2281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:10 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:11.505646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-74068768", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "40025f32-3df2-42b0-95d7-8bccd69874e4"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:11.565800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:11.582513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0fdcf8a6-6bd6-414d-a914-d272edaa3e7f tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.644532 Aug 27 20:57:11.583929 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1191/2282] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:10 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:11.716772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:11.717493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:11.731194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:11.731884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:11.732489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:11.733628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:11.736108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:11.736703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:11.889728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] validate_networks() for [('40025f32-3df2-42b0-95d7-8bccd69874e4', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:57:12.043377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:12.055074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ba15ce7-0332-4bf3-8ae6-68a45a26146d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1497 microversion: 2.1 time: 0.341629 Aug 27 20:57:12.057831 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1192/2283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:11 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1497 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:12.104958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-plugged", "status": "completed", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:12.118837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:12.119819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:12.120476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:12.138588 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Creating event network-vif-plugged:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch2-master-1 Aug 27 20:57:12.150176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:57:12.168590 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aebd5816-d70b-432b-8571-496620b57894 req-acea131b-eaf8-4ed7-9fd2-1e841dcd87e0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072541 Aug 27 20:57:12.169551 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1193/2284] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:57:12.227827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:12.229220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:12.240109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:12.241437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:12.244283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:12.245445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:12.246081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:12.255173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:13.228438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:13.247182 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50253b9f-a57c-4c55-b25d-b6d64f0ec738 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 1.028311 Aug 27 20:57:13.249460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1194/2285] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:12 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:13.265102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:13.284525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:13.285413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:13.286591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:13.320542 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] Creating event network-changed:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:57:13.339620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-dfa7ed3e-25b9-47e6-a8eb-b1e43f861989 req-a99e8370-14d5-434f-959a-78969ee7656a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088599 Aug 27 20:57:13.340619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1195/2286] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:13.359578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:13.360320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:13.362445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:13.394093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:13.396013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:13.400147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:13.404275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:13.405183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:13.405709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:13.406925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:13.461012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:13.887862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:13.975362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:57:13.975793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:57:13.976383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:57:13.977178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:57:13.978393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:57:14.005185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.007148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.008107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.011689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.012411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.013052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.065409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Getting quotas for project b4333f6ff7d146e282200d1b867cd168. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:57:14.067523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:14.080621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Getting quotas for user cb4a8d269a8e42c58f71606a1bb244ac and project b4333f6ff7d146e282200d1b867cd168. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:57:14.081212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfa7f3be-e6f4-44cb-9f8c-019fed718b6b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.738941 Aug 27 20:57:14.101178 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1196/2287] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:13 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:14.109843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:14.110953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:14.115069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:57:14.127805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:57:14.130025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.135773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.136434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.137363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.137999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.138599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.217755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:14.287420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2de8e5e7-e86a-40b1-a7b3-666a8112cd9d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.071536 Aug 27 20:57:14.298849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1092/2288] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:57:14.322561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:14.323626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:14.331953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.332881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.333572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.335238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:14.336124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:14.336815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:14.843962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:14.854739 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5d7d3ec-8af7-49d9-8c86-a2db544eb89a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 200 len: 1474 microversion: 2.1 time: 0.751509 Aug 27 20:57:14.858054 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1197/2289] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:14 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 1474 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:14.871611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:14.873495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:15.115652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:15.130259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:15.131152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:15.133086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:15.137178 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfd735ae-96ed-41d1-9a0e-5046edeafea9 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1257 microversion: 2.21 time: 0.277787 Aug 27 20:57:15.138488 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1198/2290] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:14 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1257 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:15.146242 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10aaaf0a-c0da-4b3e-8dc8-8d26cb35ebc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.837651 Aug 27 20:57:15.148018 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1093/2291] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:14 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:15.162823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:15.165744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:15.167457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-68771386"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:15.181470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:15.183445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:15.184692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:15.192895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:15.194695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:15.197259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:15.203465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:15.231766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:15.238301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:15.242159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:15.245176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:15.249481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:15.252156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:15.613637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:15.627470 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5137e0f4-3150-43b0-b8b8-e9c10ffcde0a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.477473 Aug 27 20:57:15.643181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1094/2292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:15 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:15.657607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:15.772454 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-476225f9-f856-44cb-852d-2ab67bdb72b2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4/action" status: 202 len: 0 microversion: 2.1 time: 0.628886 Aug 27 20:57:15.781945 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1199/2293] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:57:15 2022] POST /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:57:15.794895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8c67f6be-81e0-4332-9849-0e887656e6f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857bad9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:15.924214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8c67f6be-81e0-4332-9849-0e887656e6f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.134524 Aug 27 20:57:15.924914 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1095/2294] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:15 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:16.171318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:16.172052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:16.174505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:16.175439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:16.189193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.191426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.191880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.192750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.203039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.203806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.204142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.204711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.205319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.205464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.205940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.206636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.359242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:16.367869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:16.372021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:16.376349 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3b2ceac9-8802-44d5-816f-f619fb161890 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1253 microversion: 2.21 time: 0.214271 Aug 27 20:57:16.383028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1200/2295] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:16 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1253 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:16.604633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:16.621614 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ab30f41-e36a-4538-8611-d39865158282 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.453006 Aug 27 20:57:16.622958 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1096/2296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:16 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:16.652849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:16.653921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:16.666110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.666986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.667843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.668773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:16.669478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:16.670140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:16.940024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd8a24ea-3b20-45c0-97cc-3cd1331cd64f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857ca1ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:17.041544 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd8a24ea-3b20-45c0-97cc-3cd1331cd64f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.105375 Aug 27 20:57:17.042244 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1097/2297] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:16 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:17.062455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:17.084049 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc27e0cf-ab76-4bef-ab9c-4c50e06925d9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.435442 Aug 27 20:57:17.086337 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1201/2298] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:16 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:17.396680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef0f7fdd-a01f-499a-9bb4-3bf6e189d247 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] Calling method '.version_select at 0x7ff857c520d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:17.405792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:17.407566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:17.422949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:17.424489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:17.425327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:17.426374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:17.427116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:17.427859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:17.638708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:17.653221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:17.659071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:17.660878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e6873fb-1452-4f71-90cc-1a53c3b0569a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1309 microversion: 2.21 time: 0.259243 Aug 27 20:57:17.672667 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1202/2299] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:17 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:17.675061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:17.676371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:17.694782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:17.695314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:17.698776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:17.699722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:17.700223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:17.700679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:18.269166 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef0f7fdd-a01f-499a-9bb4-3bf6e189d247 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 6722 microversion: 2.1 time: 1.182905 Aug 27 20:57:18.269789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1098/2300] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:57:17 2022] GET /compute/v2.1/os-networks => generated 6722 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:18.276619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36e197bc-eacd-46fc-bd2f-4202fece81e7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857bade50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:18.366043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36e197bc-eacd-46fc-bd2f-4202fece81e7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.094579 Aug 27 20:57:18.366914 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1099/2301] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:18 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:18.377690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:18.378557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:18.397299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:18.397971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:18.398208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:18.398912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:18.404945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:18.405624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:18.670035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:18.686223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-062605c2-56dc-4e0d-8cda-a2773f005d49 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 1.020226 Aug 27 20:57:18.704950 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1203/2302] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:17 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:18.704950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5136a299-35ef-4ad4-ba59-2b6f69eaf8b4 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] Calling method '.version_select at 0x7ff84f1f25e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:18.999196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:19.028086 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1252a869-b3e8-4c8e-a08c-bfdb4741f37b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.659913 Aug 27 20:57:19.036332 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1100/2303] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:18 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:19.064681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:19.066450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:19.111224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:19.115772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:19.122209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:19.123885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:19.124376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:19.127115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:19.130284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5136a299-35ef-4ad4-ba59-2b6f69eaf8b4 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks/ec7c1b95-2dc9-4874-b493-291fb9275706" status: 200 len: 652 microversion: 2.1 time: 0.436018 Aug 27 20:57:19.131285 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1204/2304] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 20:57:18 2022] GET /compute/v2.1/os-networks/ec7c1b95-2dc9-4874-b493-291fb9275706 => generated 652 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:19.142439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09ec8b40-5328-410f-9931-eed17b5da1c3 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] Calling method '.version_select at 0x7ff84f1ecb80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:19.619173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:19.631151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:19.632993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:19.635192 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c88308b-1cd7-4e81-a8ba-a2e3e9842d79 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1315 microversion: 2.21 time: 0.594863 Aug 27 20:57:19.636467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1101/2305] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:19 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:19.646854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0cb4705b-3685-40e2-888f-dd251cfbdec8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c683a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:19.717687 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0cb4705b-3685-40e2-888f-dd251cfbdec8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.076068 Aug 27 20:57:19.718480 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1102/2306] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:19 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:19.731845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-unplugged", "status": "completed", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:19.743563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:19.744046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:19.744477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:19.757226 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Creating event network-vif-unplugged:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:57:19.765715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:57:19.780209 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-27a6bd5a-fb2a-41e9-b53d-4ef5162a489e req-62645a79-d854-4265-b2f7-4543b71b1fe9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060158 Aug 27 20:57:19.782181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1103/2307] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:19.787869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:19.788752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:19.795317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:19.795835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:19.796278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:19.796982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:19.797438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:19.797866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:19.848815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09ec8b40-5328-410f-9931-eed17b5da1c3 tempest-NetworksTest-746165055 tempest-NetworksTest-746165055-project-admin] 10.222.0.40 "GET /compute/v2.1/os-networks" status: 200 len: 6722 microversion: 2.1 time: 0.705982 Aug 27 20:57:19.872842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1205/2308] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:57:19 2022] GET /compute/v2.1/os-networks => generated 6722 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:20.054699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:20.055638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:20.074569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:20.078317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:20.079043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:20.083555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:20.086106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:20.086886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:20.184899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:20.204053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-98fc4ac0-27a8-434b-ac5c-3b26ae15a64d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.420300 Aug 27 20:57:20.209296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1104/2309] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:19 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:20.669269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:20.669899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:20.673172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:20.685320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a755327a-d900-4ccd-9336-1c43245db348 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.633408 Aug 27 20:57:20.685616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:20.686235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:20.686565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:20.688504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1206/2310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:20 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:20.691889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:20.692415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:20.692902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:20.733861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dee3d2b1-263d-49e3-9463-8145b9916196 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84eeb7ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:20.844019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dee3d2b1-263d-49e3-9463-8145b9916196 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.110455 Aug 27 20:57:20.844676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1207/2311] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:20 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:21.136860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:21.158077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:21.161340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:21.164534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4cfd8e87-fc5e-49eb-a7e1-bed1e01eefa1 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.499111 Aug 27 20:57:21.181198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1105/2312] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:20 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:57:21.230256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:21.231607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:21.242303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.243044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.243718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.244603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.245361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.246034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.348581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "name": "network-vif-plugged", "status": "completed", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:21.360082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.360559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.361062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.379093 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] Creating event network-vif-plugged:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:57:21.391048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-82951cd8-5b49-4b55-878a-c0b967a82e2f req-b4dab16e-6f66-4793-a565-279a7daeb798 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046715 Aug 27 20:57:21.393902 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1106/2313] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:21.715874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:21.717884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:21.735767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.737891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.738660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.739741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.741435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.745289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.780520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:21.797153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-031f7ba7-a520-4a66-874c-29852b6023f5 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.571312 Aug 27 20:57:21.798302 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1208/2314] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:21 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:21.860712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21bf50a4-4e64-460a-9dbb-a83a6254b449 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ee8ac10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:21.921794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21bf50a4-4e64-460a-9dbb-a83a6254b449 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.065017 Aug 27 20:57:21.923276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1209/2315] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:21 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:21.929038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:21.940131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:21.940932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:21.941680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:21.956990 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Creating event network-changed:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:57:21.963945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 20:57:21.988796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a4b8fe2d-f7f4-4fdd-a6b7-113ee78a8636 req-2849b8c6-169c-41b3-9017-26eba0bb1665 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063366 Aug 27 20:57:21.990076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1210/2316] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:22.196799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:22.208508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:22.222872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:22.246769 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd56d54b-9763-42cb-b6ab-09f0d168b462 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.529895 Aug 27 20:57:22.253925 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1107/2317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:21 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:22.258081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:22.264921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:22.266113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:22.277026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:22.277787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:22.281605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:22.713853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:22.723879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:22.730405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:22.735147 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e301c487-ff0a-4d8d-aef3-3c31d321173b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.546339 Aug 27 20:57:22.736020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1211/2318] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:22 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:57:22.820048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:22.821451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:22.840273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:22.842859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:22.848490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:22.855704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:22.857846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:22.860034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:22.944278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c7c8bc5-7cb5-4b68-a208-7a41c9b63f2b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ee75ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:23.029126 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c7c8bc5-7cb5-4b68-a208-7a41c9b63f2b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.094776 Aug 27 20:57:23.038600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1212/2319] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:22 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:23.422523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:23.439146 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06f35a59-0b21-43ad-ae43-5cd948d732fb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.624111 Aug 27 20:57:23.440567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1108/2320] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:22 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:23.450707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:23.451672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:23.464767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.465267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.465706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.466784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.471217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.475091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.478387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:23.481031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.481909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.482528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.485796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.486465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.489490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.545902 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfefb7d3-a1e4-4644-a7cb-47f87eef2a95 tempest-AZV2TestJSON-228401687 tempest-AZV2TestJSON-228401687-project] 10.222.0.40 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.505722 Aug 27 20:57:23.555138 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1213/2321] 10.222.0.40 () {58 vars in 1164 bytes} [Sat Aug 27 20:57:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:57:23.561633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df002a9-8f41-4e21-be95-8c45b19650d4", "name": "network-vif-plugged", "status": "completed", "tag": "47546445-4ed3-45b8-9cd5-87701a0d33c3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:23.578227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.579211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.579961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.601145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] Creating event network-vif-plugged:47546445-4ed3-45b8-9cd5-87701a0d33c3 for instance 0df002a9-8f41-4e21-be95-8c45b19650d4 on nch2-master-1 Aug 27 20:57:23.609504 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ecd79ae7-09de-44d2-accc-8f67fdaae039 req-cfd28a30-b7eb-41e8-9d1d-48f683c0309f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052966 Aug 27 20:57:23.610865 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1214/2322] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:23.762591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:23.763560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:23.780956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.781724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.782869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:23.784963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:23.786201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:23.786797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:24.050233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:24.104311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:24.305079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:24.324551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca56534a-d2ff-46d4-b2c6-e3a8da0a78d2 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.880755 Aug 27 20:57:24.327481 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1109/2323] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:23 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:24.339787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a1f992e-a435-45bf-8010-bf6cac342704 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ea8df70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:24.431688 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a1f992e-a435-45bf-8010-bf6cac342704 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.101430 Aug 27 20:57:24.433687 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1110/2324] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:24 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:24.448066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f5f9b5-d740-47e8-bc74-5ae81da7f876", "tag": "0fbd8868-6cd8-459a-bddd-f65a63d82060"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:24.460399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:24.462107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:24.462754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:24.482101 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] Creating event network-changed:0fbd8868-6cd8-459a-bddd-f65a63d82060 for instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 on nch2-master-1 Aug 27 20:57:24.490580 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e1b0ac52-44b4-448f-8e7a-bd97815fcae2 req-fec2ea70-9832-452c-ab2f-ea8379a75beb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Aug 27 20:57:24.491895 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1111/2325] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:24.498177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:24.499174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:24.507622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:24.508341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:24.509081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:24.510227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:24.514049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:24.516176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:24.552141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:24.580195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:24.590111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:24.598074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ffa0a9f8-6578-4634-977b-848131281a8d tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.839044 Aug 27 20:57:24.598812 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1215/2326] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:23 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:57:24.889706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:24.905982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:24.922885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db9c27cc-e765-4d89-9261-1e87fd7085ed tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1323 microversion: 2.1 time: 0.429546 Aug 27 20:57:24.924291 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1112/2327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:24 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:25.349896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:25.351144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:25.357228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:25.360481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:25.361441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:25.362513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:25.363331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:25.364049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:25.364827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:25.451099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f418050-c79c-4236-a0d1-458316d8a7c4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857bad430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:25.570129 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f418050-c79c-4236-a0d1-458316d8a7c4 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.124686 Aug 27 20:57:25.571142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1113/2328] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:25 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:25.628667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:25.629283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:25.643931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:25.645670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:25.646122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:25.653088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:25.653390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:25.657366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:26.050359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.071228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-203ec062-9b20-4768-bb89-24e6af27e50c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1469 microversion: 2.1 time: 0.726661 Aug 27 20:57:26.084040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1216/2329] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:25 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1469 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:26.104458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:26.107333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:26.123041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:26.125409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:26.128403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:26.130644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:26.132763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:26.134367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:26.397147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.411665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.416041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.422848 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-71fae93a-9fdc-4f36-b515-5c39eceb0f77 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.798384 Aug 27 20:57:26.427266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1114/2330] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:25 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:26.579790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.589148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52ab2c48-db4d-48ae-8037-e266253c5aa2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857cd6e50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:26.647664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39df3781-d3a2-4a75-bf81-03ba284e833d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1519 microversion: 2.1 time: 0.549028 Aug 27 20:57:26.652629 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1217/2331] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:26 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1519 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:26.675509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:26.695885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:26.697837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Searching by: {'deleted': False, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:57:26.716432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52ab2c48-db4d-48ae-8037-e266253c5aa2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.132424 Aug 27 20:57:26.720220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1115/2332] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:26 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:26.737100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:26.739892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:26.742181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4bd038b-7e8f-46c9-890d-ca3c0e528ba6 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'create', calling method: .version_select at 0x7ff84ea8d430>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:26.745277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:26.746327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:26.754505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:26.758243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:27.087370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:57:27.320959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-978f53eb-2219-4d97-929a-99ed3a22cfe5 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.665809 Aug 27 20:57:27.323724 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1218/2333] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:57:26 2022] GET /compute/v2.1/servers => generated 339 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:27.774828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-453455036", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:27.878388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:57:27.884144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:57:27.884845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:57:27.885522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:57:27.886224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:57:27.903393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:27.907981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:27.908675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:27.909728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:27.911559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:27.912201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:27.970796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Getting quotas for project 2c87d822a4584ee197f10a45d11e852f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:57:27.981910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Getting quotas for user 7f446eacb5e5437393b633aa2534be42 and project 2c87d822a4584ee197f10a45d11e852f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:57:28.010872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:57:28.018112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:57:28.149024 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd406016-4841-4417-8aaa-a6f6c929c761 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.822393 Aug 27 20:57:28.158303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1219/2334] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 20:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 20:57:28.170862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:28.172486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:28.200824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:28.201653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:28.208590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:28.209606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:28.218533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:28.232656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:28.795203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:28.806678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b08f82b5-130d-4108-8262-73b6f52880c3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1462 microversion: 2.1 time: 0.646567 Aug 27 20:57:28.807289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1220/2335] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:28 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1462 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:28.814525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:28.825177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:28.828223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Searching by: {'deleted': False, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:57:28.844776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:28.844776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:28.845110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:28.849380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:28.852221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:28.853042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:29.060800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:57:29.263419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:29.276036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:29.279718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:29.280407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:29.285041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:29.707284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c61c39d5-78ff-4440-bb94-8e0e6525f001 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.895835 Aug 27 20:57:29.708304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1221/2336] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:57:28 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:29.713385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:29.714198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:29.727578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:29.732283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:29.732920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:29.733866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:29.734487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:29.740721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.030302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.040618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.045448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.046698 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1abdaaf6-59f1-4e59-99ad-3e4c5556331b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.337247 Aug 27 20:57:30.047259 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1222/2337] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:29 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:30.054395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b5ee46c-05bf-4167-bd1e-923753c63c76 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84eeb7790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:30.143955 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b5ee46c-05bf-4167-bd1e-923753c63c76 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.093068 Aug 27 20:57:30.144640 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1223/2338] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:30 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:30.430386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-250fba76-5b81-4047-a558-fd5febcbc007 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] Calling method '.version_select at 0x7ff84f9c5160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:30.465082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-250fba76-5b81-4047-a558-fd5febcbc007 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.312428 Aug 27 20:57:30.466690 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1224/2339] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:57:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:30.489764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:30.490714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:30.505325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:30.506602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:30.507203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.508177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:30.508833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:30.509403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.522327 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4bd038b-7e8f-46c9-890d-ca3c0e528ba6 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.800776 Aug 27 20:57:30.523381 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1116/2340] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:57:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:30.749144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.761916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.763770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:30.765249 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca584322-6201-4f30-801f-a32bdb079944 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1332 microversion: 2.47 time: 0.280313 Aug 27 20:57:30.781272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1225/2341] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:30 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:30.789573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-plugged", "status": "completed", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:30.802234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:30.803025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:30.803699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.842086 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] Creating event network-vif-plugged:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:57:30.899166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:30.900649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:30.920970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:30.925064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:30.925064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.926902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:30.927649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:30.928333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:30.931358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-55de4689-8afe-4315-aedb-9af2c05396e8 req-03aa3c08-8919-4695-9413-939a9e59df1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148410 Aug 27 20:57:30.932133 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1226/2342] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:30.937458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-259de901-8426-45df-bd12-1d04257a05e8 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:30.958618 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-259de901-8426-45df-bd12-1d04257a05e8 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024880 Aug 27 20:57:30.962058 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1227/2343] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:57:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:30.975116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0dc5ef05-ff6e-49a0-ad3c-9bb3547d2323 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] Action: 'update', calling method: .version_select at 0x7ff84fb89670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:31.159306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ee5adff-fbfe-43e1-9459-2843d75123c3 tempest-MigrationsAdminTest-1992869928 tempest-MigrationsAdminTest-1992869928-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1613 microversion: 2.1 time: 0.634548 Aug 27 20:57:31.162070 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1117/2344] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:30 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1613 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:31.173153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-404010008", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "4f261ca6-acbc-469d-a994-54baa54a161a"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:31.250105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:UPDATE=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:31.315785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] validate_networks() for [('4f261ca6-acbc-469d-a994-54baa54a161a', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:57:31.562051 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0dc5ef05-ff6e-49a0-ad3c-9bb3547d2323 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.597883 Aug 27 20:57:31.563298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1228/2345] 10.222.0.40 () {60 vars in 1206 bytes} [Sat Aug 27 20:57:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:31.568602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:31.569432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:31.587124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:31.588044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:31.588520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:31.589275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:31.589731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:31.590164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:31.859443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:31.868983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:31.883178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:31.884703 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4def25ea-1cf7-4cb0-a087-6367a68e3233 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.320226 Aug 27 20:57:31.885455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1229/2346] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:31 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:31.899225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e8e72fc-83c9-4af4-92ac-7daf29f9e903 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ee75af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:31.970357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:57:31.970808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:57:31.971285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:57:31.972060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:57:31.972600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:57:31.977756 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e8e72fc-83c9-4af4-92ac-7daf29f9e903 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.090998 Aug 27 20:57:31.978571 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1230/2347] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:31 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:31.994367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:31.994867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:31.995309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:31.996068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:31.999467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.000141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.000829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.001497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.020910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.021794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.021917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.022584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.023053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.028866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.039112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Getting quotas for project dced4e2c73df4f4485ef8442b0afe00e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:57:32.045604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Getting quotas for user 8c6a5cc460f744ee8b958eafbe2e995b and project dced4e2c73df4f4485ef8442b0afe00e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:57:32.060190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:32.076834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:57:32.079274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:57:32.157253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9fb38d3-1fb4-415d-8ea9-3cf5da2fdb96 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993478 Aug 27 20:57:32.165601 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1118/2348] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:57:32.172543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.173295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.184077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.185534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.185984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.187527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.187998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.189864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.220332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-821c4530-6468-48da-931c-6841c02733af tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 204 len: 0 microversion: 2.1 time: 0.232836 Aug 27 20:57:32.223894 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1231/2349] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:57:31 2022] DELETE /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:57:32.234578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7bd2b74-a8a4-4daf-b44e-53926bfee052 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] Calling method '.version_select at 0x7ff84fde3040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.251606 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7bd2b74-a8a4-4daf-b44e-53926bfee052 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.025124 Aug 27 20:57:32.262198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1232/2350] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:32.264620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:32.267915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.268937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.276244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.276836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.277201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.277910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.278368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.278846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.400523 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d7d0e073-f5dd-4dfa-93e1-b71c3d89a871 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "DELETE /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 204 len: 0 microversion: 2.1 time: 0.232116 Aug 27 20:57:32.401223 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1119/2351] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:57:32 2022] DELETE /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:57:32.404769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.412056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4e7e49a-6698-423e-9bc1-b8790edc9959 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.414017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4e7e49a-6698-423e-9bc1-b8790edc9959 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.419801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.421817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.423010 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85fc7bbf-7bb1-4f77-9f56-06e13b727482 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1338 microversion: 2.47 time: 0.159732 Aug 27 20:57:32.423608 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1233/2352] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:32.438744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.439380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.453109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.453556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.454204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.454920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.455453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.455973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.500186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4e7e49a-6698-423e-9bc1-b8790edc9959 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.518229 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4e7e49a-6698-423e-9bc1-b8790edc9959 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1223 microversion: 2.1 time: 0.115446 Aug 27 20:57:32.521112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1120/2353] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:32.540964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-09d99278-c34e-46d6-94fd-480dd723a502 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] Action: 'update', calling method: .version_select at 0x7ff857c529d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:32.700111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.713997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d02b8884-38a4-427e-8bd9-d7dc40a1c3b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1468 microversion: 2.1 time: 0.286434 Aug 27 20:57:32.715037 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1234/2354] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:32.721942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.722724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.731161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.732819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.733357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.734173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.734802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.735244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.750607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-09d99278-c34e-46d6-94fd-480dd723a502 tempest-QuotaClassesAdminTestJSON-1827297616 tempest-QuotaClassesAdminTestJSON-1827297616-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.216306 Aug 27 20:57:32.751220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1121/2355] 10.222.0.40 () {60 vars in 1206 bytes} [Sat Aug 27 20:57:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:32.915510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:32.916459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:32.930099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.933446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.935017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.938352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:32.939161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:32.940431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:32.962199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:32.972346 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a23101d-1e23-4fa1-9b28-1f189e1e2ae3 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1714 microversion: 2.1 time: 0.255035 Aug 27 20:57:32.973202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1235/2356] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1714 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:33.022660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b6d62d7-0e00-41e1-b9aa-b2e3075b2239 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f1c9af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:33.116041 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b6d62d7-0e00-41e1-b9aa-b2e3075b2239 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.126229 Aug 27 20:57:33.117181 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1236/2357] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:33.127388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f5f9b5-d740-47e8-bc74-5ae81da7f876", "name": "network-vif-plugged", "status": "completed", "tag": "0fbd8868-6cd8-459a-bddd-f65a63d82060"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:33.150518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.155289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.156093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.180051 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] Creating event network-vif-plugged:0fbd8868-6cd8-459a-bddd-f65a63d82060 for instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 on nch2-master-1 Aug 27 20:57:33.188045 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a12721b1-7234-4279-b676-f7a6faee95f4 req-0e2a7a09-8a9d-4ee7-ac67-934812391427 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066593 Aug 27 20:57:33.200073 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1237/2358] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:33.244666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.267091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.269664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.272560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5caf1490-520d-4956-9681-62b89d0d5c3f tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.362768 Aug 27 20:57:33.273667 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1122/2359] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:32 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:33.448781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:33.449491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:33.474203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.476621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.477097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.477827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.478293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.478778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.545821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:33.546861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:33.555209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.556044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.557072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.557939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.558659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.559235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.705020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.713741 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a90b532-a7ba-4d1e-b9de-0dc25233fc3f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1219 microversion: 2.1 time: 0.176211 Aug 27 20:57:33.720589 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1123/2360] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:33 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:33.740402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:33.741265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:33.749056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.752256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.756721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.757263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:33.757722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:33.758262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:33.765924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.787767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.789515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:33.791039 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9982458a-3a9f-4577-be1b-e4a2add7832b tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1338 microversion: 2.47 time: 0.347488 Aug 27 20:57:33.792270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1238/2361] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:33 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1338 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:33.996807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:33.998125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:34.017913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:34.019872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.023935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.024725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:34.027931 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7373cb3-bed2-4239-a744-7183fe7fd226 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1468 microversion: 2.1 time: 0.292708 Aug 27 20:57:34.034965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1124/2362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:33 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1468 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:34.040766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.041418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.041876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:34.137066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-65e55e29-8ac3-4a3c-b216-62348aad7da8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84eab10d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:34.234476 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-65e55e29-8ac3-4a3c-b216-62348aad7da8 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.106844 Aug 27 20:57:34.240360 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1125/2363] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:34 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:34.295457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:34.296134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:34.304163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.308092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.312291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:34.313337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.313988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.314609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:34.938725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:34.957816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab51ab53-312b-488a-b94f-e73d4208ef66 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1714 microversion: 2.1 time: 0.963755 Aug 27 20:57:34.958826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1239/2364] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:33 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1714 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:34.964441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:34.967268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:34.988441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.989054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.991449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:34.993092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:34.993772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:34.994472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:35.114183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.127284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.135148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.136771 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dfd5f9dc-ec16-489d-b0e4-69f5fc3436ee tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1357 microversion: 2.21 time: 0.845986 Aug 27 20:57:35.138974 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1126/2365] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:34 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1357 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:57:35.156700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:35.157872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:35.168362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.169751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:35.170426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:35.171003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:35.172076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:35.172954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:35.173528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:35.186658 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c42a9f36-16ca-42a5-a81d-69af236073c4 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1275 microversion: 2.1 time: 0.226263 Aug 27 20:57:35.209437 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1240/2366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:34 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:35.227918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:35.228547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:35.250553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:35.251297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:35.253659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:35.256376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:35.257043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:35.257512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:35.328136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.337565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.339452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.341000 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-997c7479-09cb-4e65-becc-50e2aa65269e tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1338 microversion: 2.47 time: 0.197068 Aug 27 20:57:35.355362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1127/2367] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:35.505042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:35.515016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52305ad1-283c-44b3-8194-cc04cadabe69 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1468 microversion: 2.1 time: 0.299078 Aug 27 20:57:35.515765 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1241/2368] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:35.521730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1501ffce-a78c-4e31-bb37-37696077435f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f2bc790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:35.583153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1501ffce-a78c-4e31-bb37-37696077435f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.066175 Aug 27 20:57:35.584598 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1242/2369] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:35.598970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91179aed-ac55-49a2-af8d-0601ad3c2a90 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] Calling method '.version_select at 0x7ff857cf6550>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:35.614393 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91179aed-ac55-49a2-af8d-0601ad3c2a90 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.264903 Aug 27 20:57:35.614983 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1128/2370] 10.222.0.40 () {60 vars in 1226 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:57:35.628618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e080ce13-4640-43fc-b3c3-e7603113817f tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f0eedc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:35.777888 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e080ce13-4640-43fc-b3c3-e7603113817f tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.155532 Aug 27 20:57:35.789798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e113faf-d8b9-4563-8278-fc43eea027b9 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] Calling method '.version_select at 0x7ff857cf60d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:35.796920 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1243/2371] 10.222.0.40 () {62 vars in 1247 bytes} [Sat Aug 27 20:57:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:57:35.799041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=13 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:35.806174 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e113faf-d8b9-4563-8278-fc43eea027b9 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020072 Aug 27 20:57:35.812628 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1129/2372] 10.222.0.40 () {60 vars in 1226 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:57:35.829345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a35330ea-2b66-41f1-98dd-94a25aff39e6 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f250820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:35.956810 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a35330ea-2b66-41f1-98dd-94a25aff39e6 tempest-QuotaClassesAdmin257Test-1900258517 tempest-QuotaClassesAdmin257Test-1900258517-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.141602 Aug 27 20:57:35.959823 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1244/2373] 10.222.0.40 () {62 vars in 1247 bytes} [Sat Aug 27 20:57:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:57:36.000778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.012888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.032001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.032510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.032954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.033793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.034438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.034438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.163227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.164889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.167459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=70,nova_api:UPDATE=21 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:36.185047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.187769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.188378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.192939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.194709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.197028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.374150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.383600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-624285c3-47a2-4fc1-814a-f3e47dbfd28c tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1714 microversion: 2.1 time: 0.406466 Aug 27 20:57:36.387058 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1130/2374] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:35 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1714 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:36.393956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.399876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.416380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.424168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.425006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.426316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.426921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.427876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.521433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.543855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.547127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.551789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9eccb545-a099-4abe-98a9-552c3b265543 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1549 microversion: 2.21 time: 0.390942 Aug 27 20:57:36.552472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1245/2375] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:36 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1549 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:36.562792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.563663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.570230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.582304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36b0a2ac-a82e-4afb-a89c-6f2d1015475a tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1281 microversion: 2.1 time: 0.191982 Aug 27 20:57:36.587776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.589541 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1131/2376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:36 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:36.592456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.593169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.594090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.599990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.605635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.605930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.606622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.629614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.630149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.630594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.631334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.631817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.632265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.743122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.754937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.757004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.758395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7d2e990-c8df-4735-b19d-d68aa4a4b3df tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1338 microversion: 2.47 time: 0.199661 Aug 27 20:57:36.772212 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1246/2377] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:36 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1338 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:36.783214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.784094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:36.791518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.800783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.807447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.808412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:36.810481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:36.811942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:36.871539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:36.872547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:36.884158 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1021c0b1-96c0-4958-a45e-1eba786759e0 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1468 microversion: 2.1 time: 0.293140 Aug 27 20:57:36.885325 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1132/2378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:36 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:36.890572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:36.890719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19c68c5b-52e0-4a3f-beaf-5b946dcce02c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c7f430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:36.976413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19c68c5b-52e0-4a3f-beaf-5b946dcce02c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.089683 Aug 27 20:57:36.977170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1133/2379] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:36 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:37.016781 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-653f7d87-5214-41f0-9c2d-0b546fa62d44 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 204 len: 0 microversion: 2.21 time: 0.241934 Aug 27 20:57:37.021333 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1247/2380] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:57:36 2022] DELETE /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:57:37.030457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:37.031112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:37.051741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.054007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.056116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.059584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.062356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.067079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.295240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.311556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.313362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.314748 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97dba658-56e7-437e-bf66-ea34523c94c2 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1555 microversion: 2.21 time: 0.292040 Aug 27 20:57:37.335884 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1134/2381] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:37 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1555 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:37.413440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:37.414314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:37.440393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.443807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.445461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.446398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.452790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.456714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.616326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:37.616976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:37.630996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.631666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.632985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.633754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.636882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.639479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.783001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.802191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2fc82451-a194-4041-942c-51766b2b5f21 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1714 microversion: 2.1 time: 0.395521 Aug 27 20:57:37.803557 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1248/2382] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:37 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1714 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:37.814882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:37.816519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:37.828491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.829486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.830875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.832341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:37.833134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:37.833764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:37.977171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.989514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.993959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.996886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:37.998940 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a37d48a-f1f7-4a9a-b9d6-3148e489eb1d tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.386640 Aug 27 20:57:38.002291 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15c73896-9114-4ff9-a359-dabc44d5c3bf tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1338 microversion: 2.47 time: 0.195912 Aug 27 20:57:38.015410 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1249/2383] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:37 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:38.016651 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1135/2384] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:37 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:38.018981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.018981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:38.025285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c1358682-9117-4b98-a374-34ba08053c57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857cf6310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.047940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.052503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.052503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.052503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.052503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.053167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.090292 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c1358682-9117-4b98-a374-34ba08053c57 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.072159 Aug 27 20:57:38.092101 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1136/2385] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:38.344587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.345509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:38.357135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.358410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.368211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.369261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.369899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.370805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.699625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:38.714559 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a2716a1-099e-46e1-90be-cbaccb1a45f9 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1468 microversion: 2.1 time: 0.707153 Aug 27 20:57:38.728333 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1250/2386] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1468 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:38.781002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:38.789649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:38.791132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:38.792357 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87c29e05-6c2d-49b7-a52f-d7ca03cb243a tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1555 microversion: 2.21 time: 0.453938 Aug 27 20:57:38.820316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1137/2387] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1555 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:38.829097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.829985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:38.850954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.851714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.852335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.853260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.853895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.854497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.900489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:38.912424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.917321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.918470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.920119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.921570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.922298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.922881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.956598 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e74739c3-9b95-48a9-bdc1-9ef6ac488912 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.225385 Aug 27 20:57:38.958046 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1251/2388] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/os-services => generated 947 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:38.970989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:38.977503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.978511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.979248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:38.980173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:38.980924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:38.981524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.022461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58085e22-2377-408b-bf77-349c9b8a1e8f tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.056181 Aug 27 20:57:39.024788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1252/2389] 10.222.0.40 () {58 vars in 1174 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:57:39.030228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.031052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:39.040637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.041539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.042448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.043580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.044535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.045463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.154738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.164114 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35da82fb-8a1f-4029-9339-9cb2cdc0cb20 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1714 microversion: 2.1 time: 0.340261 Aug 27 20:57:39.168054 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1138/2390] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:38 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1714 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:39.176355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.185851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.192492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.193431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.194568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.195077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.195520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.245615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4a30cbf-6922-4cd0-b04a-69a0d2f29cd7 tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076025 Aug 27 20:57:39.253281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1139/2391] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:39.258883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.264699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:39.297261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.298055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.298676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.299716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.300361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.300969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.456730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.469824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.475407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.481084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.485945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b8d3c89-256e-4553-b999-e6dfd00caf12 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.459915 Aug 27 20:57:39.486734 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1253/2392] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:39.489621 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac7de004-e23c-4b8c-97ea-aa24a11715f4 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1359 microversion: 2.47 time: 0.234690 Aug 27 20:57:39.493220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1140/2393] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:39.527777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29268091-9732-4f12-baad-8b5910ed0077 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f360a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.543551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.568063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.573416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.574987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.576327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.578710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.580349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.658939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29268091-9732-4f12-baad-8b5910ed0077 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.160565 Aug 27 20:57:39.662829 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1254/2394] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:39.683072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-952211825"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:39.693678 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c64ef52-b9c8-485b-b11b-3118feab038e tempest-ServicesAdminTestJSON-1132266409 tempest-ServicesAdminTestJSON-1132266409-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.175487 Aug 27 20:57:39.695802 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1141/2395] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/os-services => generated 947 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:39.712718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:39.738558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:39.739190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:39.755676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.755794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.756122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.756559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.757257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.757710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.758135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.767844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.772893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.776989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:39.781632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:39.782115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:39.960632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:39.981363 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12e6e8f3-4d9e-4d9d-bdf5-934fc01050e7 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1426 microversion: 2.1 time: 0.237202 Aug 27 20:57:39.982046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1142/2396] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1426 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:40.008558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:40.011100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:40.029724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.031933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.032772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.039389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.040118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.041503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.273459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-061b0b56-894c-4db6-8436-9e72e866a400 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "POST /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d/action" status: 202 len: 52 microversion: 2.47 time: 0.607306 Aug 27 20:57:40.295763 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1255/2397] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 20:57:39 2022] POST /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d/action => generated 52 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 27 20:57:40.342529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:40.343303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:40.373537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.374272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.374914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.382082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.382607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.383270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.744509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:40.763376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e6d50ff-8a7c-4361-93d5-9930002f8bc4 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1646 microversion: 2.1 time: 0.464553 Aug 27 20:57:40.764459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1256/2398] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:40 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1646 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:40.774795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:40.802677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:40.844597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.864066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.865081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.869382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.878189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.882945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:40.894852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:40.904469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:40.906452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:40.910019 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e722a427-548b-424e-9b49-2a7d5556d562 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1555 microversion: 2.21 time: 0.923958 Aug 27 20:57:40.927973 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1143/2399] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:39 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1555 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:40.940198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8319ba70-fc0f-47e9-8ee0-454880ce8daa", "name": "network-vif-deleted", "tag": "6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:40.969691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:40.970780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:40.985463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.057893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] Creating event network-vif-deleted:6858ea92-f53b-42ef-a3f6-b2d7bbd4bcad for instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa on nch1-master-1 Aug 27 20:57:41.075950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:41.093587 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-59e21ef2-88c3-4879-bf58-db418b1fa791 req-e547e54f-c9ca-4cee-b985-f1a8060fba46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160401 Aug 27 20:57:41.097485 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1144/2400] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:41.103758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:41.120367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:41.159133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.160725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.164043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.170272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.177108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.178461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.444732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e43f5269-ca65-4236-9fad-afda9978b5a8 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 204 len: 0 microversion: 2.47 time: 0.676683 Aug 27 20:57:41.450879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1257/2401] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:57:40 2022] DELETE /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 20:57:41.459386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6b3f97d-c7e7-49de-ba65-d30795254c5a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f3509d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:41.545981 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6b3f97d-c7e7-49de-ba65-d30795254c5a tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.096317 Aug 27 20:57:41.547760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1258/2402] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:41 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:41.557981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54664521-0e6f-4816-a130-9d1eb527c73e", "name": "network-vif-deleted", "tag": "a2838871-c26a-43fd-a359-77dd82e54c7d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:41.589970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.592327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.592916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.601827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:41.626792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] Creating event network-vif-deleted:a2838871-c26a-43fd-a359-77dd82e54c7d for instance 54664521-0e6f-4816-a130-9d1eb527c73e on nch1-master-1 Aug 27 20:57:41.631361 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e9752b2-434e-4fe8-a6d4-046b6cf62741 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.531658 Aug 27 20:57:41.632118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1145/2403] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:41 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:41.641228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6d9ab9d6-aed9-472f-b6cd-21e2d3317044 req-061e79a5-67c0-4a15-998b-321458881e02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092109 Aug 27 20:57:41.645769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1259/2404] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:41.661168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:41.663492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:41.665425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:41.666436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:41.681198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.682846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.683655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.684280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.684798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.685243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.688960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.692230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.693962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.695272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.702655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.704294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.814814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:41.821499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:41.829218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:41.830228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lazy-loading 'fault' on Instance uuid 8319ba70-fc0f-47e9-8ee0-454880ce8daa {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:41.957842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:41.978896 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c5a9d0f-4584-4be7-855d-7e3864735a6e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 200 len: 1303 microversion: 2.1 time: 0.345638 Aug 27 20:57:41.996921 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1146/2405] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:41 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 1303 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:42.012070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:42.013455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:42.041210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.043095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.056252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.059234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.059966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.064007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.124262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.125138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.126310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.127258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lazy-loading 'fault' on Instance uuid 54664521-0e6f-4816-a130-9d1eb527c73e {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:42.154694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.174170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.182693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.184011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a7b5633-de37-4336-ae03-37b5cc146ff3 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1365 microversion: 2.47 time: 0.536272 Aug 27 20:57:42.187861 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1260/2406] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:41 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:42.206822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:42.211201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:42.245188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.245732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.249591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.251811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.252357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.252834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.281920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.315782 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-242a1645-9d5e-4502-baa2-d1f5655e5499 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1367 microversion: 2.1 time: 0.317465 Aug 27 20:57:42.337841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1147/2407] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:41 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:42.358902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.359456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.359893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.368860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lazy-loading 'fault' on Instance uuid 79f5f9b5-d740-47e8-bc74-5ae81da7f876 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:42.517768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.536259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.541320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb4a8d269a8e42c58f71606a1bb244ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4333f6ff7d146e282200d1b867cd168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:42.553875 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ac959d8-b9d1-4fac-8d5d-a68bf7dd55cf tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 200 len: 1347 microversion: 2.21 time: 0.362298 Aug 27 20:57:42.558956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1261/2408] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:42 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 1347 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:42.562915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1bcd72ac-5cd5-4e57-a20d-022c1a54e37d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f58f9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:42.648535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1bcd72ac-5cd5-4e57-a20d-022c1a54e37d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.090250 Aug 27 20:57:42.657623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:42.657623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:42.659515 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1148/2409] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:42 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:42.667408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.669441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.672212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:42.673283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:42.675816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:42.677373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.011624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.011624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 8319ba70-fc0f-47e9-8ee0-454880ce8daa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.023737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.034160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c302f9ce-f233-4be6-a6e0-4f8ffe73cb73 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.384838 Aug 27 20:57:43.045948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.047023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.049828 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1262/2410] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:42 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:43.050794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.063785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.064526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.065071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.130007 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] HTTP exception thrown: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Request method failure captured: Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa HTTP/1.1 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoPh_V6iG-Yu3mvd7uCoAm40z9ydwpxasot13yXKo4_gbOwQlkkMwfgs96nzMIGdVvn-lfFeBBYWLY-Sw25zEFd4qMFaMvlUT5xQPDUYs8KbEoFl5CHMkBcmkgGMK-uR0QpcDhitFPUqhmLzlE9MNf5tCnPoKpQ7TVdSUuY7UxwB-zE Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e287f0565aa445f38277a34a29b94c9d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}] Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MigrationsAdminTest-104901767-project Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 513ac3d6ab864589b6b03554fc0ce9a8 Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MigrationsAdminTest-104901767-project Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '8319ba70-fc0f-47e9-8ee0-454880ce8daa'} Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:43.131705 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Returning 404 to user: Instance 8319ba70-fc0f-47e9-8ee0-454880ce8daa could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:43.138256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d16e582-1b86-435d-8a3b-7c8cb7202006 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa" status: 404 len: 111 microversion: 2.1 time: 0.129650 Aug 27 20:57:43.142044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.142856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.147910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1149/2411] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/8319ba70-fc0f-47e9-8ee0-454880ce8daa => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:57:43.157427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.157905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.158418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.159207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.159874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.160308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.168481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c0f46e-25c2-4eec-8880-a726ced5f23b", "tag": "dc153e44-4059-429a-a508-cf3f76521260"}, {"server_uuid": "79f5f9b5-d740-47e8-bc74-5ae81da7f876", "name": "network-vif-deleted", "tag": "0fbd8868-6cd8-459a-bddd-f65a63d82060"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:43.182139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.182626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.183071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.220195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Creating event network-changed:dc153e44-4059-429a-a508-cf3f76521260 for instance e3c0f46e-25c2-4eec-8880-a726ced5f23b on nch2-master-1 Aug 27 20:57:43.221218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] Creating event network-vif-deleted:0fbd8868-6cd8-459a-bddd-f65a63d82060 for instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 on nch2-master-1 Aug 27 20:57:43.236464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fd5d6007-40be-4252-8465-e116f49dde79 req-65b66133-82ba-4dbc-a06a-4a7de175b6e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072330 Aug 27 20:57:43.237608 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1150/2412] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:43.240597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:43.250834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.252572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.260283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.260883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.261214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.262109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.262731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.263324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.264383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:43.385648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.399448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.403539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.404905 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86aba076-b050-4dc5-8824-0234e8abfa1d tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1365 microversion: 2.47 time: 0.164670 Aug 27 20:57:43.409512 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1151/2413] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 20:57:43.417570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.420093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.439315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.440765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.441970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.445727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.447784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.448818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.482686 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f7715ff-09a1-4426-abd6-8558f375d590 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 204 len: 0 microversion: 2.1 time: 0.344060 Aug 27 20:57:43.483932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1263/2414] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:57:43 2022] DELETE /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:57:43.497384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.498130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.499757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.500598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.501204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.501823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lazy-loading 'fault' on Instance uuid 54664521-0e6f-4816-a130-9d1eb527c73e {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:43.520816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.521381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.521974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.523190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.523676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.526283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.552255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bebb885925d646d7bbfe523109df7c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5d28e239340c29ec8f7d9f9bd2653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.562185 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97d7fdb2-0634-4b94-84ff-d9c029b94c14 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 200 len: 1367 microversion: 2.1 time: 0.150234 Aug 27 20:57:43.563412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1152/2415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:43.580971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.581696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.592617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.594538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.595125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.596092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.597890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.598891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.632955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] HTTP exception thrown: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Request method failure captured: Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 HTTP/1.1 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoUm7Jw7ccTM1oM99d0VVaLoKvWpxvsgJUNpR0Zk7tInankwaS03obdxEOOgJi0uZ8yIZ9TUbv1Ve0TSQzf0MKMJIEzBJbzPi5eUUs2UNOBJb_vUIHEDadhG-6XOwYe4I1xb23n44gV9bbD2MUCWsS98OYH9BJ_IkSNvpJe5eoGGqFM Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4333f6ff7d146e282200d1b867cd168", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}] Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: cb4a8d269a8e42c58f71606a1bb244ac Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '79f5f9b5-d740-47e8-bc74-5ae81da7f876'} Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.636306 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:43.640059 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:43.658081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Returning 404 to user: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:43.661530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6bdb7f24-1024-4fc3-a441-e561effc0ce8 tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 404 len: 111 microversion: 2.21 time: 0.083622 Aug 27 20:57:43.666713 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1153/2416] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 20:57:43.681102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e1ddeeb8-8207-49c9-a2f9-a022666fa2e1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c68b80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.824624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:43.851816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-99c6afac-60b5-40ee-a330-89de2920881e tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1535 microversion: 2.1 time: 0.360838 Aug 27 20:57:43.853706 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1264/2417] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1535 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:43.874420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '.version_select at 0x7ff84fcd2a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:43.876305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:43.893153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.897034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.899307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:43.900390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:43.902701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:43.905483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.097830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e1ddeeb8-8207-49c9-a2f9-a022666fa2e1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1410 microversion: 2.1 time: 0.429654 Aug 27 20:57:44.101939 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1154/2418] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1410 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:44.104087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd7a4cca-19ef-4b43-a848-1c8a3d7025aa tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.248348 Aug 27 20:57:44.114114 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1265/2419] 10.222.0.40 () {60 vars in 1337 bytes} [Sat Aug 27 20:57:43 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876/os-instance-actions => generated 611 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:57:44.114734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.117648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.134698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.136730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.151015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.153197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.154231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.156326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.156907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.159040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.159734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.160358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.160932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.161704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.162174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.162608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.195655 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] HTTP exception thrown: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Request method failure captured: Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 HTTP/1.1 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUm7Jw7ccTM1oM99d0VVaLoKvWpxvsgJUNpR0Zk7tInankwaS03obdxEOOgJi0uZ8yIZ9TUbv1Ve0TSQzf0MKMJIEzBJbzPi5eUUs2UNOBJb_vUIHEDadhG-6XOwYe4I1xb23n44gV9bbD2MUCWsS98OYH9BJ_IkSNvpJe5eoGGqFM Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4333f6ff7d146e282200d1b867cd168", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}] Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cb4a8d269a8e42c58f71606a1bb244ac Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '79f5f9b5-d740-47e8-bc74-5ae81da7f876'} Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:44.198022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.201387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.203312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Returning 404 to user: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:44.206882 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a08ebff-1f41-4785-9430-f27f7e40924b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "DELETE /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 404 len: 111 microversion: 2.21 time: 0.091185 Aug 27 20:57:44.209126 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1266/2420] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 20:57:44 2022] DELETE /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:57:44.222391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.228529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] [instance: 79f5f9b5-d740-47e8-bc74-5ae81da7f876] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.244420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.245114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.246633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.249915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.250972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.255301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.284254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] HTTP exception thrown: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Request method failure captured: Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 HTTP/1.1 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUm7Jw7ccTM1oM99d0VVaLoKvWpxvsgJUNpR0Zk7tInankwaS03obdxEOOgJi0uZ8yIZ9TUbv1Ve0TSQzf0MKMJIEzBJbzPi5eUUs2UNOBJb_vUIHEDadhG-6XOwYe4I1xb23n44gV9bbD2MUCWsS98OYH9BJ_IkSNvpJe5eoGGqFM Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4333f6ff7d146e282200d1b867cd168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4333f6ff7d146e282200d1b867cd168", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4333f6ff7d146e282200d1b867cd168"}]}] Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b4333f6ff7d146e282200d1b867cd168 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1351072489 Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cb4a8d269a8e42c58f71606a1bb244ac Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceActionsV221TestJSON-1351072489-project Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '79f5f9b5-d740-47e8-bc74-5ae81da7f876'} Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.286203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.289596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] Returning 404 to user: Instance 79f5f9b5-d740-47e8-bc74-5ae81da7f876 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:44.290929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3432d026-d86d-4c25-b51f-74c58439dc9b tempest-InstanceActionsV221TestJSON-1351072489 tempest-InstanceActionsV221TestJSON-1351072489-project] 10.222.0.40 "GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876" status: 404 len: 111 microversion: 2.21 time: 0.073910 Aug 27 20:57:44.291624 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1267/2421] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:44 2022] GET /compute/v2.1/servers/79f5f9b5-d740-47e8-bc74-5ae81da7f876 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:57:44.455269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.461228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.472355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.473243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.473755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.475166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.475836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.476476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.526191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:44.538383 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17c31a02-ad53-4653-b115-70ef470fc049 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.434032 Aug 27 20:57:44.551883 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1155/2422] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:44 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:44.588558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.589399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] [instance: 54664521-0e6f-4816-a130-9d1eb527c73e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.602829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.603454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.603966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.606214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.606738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.607715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.610504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:44.628720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:44.630179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f446eacb5e5437393b633aa2534be42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c87d822a4584ee197f10a45d11e852f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:44.631397 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be0ed27d-46d3-4576-902c-f9420f5ef538 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 200 len: 1365 microversion: 2.47 time: 0.199679 Aug 27 20:57:44.632436 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1268/2423] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:44 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 20:57:44.648526 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] HTTP exception thrown: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Request method failure captured: Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e HTTP/1.1 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoTF0UElNoPvQspglLXUxA2FRT-WaBh63wSv2AvFWYTqQxyM9lE2nxuUAWk-EccBKCVOafLddOnS89fitq7jK98yuMNdB7JWpav4vKMfUfxvA8gBe_HI92ORdXwvROBVpG_ziCRlDgiWJwp-WR7Dv5MDkMvh0xW19_DsIs1vcnSR11w Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: bba5d28e239340c29ec8f7d9f9bd2653 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestManualDisk-1926266996 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bba5d28e239340c29ec8f7d9f9bd2653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bba5d28e239340c29ec8f7d9f9bd2653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bba5d28e239340c29ec8f7d9f9bd2653", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bba5d28e239340c29ec8f7d9f9bd2653"}]}] Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestManualDisk-1926266996 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: bba5d28e239340c29ec8f7d9f9bd2653 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestManualDisk-1926266996 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestManualDisk-1926266996-project Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: bebb885925d646d7bbfe523109df7c56 Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestManualDisk-1926266996-project Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '54664521-0e6f-4816-a130-9d1eb527c73e'} Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:44.651689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. Aug 27 20:57:44.654957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:44.668003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Returning 404 to user: Instance 54664521-0e6f-4816-a130-9d1eb527c73e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:44.670503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec138028-234b-4c23-b331-74a3922e8334 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e" status: 404 len: 111 microversion: 2.1 time: 0.087335 Aug 27 20:57:44.672738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1156/2424] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:44 2022] GET /compute/v2.1/servers/54664521-0e6f-4816-a130-9d1eb527c73e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:57:44.682310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0e841c0-0998-4032-b5cc-4857a90a5eb9 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] Calling method '.version_select at 0x7ff84f0ee4c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.714775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0e841c0-0998-4032-b5cc-4857a90a5eb9 tempest-ServersTestManualDisk-1926266996 tempest-ServersTestManualDisk-1926266996-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667229588" status: 202 len: 0 microversion: 2.1 time: 0.037385 Aug 27 20:57:44.716862 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1269/2425] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 20:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667229588 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:57:44.876380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:44.878452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:44.887835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.888402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.889225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:44.890447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:44.891405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:44.892122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:45.130760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f38d265c-f066-4354-9d6f-614e3e2130eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f2bc430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:45.233860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f38d265c-f066-4354-9d6f-614e3e2130eb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1419 microversion: 2.1 time: 0.116021 Aug 27 20:57:45.236231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1270/2426] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:45 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1419 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:45.249627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f743493-7737-403c-aa26-879d208506fd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857dadee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:45.281084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:45.293723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afeb0e38-fee1-444d-8aaf-0cbd6edb1d63 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1535 microversion: 2.1 time: 0.423522 Aug 27 20:57:45.295214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1157/2427] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:44 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1535 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:45.317599 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f743493-7737-403c-aa26-879d208506fd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 200 len: 1419 microversion: 2.1 time: 0.071936 Aug 27 20:57:45.320268 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1271/2428] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:57:45 2022] GET /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 1419 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:45.332903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a67ec48-7383-4a07-8506-c8c201b85020 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857c7f8b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:45.564546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:45.565570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:45.580578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:45.583025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:45.584608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:45.585625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:45.587948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:45.589602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:45.805518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=14 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:45.950930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:45.969361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:45.980984 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-156ce4c7-6d15-4eb0-be10-e66b26ad8b2f tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.420703 Aug 27 20:57:45.984025 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1272/2429] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:45 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:45.989249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:45.989840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] [instance: bc0ced03-b4e9-41a9-9bc7-207d59f4545d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:46.003516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.004008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.024128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.024909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.025383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.025807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.044167 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] HTTP exception thrown: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Request method failure captured: Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d HTTP/1.1 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoU2oyOULiH-X46iWzknntPGoPPEUpzkHc2zmdnBGepFBcVhoinQ0j8jaeocYgkVapqKo85abq5-0_YRjYHD77HUXaJ33qUvaEf8qzL15ZgfYrcupRnxJHCUdjF2eHUY2Qj--yk73kvf0hiL-iXoxlBd69ZFvmxNtP1aM9bdc-z1QvQ Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 2c87d822a4584ee197f10a45d11e852f Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersAaction247Test-1611069248 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c87d822a4584ee197f10a45d11e852f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/2c87d822a4584ee197f10a45d11e852f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_2c87d822a4584ee197f10a45d11e852f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/2c87d822a4584ee197f10a45d11e852f"}]}] Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersAaction247Test-1611069248 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 2c87d822a4584ee197f10a45d11e852f Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersAaction247Test-1611069248 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersAaction247Test-1611069248-project Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7f446eacb5e5437393b633aa2534be42 Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersAaction247Test-1611069248-project Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'bc0ced03-b4e9-41a9-9bc7-207d59f4545d'} Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:46.050761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. Aug 27 20:57:46.054179 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:46.058222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] Returning 404 to user: Instance bc0ced03-b4e9-41a9-9bc7-207d59f4545d could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:46.059807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4e175be-4b55-450d-9378-d4c86853ca84 tempest-ServersAaction247Test-1611069248 tempest-ServersAaction247Test-1611069248-project] 10.222.0.40 "GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d" status: 404 len: 111 microversion: 2.47 time: 0.074198 Aug 27 20:57:46.063510 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1273/2430] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 20:57:45 2022] GET /compute/v2.1/servers/bc0ced03-b4e9-41a9-9bc7-207d59f4545d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:57:46.324088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:46.324346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:46.342655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.343166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.354117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.355178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.355857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.356466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.438747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a67ec48-7383-4a07-8506-c8c201b85020 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 204 len: 0 microversion: 2.1 time: 1.110271 Aug 27 20:57:46.440272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1158/2431] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:45 2022] DELETE /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 0 bytes in 1113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:57:46.454537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:46.455777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:46.467841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.468731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.469449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.470387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:46.471454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:46.472681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:46.514181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:46.625337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f7009b4-6ed1-42ee-9f82-3cf5dfaf8af3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 204 len: 0 microversion: 2.1 time: 0.180005 Aug 27 20:57:46.627211 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1159/2432] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:57:46 2022] DELETE /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:57:46.823871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:46.836286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f50a09f-cc84-41e2-bcbc-c08b8021800b tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1535 microversion: 2.1 time: 0.516472 Aug 27 20:57:46.837499 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1274/2433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:46 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1535 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:46.856859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1389711384", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5b97881f-89ac-4440-8b19-f267ffb14088"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:46.947439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] validate_networks() for [('5b97881f-89ac-4440-8b19-f267ffb14088', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:57:47.006795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:47.007567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:47.016545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:47.017050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:47.017488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:47.032543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:47.034257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:47.035395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:47.828913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:47.847399 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96dfa764-1481-4b00-91e2-60f6dd41c83e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.844332 Aug 27 20:57:47.848362 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1275/2434] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:47 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:48.290757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d850f27f-2b10-4431-9ae6-f94b9a8ed5ad tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T20%3A57%3A47.318656&end=2022-08-28T20%3A57%3A47.318656" status: 404 len: 112 microversion: - time: 0.437932 Aug 27 20:57:48.293982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1276/2435] 10.222.0.40 () {58 vars in 1316 bytes} [Sat Aug 27 20:57:47 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T20%3A57%3A47.318656&end=2022-08-28T20%3A57%3A47.318656 => generated 112 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 20:57:48.313439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:48.315710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:48.325453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:48.326390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:48.327369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:48.328424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:48.329072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:48.329704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:48.605967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:57:48.606456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:57:48.606872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:57:48.607288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:57:48.607909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:57:48.618255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:48.619474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:48.620069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:48.620975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:48.621617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:48.622290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:48.641284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:48.669892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:57:48.679515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for user ede90e55159a4d3192505c74a2a69a51 and project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:57:48.697234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:57:48.700784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:57:48.786935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:48.796628 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3249b974-76b6-4834-8e13-3e40e576b2b8 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1535 microversion: 2.1 time: 0.499131 Aug 27 20:57:48.811633 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a397022-3445-4ecc-91f9-0a237428bc54 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959461 Aug 27 20:57:48.812243 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1277/2436] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:48 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1535 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:48.819188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1160/2437] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:57:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:57:48.823061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a9dd128-67e9-41e4-9c6c-138e11c5e1e7 tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] Calling method '.version_select at 0x7ff84e642940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:48.827801 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5a9dd128-67e9-41e4-9c6c-138e11c5e1e7 tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a9dd128-67e9-41e4-9c6c-138e11c5e1e7 tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] Request method failure captured: Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-simple-tenant-usage/1f2700fba7b24a799574e249b2fe5274?start=2022-08-28T20%3A57%3A47.318656&end=2022-08-26T20%3A57%3A47.318656 HTTP/1.1 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVLax5xjQDj7DLwBNpDjrQK4dqRZ-WPo3IuQENdMlEV6f2_CYdvheiXrXkdmmgJdSsjfjlCMYB8tZ2Mif1SdYj_pxv3FNr7ZWvDvxiFCuTFidbIa6NQ7ETiYKVUuP2JBW9AqKHge_OSA-IAaNVWvdy-Z9g_qo0UQvaNXefCAW8sGu0 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 11f9b189119d45b7be68e13a7b22a7fb Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-886080955 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11f9b189119d45b7be68e13a7b22a7fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/11f9b189119d45b7be68e13a7b22a7fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_11f9b189119d45b7be68e13a7b22a7fb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/11f9b189119d45b7be68e13a7b22a7fb"}]}] Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-886080955 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 11f9b189119d45b7be68e13a7b22a7fb Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-886080955 Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TenantUsagesNegativeTestJSON-886080955-project-admin Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d36c5486f5ec4fea8e6d22a471ce3adf Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-886080955-project-admin Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1f2700fba7b24a799574e249b2fe5274'} Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 20:57:48.829810 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:48.835832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7aa4607a-6269-47e6-b9b7-de6edb2c4091 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:48.836850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a9dd128-67e9-41e4-9c6c-138e11c5e1e7 tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:48.837954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a9dd128-67e9-41e4-9c6c-138e11c5e1e7 tempest-TenantUsagesNegativeTestJSON-886080955 tempest-TenantUsagesNegativeTestJSON-886080955-project-admin] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage/1f2700fba7b24a799574e249b2fe5274?start=2022-08-28T20%3A57%3A47.318656&end=2022-08-26T20%3A57%3A47.318656" status: 400 len: 111 microversion: 2.1 time: 0.024484 Aug 27 20:57:48.845372 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1278/2438] 10.222.0.40 () {58 vars in 1412 bytes} [Sat Aug 27 20:57:48 2022] GET /compute/v2.1/os-simple-tenant-usage/1f2700fba7b24a799574e249b2fe5274?start=2022-08-28T20%3A57%3A47.318656&end=2022-08-26T20%3A57%3A47.318656 => generated 111 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:57:48.858788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7aa4607a-6269-47e6-b9b7-de6edb2c4091 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:48.995770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:49.081768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7aa4607a-6269-47e6-b9b7-de6edb2c4091 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:49.097651 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7aa4607a-6269-47e6-b9b7-de6edb2c4091 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1208 microversion: 2.1 time: 0.275348 Aug 27 20:57:49.114048 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1161/2439] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:48 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1208 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:49.125183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:49.133239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:49.159638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:49.161785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:49.164763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:49.174680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:49.175602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:49.177817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:49.705236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4229ff47-73fe-4140-ad9c-d581baade829 tempest-TenantUsagesNegativeTestJSON-1786522616 tempest-TenantUsagesNegativeTestJSON-1786522616-project] Calling method '.version_select at 0x7ff84e66f280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:49.718488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4229ff47-73fe-4140-ad9c-d581baade829 tempest-TenantUsagesNegativeTestJSON-1786522616 tempest-TenantUsagesNegativeTestJSON-1786522616-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ae1e5e57a2af46f38025997060d1bcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2700fba7b24a799574e249b2fe5274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4229ff47-73fe-4140-ad9c-d581baade829 tempest-TenantUsagesNegativeTestJSON-1786522616 tempest-TenantUsagesNegativeTestJSON-1786522616-project] Request method failure captured: Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T20%3A57%3A47.318656&end=2022-08-28T20%3A57%3A47.318656&detailed=1 HTTP/1.1 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVJWWKb8PgaHMm1Sc_ykZ6iN5zOzBrzp4Wz7qaIfVkT-Xkh4MQrQFzFOcCsUJJr5worJa9PNJBqKfeOc6j8EBZKOYJgjmfsG2flfh35fCB7HX4GbOKvWZzhHRK8nvjsIKs-KEKxsGeAJlsO8NrJiPNxcg7mRBypIZ_BqPgapEDpShQ Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1f2700fba7b24a799574e249b2fe5274 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1786522616 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1f2700fba7b24a799574e249b2fe5274"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1f2700fba7b24a799574e249b2fe5274"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1f2700fba7b24a799574e249b2fe5274", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1f2700fba7b24a799574e249b2fe5274"}]}] Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1786522616 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1f2700fba7b24a799574e249b2fe5274 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1786522616 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TenantUsagesNegativeTestJSON-1786522616-project Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ae1e5e57a2af46f38025997060d1bcc5 Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1786522616-project Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 20:57:49.722565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4229ff47-73fe-4140-ad9c-d581baade829 tempest-TenantUsagesNegativeTestJSON-1786522616 tempest-TenantUsagesNegativeTestJSON-1786522616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4229ff47-73fe-4140-ad9c-d581baade829 tempest-TenantUsagesNegativeTestJSON-1786522616 tempest-TenantUsagesNegativeTestJSON-1786522616-project] 10.222.0.40 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T20%3A57%3A47.318656&end=2022-08-28T20%3A57%3A47.318656&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.874056 Aug 27 20:57:49.736373 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1279/2440] 10.222.0.40 () {58 vars in 1335 bytes} [Sat Aug 27 20:57:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T20%3A57%3A47.318656&end=2022-08-28T20%3A57%3A47.318656&detailed=1 => generated 123 bytes in 878 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:57:49.829797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:49.831111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:49.832745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:49.842959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:49.843536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:49.843978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:49.844691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:49.845145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:49.846798 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-680cc79c-37d7-40a2-83fb-0c3ac2237ada tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 0.728992 Aug 27 20:57:49.848643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:49.849699 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1162/2441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:49 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:50.118693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:50.119534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:50.132710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.134671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.151203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:50.155324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.156504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.157861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:50.366515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:50.400705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e1701494-ebb3-410b-8347-34a56cbf75e3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1204 microversion: 2.1 time: 0.282800 Aug 27 20:57:50.421616 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1163/2442] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:50 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1204 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:50.449799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0df002a9-8f41-4e21-be95-8c45b19650d4", "name": "network-vif-deleted", "tag": "47546445-4ed3-45b8-9cd5-87701a0d33c3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:50.493816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.498663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.500842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:50.576995 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] Creating event network-vif-deleted:47546445-4ed3-45b8-9cd5-87701a0d33c3 for instance 0df002a9-8f41-4e21-be95-8c45b19650d4 on nch2-master-1 Aug 27 20:57:50.590397 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ae3d3513-9743-4355-8261-a467cce22f6f req-07754d97-5db2-4246-9f60-8678f4d15684 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163450 Aug 27 20:57:50.598211 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1164/2443] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:50.699967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c0f46e-25c2-4eec-8880-a726ced5f23b", "name": "network-vif-plugged", "status": "completed", "tag": "dc153e44-4059-429a-a508-cf3f76521260"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:50.736588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:50.740891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.742491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.742957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:50.746301 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e8d95f7-17ea-4d62-8e19-e68a40e035b3 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1535 microversion: 2.1 time: 0.920266 Aug 27 20:57:50.751561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1280/2444] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:49 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1535 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:50.796633 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] Creating event network-vif-plugged:dc153e44-4059-429a-a508-cf3f76521260 for instance e3c0f46e-25c2-4eec-8880-a726ced5f23b on nch2-master-1 Aug 27 20:57:50.802923 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ffcc3fbe-571e-44b8-af01-7f44024f424e req-04b518c9-2abf-4838-a726-cac43a4ea41c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117375 Aug 27 20:57:50.803578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1165/2445] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 20:57:50.871456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:50.872889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:50.894962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.896007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.899811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:50.902867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:50.903622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:50.915889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:51.451584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:51.452415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:51.506580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:51.509023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:51.515569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:51.516683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:51.517358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:51.518091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:52.605811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:52.616699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39630ccd-e446-41f0-9785-91ee093453d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1266 microversion: 2.1 time: 1.190140 Aug 27 20:57:52.638421 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1166/2446] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:51 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1266 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:52.644011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:52.644839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:52.667539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:52.668093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:52.668613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:52.669407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:52.669936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:52.670435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:52.729648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:52.743964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:52.744761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:52.745558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:52.746212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lazy-loading 'fault' on Instance uuid 385734d0-4fb2-40e5-8aff-e605ac4df515 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:57:52.897537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:52.910762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:52.918778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc74408d-968d-4db5-91a2-d6ad49436686 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 200 len: 1369 microversion: 2.1 time: 0.278267 Aug 27 20:57:52.919923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1167/2447] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:52 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 1369 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:52.925778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e072a987-86e8-4868-9697-e966a140c83b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1323 microversion: 2.1 time: 2.059420 Aug 27 20:57:52.927483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385734d0-4fb2-40e5-8aff-e605ac4df515", "name": "network-vif-deleted", "tag": "867fc8ab-808d-4e8d-8c5c-092400e53239"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:52.941070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:52.941872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:52.942598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:52.944677 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1281/2448] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:50 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1323 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:52.961328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] Creating event network-vif-deleted:867fc8ab-808d-4e8d-8c5c-092400e53239 for instance 385734d0-4fb2-40e5-8aff-e605ac4df515 on nch2-master-1 Aug 27 20:57:52.967880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0c072d30-d652-4e7a-92d0-89e9a84b901c req-662681b3-9a57-4c49-af9f-a94af2141285 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045569 Aug 27 20:57:52.968989 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1168/2449] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:53.648619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:53.649489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:53.664918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:53.666604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:53.667290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:53.668891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:53.672066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:53.673905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:53.810994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:53.824861 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-398363fc-85ea-456d-b022-92acaaa223d0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1266 microversion: 2.1 time: 0.182828 Aug 27 20:57:53.826467 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1282/2450] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:53 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:53.952833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:53.955550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:53.958243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:53.960905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 385734d0-4fb2-40e5-8aff-e605ac4df515] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:53.972724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:53.988360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:53.990771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:53.992202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:53.993152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:53.993769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:53.994570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:53.995178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.000605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.001749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:54.002619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:54.003315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.068439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] HTTP exception thrown: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Request method failure captured: Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 HTTP/1.1 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoPh_V6iG-Yu3mvd7uCoAm40z9ydwpxasot13yXKo4_gbOwQlkkMwfgs96nzMIGdVvn-lfFeBBYWLY-Sw25zEFd4qMFaMvlUT5xQPDUYs8KbEoFl5CHMkBcmkgGMK-uR0QpcDhitFPUqhmLzlE9MNf5tCnPoKpQ7TVdSUuY7UxwB-zE Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e287f0565aa445f38277a34a29b94c9d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}] Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MigrationsAdminTest-104901767-project Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 513ac3d6ab864589b6b03554fc0ce9a8 Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MigrationsAdminTest-104901767-project Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '385734d0-4fb2-40e5-8aff-e605ac4df515'} Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:57:54.081536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. Aug 27 20:57:54.085430 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:57:54.090589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Returning 404 to user: Instance 385734d0-4fb2-40e5-8aff-e605ac4df515 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:57:54.094118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-405347a1-773a-42f0-b0c1-20c4d6e8a34a tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515" status: 404 len: 111 microversion: 2.1 time: 0.152435 Aug 27 20:57:54.095641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1169/2451] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:53 2022] GET /compute/v2.1/servers/385734d0-4fb2-40e5-8aff-e605ac4df515 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 20:57:54.107435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-09ae4d54-87aa-450b-b457-3bf8f531bb49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '.version_select at 0x7ff857d70700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:54.137058 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-09ae4d54-87aa-450b-b457-3bf8f531bb49 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469423372" status: 202 len: 0 microversion: 2.1 time: 0.034321 Aug 27 20:57:54.138122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1170/2452] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 20:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469423372 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:57:54.739685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:54.752503 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-397e3ae5-dda3-44c4-acb6-44fd163127ca tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 200 len: 1520 microversion: 2.1 time: 0.803681 Aug 27 20:57:54.767508 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1283/2453] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:53 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 1520 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:57:54.775083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: .version_select at 0x7ff854f22040>, body: {"addFloatingIp": {"address": "172.35.5.241"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:54.777947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:54.794761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:54.796925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:54.798191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.801668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:54.802287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:54.802867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.847474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:54.848261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:54.857167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:54.862823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:54.865895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:54.869991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:54.871465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:54.872905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:55.075146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:57:55.075667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquired lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:57:55.733730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:55.749607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7286d4c3-2037-4768-99fe-5dc03c354817 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 0.906493 Aug 27 20:57:55.763871 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1284/2454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:54 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:56.342139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2807b8-4761-4028-bcfe-ab65761a19f9", "tag": "41405498-6abd-4854-80fa-b5e83fbf5a35"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:56.368037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:56.371981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:56.372717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:56.419099 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] Creating event network-changed:41405498-6abd-4854-80fa-b5e83fbf5a35 for instance ff2807b8-4761-4028-bcfe-ab65761a19f9 on nch1-master-1 Aug 27 20:57:56.432916 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-290b13dc-ac35-49c4-a452-6f0e5806c1bc req-0bf3548e-6360-44bc-82b6-e44a74c5ea5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094731 Aug 27 20:57:56.433884 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1285/2455] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:56.776539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:56.777454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:56.794265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:56.794764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:56.795423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:56.796318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:56.796951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:56.797549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:57.214488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:57.237470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-448abe0c-15d7-4957-8ef4-648f6afc17c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 0.460775 Aug 27 20:57:57.238506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1286/2456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:56 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:58.266956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:58.267913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:58.278487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:58.279450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:58.279889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:58.286401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:58.287316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:58.287938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:58.320588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Building network info cache for instance {{(pid=140433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:57:58.343751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:58.641808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:58.821171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:57:58.843788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-80b4c55f-5f60-44ff-8c3a-3ef7a2b46484 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 0.585649 Aug 27 20:57:58.848519 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1287/2457] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:58 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:57:58.866073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:57:58.906809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:58.909209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:58.910069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:58.971365 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] Creating event network-changed:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:57:58.985345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-61c56293-9b8c-4af4-aea1-2270b3bd2531 req-3538aa34-4b05-4f11-9302-01e6c4775881 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128436 Aug 27 20:57:58.990550 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1288/2458] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:57:59.093046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:59.382874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:59.384150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:59.393842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:57:59.397412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:59.398421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:59.398861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:59.400154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:59.400646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:59.401066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:59.459353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:57:59.633939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49b4599d-e1c0-432d-82fc-8172653b4d3c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 204 len: 0 microversion: 2.1 time: 0.261835 Aug 27 20:57:59.635147 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1289/2459] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:57:59 2022] DELETE /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 20:57:59.662357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:57:59.666270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:57:59.692145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:59.694828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:59.695547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:57:59.725376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:57:59.726182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:57:59.727269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:00.068575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Updating instance_info_cache with network_info: [{"id": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d", "address": "fa:16:3e:b8:db:0f", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa812c4bc-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:00.102642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Releasing lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:58:00.116196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-902816bd-07ac-4e25-8c34-71376552e12c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action" status: 202 len: 0 microversion: 2.1 time: 5.334012 Aug 27 20:58:00.116907 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1171/2460] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:57:54 2022] POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action => generated 0 bytes in 5347 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:58:00.130119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:00.131920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:00.146818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:00.147330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:00.149783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:00.151447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:00.151977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:00.152412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:00.210868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:00.226078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ee6f218-7308-4f6d-8e84-3a7c3e1f5c56 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1469 microversion: 2.1 time: 0.586786 Aug 27 20:58:00.251023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1290/2461] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:57:59 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1469 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:00.263191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: .version_select at 0x7ff854f21040>, body: {"addFloatingIp": {"address": "172.35.5.241"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:00.272950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:00.286306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:00.286807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:00.288113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:00.288902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:00.290600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:00.291045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:00.454197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:58:00.454836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquired lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:58:00.917618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:00.927708 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0adf5010-f9cf-4073-b56e-92039d425fa5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 0.807453 Aug 27 20:58:00.931770 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1172/2462] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:00 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:01.251266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:01.253343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:01.262980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:01.263921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:01.264651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:01.265626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:01.267088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:01.274555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:02.127912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:02.141613 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b01a24ae-5256-4c6d-a13a-26b8477c28fe tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1469 microversion: 2.1 time: 0.890912 Aug 27 20:58:02.142494 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1173/2463] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:01 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1469 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:02.147590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:02.152766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:02.168789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:02.169748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:02.170457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:02.172157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:02.174487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:02.175186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:02.784387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:02.813843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d44ef67-4f5d-42e3-97cb-aeba528de2c6 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 0.668136 Aug 27 20:58:02.833978 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1174/2464] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:02 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:03.180977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:03.181960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:03.210069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:03.214242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:03.215844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:03.218408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:03.220339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:03.221533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:04.068627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:04.082445 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd019a63-c8e3-4b0a-b958-383c47aed400 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 200 len: 1469 microversion: 2.1 time: 0.912580 Aug 27 20:58:04.086183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1175/2465] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:03 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 1469 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:04.091593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:04.101321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:04.115893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:04.121204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:04.122009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:04.122905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:04.123534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:04.124122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:05.830446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:05.849756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dfb98c5a-add7-4e1d-b810-5e8fae619463 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 1.761297 Aug 27 20:58:05.852482 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1176/2466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:04 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:05.871145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f70541-3f19-479c-af7d-cadb6d1789db", "name": "network-vif-deleted", "tag": "6675d230-7e6e-4bf0-9f9e-3af33976084e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:05.917932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:05.919786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:05.922333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:05.945571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] Creating event network-vif-deleted:6675d230-7e6e-4bf0-9f9e-3af33976084e for instance 71f70541-3f19-479c-af7d-cadb6d1789db on nch1-master-1 Aug 27 20:58:05.963767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-03e01fbb-243f-41d7-b792-d2a8c89ce630 req-1a6776dd-876c-406c-8970-da9beb46356c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108446 Aug 27 20:58:05.966521 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1177/2467] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:05.982505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:05.985108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 71f70541-3f19-479c-af7d-cadb6d1789db] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:06.008397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.009285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.012716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.014155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.017395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.018925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.060936 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] HTTP exception thrown: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Request method failure captured: Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db HTTP/1.1 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoPh_V6iG-Yu3mvd7uCoAm40z9ydwpxasot13yXKo4_gbOwQlkkMwfgs96nzMIGdVvn-lfFeBBYWLY-Sw25zEFd4qMFaMvlUT5xQPDUYs8KbEoFl5CHMkBcmkgGMK-uR0QpcDhitFPUqhmLzlE9MNf5tCnPoKpQ7TVdSUuY7UxwB-zE Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e287f0565aa445f38277a34a29b94c9d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}] Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MigrationsAdminTest-104901767-project Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 513ac3d6ab864589b6b03554fc0ce9a8 Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MigrationsAdminTest-104901767-project Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '71f70541-3f19-479c-af7d-cadb6d1789db'} Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:06.062676 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Returning 404 to user: Instance 71f70541-3f19-479c-af7d-cadb6d1789db could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec9c8920-face-412b-a0dd-2c8311bf9b57 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db" status: 404 len: 111 microversion: 2.1 time: 0.096016 Aug 27 20:58:06.067241 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1178/2468] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:05 2022] GET /compute/v2.1/servers/71f70541-3f19-479c-af7d-cadb6d1789db => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:58:06.079602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:06.088270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:06.101721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.102569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.104174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.104940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.105414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.106015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.191029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:58:06.329796 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4bc4fbda-5391-4ca8-ae6f-64de66877f6c tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "DELETE /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 204 len: 0 microversion: 2.1 time: 0.254066 Aug 27 20:58:06.331533 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1179/2469] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:58:06 2022] DELETE /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:58:06.347237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:06.348360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:06.358024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.358683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.359191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.360004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:06.360543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:06.360971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:06.396258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:06.988072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:06.996936 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd0b911e-38ec-4c81-9849-ec7f03b9b8df tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1469 microversion: 2.1 time: 0.658613 Aug 27 20:58:07.003673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1180/2470] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:06 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:07.009019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:07.016077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:07.035258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:07.036154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:07.036782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:07.037617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:07.038796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:07.039258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:08.203407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:08.223246 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6dd950b-8d1c-4dd5-b2d0-590e6a24befd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1308 microversion: 2.1 time: 1.217629 Aug 27 20:58:08.224813 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1181/2471] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:07 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1308 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:08.242517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2807b8-4761-4028-bcfe-ab65761a19f9", "name": "network-vif-plugged", "status": "completed", "tag": "41405498-6abd-4854-80fa-b5e83fbf5a35"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:08.262252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:08.265133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:08.265566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:08.285742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] Creating event network-vif-plugged:41405498-6abd-4854-80fa-b5e83fbf5a35 for instance ff2807b8-4761-4028-bcfe-ab65761a19f9 on nch1-master-1 Aug 27 20:58:08.294012 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-191a27c2-4484-4d42-88e3-75b1badbd5c6 req-78921c7b-b1ee-43f9-922c-8a067f14977e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066846 Aug 27 20:58:08.295017 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1182/2472] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:08.304174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:08.306137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:08.318962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:08.320506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:08.321152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:08.322408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:08.323092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:08.323759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:09.226393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '513ac3d6ab864589b6b03554fc0ce9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e287f0565aa445f38277a34a29b94c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:09.241927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b43edb2e-fa1c-472e-8a39-b8d9f4d17a11 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 200 len: 1469 microversion: 2.1 time: 0.943063 Aug 27 20:58:09.242832 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1183/2473] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:08 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 1469 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:09.531976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-855584111", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:09.645314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:10.279792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:10.439276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:12.351122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:12.352289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:12.354727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:12.355553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:12.356177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:12.389392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:12.396170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:12.397016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:12.398106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:12.398760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:12.399420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:12.443642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:12.460780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:12.478023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:12.481275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:12.588764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-704294e4-7cbd-4922-ba67-9fdcea8dc692 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.342400 Aug 27 20:58:12.589714 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1184/2474] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:12.610457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:12.612219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:12.646003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:12.646708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:12.647325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:12.648573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:12.649225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:12.649809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:12.821875 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.network.neutron [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] re-assign floating IP 172.35.5.241 from instance 848193dd-e1e9-4a01-adf4-8b55863607f9 Aug 27 20:58:12.928824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:58:13.748620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:13.760471 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b90c1e2c-c493-4432-bbea-c3c49023caba tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1488 microversion: 2.1 time: 1.169262 Aug 27 20:58:13.775385 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1185/2475] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:12 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1488 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:13.775385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:13.775385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] [instance: 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:13.814584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:13.815128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:13.815540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:13.816262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:13.817314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:13.817739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:13.860464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] HTTP exception thrown: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Request method failure captured: Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 HTTP/1.1 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoPh_V6iG-Yu3mvd7uCoAm40z9ydwpxasot13yXKo4_gbOwQlkkMwfgs96nzMIGdVvn-lfFeBBYWLY-Sw25zEFd4qMFaMvlUT5xQPDUYs8KbEoFl5CHMkBcmkgGMK-uR0QpcDhitFPUqhmLzlE9MNf5tCnPoKpQ7TVdSUuY7UxwB-zE Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e287f0565aa445f38277a34a29b94c9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e287f0565aa445f38277a34a29b94c9d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e287f0565aa445f38277a34a29b94c9d"}]}] Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e287f0565aa445f38277a34a29b94c9d Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MigrationsAdminTest-104901767 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MigrationsAdminTest-104901767-project Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 513ac3d6ab864589b6b03554fc0ce9a8 Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MigrationsAdminTest-104901767-project Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2'} Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:13.867321 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] Returning 404 to user: Instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:58:13.870814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-318dc6a7-dad3-446e-8594-13b34f9dc618 tempest-MigrationsAdminTest-104901767 tempest-MigrationsAdminTest-104901767-project] 10.222.0.40 "GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2" status: 404 len: 111 microversion: 2.1 time: 0.101223 Aug 27 20:58:13.873012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1186/2476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:13 2022] GET /compute/v2.1/servers/82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:58:13.960020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-603383494", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "97874412-b0c3-42b7-ab38-f8c8f8b089f1"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:14.040295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] validate_networks() for [('97874412-b0c3-42b7-ab38-f8c8f8b089f1', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:16.636956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:16.637727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:16.639082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:16.641115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:16.642029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:16.690407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:16.691712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:16.692887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:16.694256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:16.698108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:16.699030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:16.734773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Updating instance_info_cache with network_info: [{"id": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d", "address": "fa:16:3e:b8:db:0f", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa812c4bc-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:16.764807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:58:16.814850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Getting quotas for project b385f04d9af64d83bf4104606c716af7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:16.821722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Getting quotas for user beb681daa8ff4485b8605f79a32bd45b and project b385f04d9af64d83bf4104606c716af7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:16.840225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Going to run 3 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:16.843400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:16.955190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=68b08606-ff14-4c09-a896-66d93151ecdb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:17.054393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=4705ab9d-bd89-489e-9394-9f1981221188,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:17.232285 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56dfe805-3b75-40d5-b582-9928f6ffa7ef tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.355105 Aug 27 20:58:17.233682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1187/2477] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:17.247452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2", "name": "network-vif-deleted", "tag": "fc6a3c0a-b9df-43b0-b445-64f14123fe10"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:17.279775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:17.280629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:17.284132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:17.330941 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] Creating event network-vif-deleted:fc6a3c0a-b9df-43b0-b445-64f14123fe10 for instance 82f7b2dd-84db-4ba8-bc9d-b2dcac2ddbe2 on nch2-master-1 Aug 27 20:58:17.347997 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6e6c2930-b452-48fb-8568-e4a7321f585d req-69d961e0-a4b5-4c14-ab63-8ae9f6684255 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112649 Aug 27 20:58:17.350892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1188/2478] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:17.362383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:17.372900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:17.401329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:17.401816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:17.410870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:17.413907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:17.414839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:17.415469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:18.184796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:18.198228 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0fdaf30-836e-4696-9c98-5a3fb3a98622 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1250 microversion: 2.1 time: 0.845919 Aug 27 20:58:18.198873 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1189/2479] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:17 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1250 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:18.869418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-561933654", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "55e991bc-e3d2-4ac7-85bd-77602d68921c"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:19.020541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] validate_networks() for [('55e991bc-e3d2-4ac7-85bd-77602d68921c', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:21.823250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Updating instance_info_cache with network_info: [{"id": "dc153e44-4059-429a-a508-cf3f76521260", "address": "fa:16:3e:bc:e8:5c", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdc153e44-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:21.840758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Releasing lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:58:21.842510 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78c4d528-9963-4bba-b89b-3268b0eb319e tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b/action" status: 202 len: 0 microversion: 2.1 time: 21.590125 Aug 27 20:58:21.848530 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1291/2480] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:00 2022] POST /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b/action => generated 0 bytes in 21597 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:58:21.869052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:21.870357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:21.894759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:21.895995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:21.897585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:21.899942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:21.902089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:21.902694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:21.949281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lazy-loading 'flavor' on Instance uuid ff2807b8-4761-4028-bcfe-ab65761a19f9 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:22.180152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee597e3f-3c50-41eb-be87-8aa75f2ab502 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9/action" status: 202 len: 0 microversion: 2.1 time: 0.329297 Aug 27 20:58:22.181330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1292/2481] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:21 2022] POST /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:58:22.187541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:22.227901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:22.229929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:58:22.241512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.242960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.243633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.244577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.245271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.245912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.278475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:58:22.303246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:22.303246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:22.303246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:22.303246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:22.303246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:22.323321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.325014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.326399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.332312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.332621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.333162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.385267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14760221-263c-41a7-98ea-80bbdac19c30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.202112 Aug 27 20:58:22.388926 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1293/2482] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:58:22 2022] GET /compute/v2.1/servers => generated 1015 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:22.401224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:22.404071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:22.428100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.428612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.429058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.429786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.429891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Getting quotas for project 4f3beed612074a54b8ee14f7abcee3ab. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:22.430243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.430672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.454419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Getting quotas for user 18552094160c4c72bccdc1f412e9f95c and project 4f3beed612074a54b8ee14f7abcee3ab. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:22.495384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:22.499762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:22.502758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:22.624721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e8fa15d-4593-474d-9216-ea80238ed69e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.421710 Aug 27 20:58:22.634436 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1190/2483] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:22.644087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}, {"name": "network-changed", "server_uuid": "e3c0f46e-25c2-4eec-8880-a726ced5f23b", "tag": "dc153e44-4059-429a-a508-cf3f76521260"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:22.686552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:22.687737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:22.690661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:22.719056 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Creating event network-changed:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:58:22.724803 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] Creating event network-changed:dc153e44-4059-429a-a508-cf3f76521260 for instance e3c0f46e-25c2-4eec-8880-a726ced5f23b on nch2-master-1 Aug 27 20:58:22.750518 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d55a99a2-4c56-4fe1-9977-37148d4a7294 req-5bcc0ae0-e88c-4e6a-8c6b-a0e2fe036f1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112136 Aug 27 20:58:22.751826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1191/2484] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:23.022262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:23.049829 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5041cd77-4c9a-48bd-abc7-94ba5f29cc73 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 0.644507 Aug 27 20:58:23.052523 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1294/2485] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:22 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:23.424926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-517078187", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "32f0e6e7-77b7-42e7-a0b9-be002fbc054c"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:23.492151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f47d280>, body: {"quota_set": {"ram": "5120"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:23.587199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] validate_networks() for [('32f0e6e7-77b7-42e7-a0b9-be002fbc054c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:23.717776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:23.719510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:23.721291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:23.724485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:23.726311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:23.727821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:23.878859 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63eb5f5e-fa28-41ba-8c65-1d4822fa9bfd tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc" status: 200 len: 240 microversion: 2.36 time: 1.124967 Aug 27 20:58:23.881103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1192/2486] 10.222.0.40 () {62 vars in 1303 bytes} [Sat Aug 27 20:58:22 2022] PUT /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc => generated 240 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:58:23.893966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: .version_select at 0x7ff854f22790>, body: {"removeFloatingIp": {"address": "172.35.5.241"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:24.596377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:24.604331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:24.607071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:24.608002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:24.609259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:24.611511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:24.612698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.289458 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] HTTP exception thrown: Floating IP 172.35.5.241 is not associated with instance 848193dd-e1e9-4a01-adf4-8b55863607f9. Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Request method failure captured: Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action HTTP/1.1 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 49 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoUeJNWjsfCZhZaeMPqJpajzhcpsOledBPRLczsSOaqOk1toDc9XXLRLXNlJtAHe6ewJVCWYY7VL4hgDGwJbACk1yG24l3QR4WDPP-UW9yqIjMfim_PrgAAZ73MlD5gDWudJ884PnAycW_NiRH_gfndSyG4vDJVLfQKhknNSpswyN3g Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dced4e2c73df4f4485ef8442b0afe00e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}] Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8c6a5cc460f744ee8b958eafbe2e995b Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: {"removeFloatingIp": {"address": "172.35.5.241"}} Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP 172.35.5.241 is not associated with instance 848193dd-e1e9-4a01-adf4-8b55863607f9. Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '848193dd-e1e9-4a01-adf4-8b55863607f9', 'body': {'removeFloatingIp': {'address': '172.35.5.241'}}} Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.5.241 is not associated with instance 848193dd-e1e9-4a01-adf4-8b55863607f9. Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.5.241 is not associated with instance 848193dd-e1e9-4a01-adf4-8b55863607f9. Aug 27 20:58:25.291117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:25.296614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Returning 409 to user: Floating IP 172.35.5.241 is not associated with instance 848193dd-e1e9-4a01-adf4-8b55863607f9. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:58:25.297856 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b2bb210-2433-4213-ba04-fd279ef32b07 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action" status: 409 len: 146 microversion: 2.1 time: 1.415595 Aug 27 20:58:25.298828 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1193/2487] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:23 2022] POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action => generated 146 bytes in 1417 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:58:25.307844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:25.308717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:25.331599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.332487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.333157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.337262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.338184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.338844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.692507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:25.692997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:25.694408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:25.696491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:25.697514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:25.731802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.735331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.737630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.738532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.739446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.740040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.778247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Getting quotas for project f44941fb23b241c08ef26b631843b693. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:25.786949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Getting quotas for user 119d47518a96468180e55a660c5d397b and project f44941fb23b241c08ef26b631843b693. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:25.808818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:25.811781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:25.843157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:25.854295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3982d79-befc-4ba5-87b7-eba47b4decec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 200 len: 1479 microversion: 2.1 time: 0.552010 Aug 27 20:58:25.854999 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1194/2488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:25 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 1479 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:25.872687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:25.873353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:25.882104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.882834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.883291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.884066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.884679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.885362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.918057 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864065 Aug 27 20:58:25.919838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1295/2489] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:25.931465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:25.932483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:25.940578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.941659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.942556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:25.957651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:25.958461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:25.960667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:26.537966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:26.575679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2135eb01-0f8d-42a4-ae9c-f95e7ae9b8f1 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1289 microversion: 2.1 time: 0.650960 Aug 27 20:58:26.579271 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1296/2490] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:25 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1289 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:26.599934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Calling method '.version_select at 0x7ff84e66f040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:26.698529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:26.715797 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c17e3a8b-cdd9-4e48-83b8-8d18a63db8dc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.854569 Aug 27 20:58:26.716797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1195/2491] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:25 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:26.736472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:26.737555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:26.747716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:26.748568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:26.749283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:26.750538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:26.752054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:26.752822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.025492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.026023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.029972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.035953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.036627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.037515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.101150 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e25cc920-7508-4411-a2e0-5c3af47271b6 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc/detail" status: 200 len: 672 microversion: 2.36 time: 0.517026 Aug 27 20:58:27.104564 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1297/2492] 10.222.0.40 () {60 vars in 1304 bytes} [Sat Aug 27 20:58:26 2022] GET /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc/detail => generated 672 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:58:27.117098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7aff3d3-bde8-4425-9497-f076941eb88e", "tag": "425d80a0-fb4c-41fe-8c2b-19075304a84f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:27.140361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.145015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.145488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.183094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] Creating event network-changed:425d80a0-fb4c-41fe-8c2b-19075304a84f for instance b7aff3d3-bde8-4425-9497-f076941eb88e on nch2-master-1 Aug 27 20:58:27.185956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:27.202693 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c06d8424-b888-4a56-a8d2-b4b421aaebfe req-49bd7a6b-920b-4169-8feb-4481e13c633b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094790 Aug 27 20:58:27.205208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1298/2493] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:27.209372 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-718aa0c1-669a-4f86-aeef-f5b67af13668 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 0.476204 Aug 27 20:58:27.211203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1196/2494] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:26 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:27.227475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: .version_select at 0x7ff854f21790>, body: {"removeFloatingIp": {"address": "172.35.5.241"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:27.244637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-966998634"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:27.263607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:27.291537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.302110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.306969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.310012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.328333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.345801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.855248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-991b9711-1f26-4294-b895-8c014cedca1c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9/action" status: 202 len: 0 microversion: 2.1 time: 0.640021 Aug 27 20:58:27.859206 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1197/2495] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:27 2022] POST /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:58:27.872313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:27.875979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:27.876107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:27.886737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.889921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.893232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.894405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.895211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.897131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.899526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.902552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.902687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:27.903421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:27.904013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:27.904116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.149161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:28.171194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f4ec8da-ca28-46c6-aef6-83e7b7336085 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1268 microversion: 2.1 time: 0.307448 Aug 27 20:58:28.190498 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1198/2496] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:27 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:28.204051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Action: 'update', calling method: .version_select at 0x7ff84f69b040>, body: {"quota_set": {"ram": "2048"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:28.365222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.365969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.368824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.371418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.373645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.374309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.490569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.498166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.499279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.500346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.502003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.502914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.658413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ca58f7e-7a07-45ef-b020-f66c3bf2e043 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc?user_id=bf247d813c5b452aa52e119e83811005" status: 200 len: 240 microversion: 2.36 time: 0.465832 Aug 27 20:58:28.668519 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1199/2497] 10.222.0.40 () {62 vars in 1384 bytes} [Sat Aug 27 20:58:28 2022] PUT /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc?user_id=bf247d813c5b452aa52e119e83811005 => generated 240 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:58:28.675910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:28.676782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:28.686769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.687272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.687895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.689659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.690363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.690760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.752025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:58:28.753357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquired lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:58:28.881968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:28.891366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6258a4ba-e0d4-4632-8837-e9c8cb743353 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1289 microversion: 2.1 time: 0.221428 Aug 27 20:58:28.893687 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1200/2498] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:28 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1289 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:28.898891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:28.900004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:28.907005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.908342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.909090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:28.910038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:28.910783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:28.911667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:29.598037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:29.605845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:29.608365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-737f8851-1cb0-412b-b9ff-fafc05f1785e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.713443 Aug 27 20:58:29.623975 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1201/2499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:28 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:29.640378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cee722e2-5f5e-4ae1-a711-e8c234d51656 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857d1b160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:29.731972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cee722e2-5f5e-4ae1-a711-e8c234d51656 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.106555 Aug 27 20:58:29.732822 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1202/2500] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:29 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:29.744699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:29.748591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:29.765291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:29.768336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:29.769291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:29.770287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:29.771954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:29.774930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:31.190205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:31.205205 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eff308aa-e81b-431d-9193-88ab158774cc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 1.466332 Aug 27 20:58:31.223974 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1203/2501] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:29 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:31.248935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d6f537d-8702-4265-bccb-d79be6e8a597 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] Calling method '.version_select at 0x7ff84f665f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:31.370216 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d6f537d-8702-4265-bccb-d79be6e8a597 tempest-QuotasAdminTestV236-1393084194 tempest-QuotasAdminTestV236-1393084194-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc?user_id=bf247d813c5b452aa52e119e83811005" status: 200 len: 282 microversion: 2.36 time: 0.143617 Aug 27 20:58:31.370987 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1204/2502] 10.222.0.40 () {60 vars in 1364 bytes} [Sat Aug 27 20:58:31 2022] GET /compute/v2.1/os-quota-sets/69e321b999e4470fb06a3371b924e7bc?user_id=bf247d813c5b452aa52e119e83811005 => generated 282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 20:58:31.378171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:31.379013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:31.387084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:31.387816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:31.388432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:31.389519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:31.390121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:31.390743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:31.658008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:31.675404 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8ccfcbe-78fc-457c-adc1-31cfb6829665 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1274 microversion: 2.1 time: 0.295735 Aug 27 20:58:31.676301 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1205/2503] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:31 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:31.682302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b08606-ff14-4c09-a896-66d93151ecdb", "tag": "b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:31.726141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:31.728648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:31.733073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:31.753685 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] Creating event network-changed:b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3 for instance 68b08606-ff14-4c09-a896-66d93151ecdb on nch1-master-1 Aug 27 20:58:31.769675 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-05312b62-63a4-4a14-b5b8-e4b7580b66d4 req-5d41cba7-cae3-4bfb-b199-1ba3901a6593 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090986 Aug 27 20:58:31.774062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1206/2504] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:31.796512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:31.801525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:31.813666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:31.817177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:31.817887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:31.824823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:31.825860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:31.827242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:32.315184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:32.328420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc2d401e-4df2-4366-9d70-8664f7bfd083 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.552809 Aug 27 20:58:32.343959 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1207/2505] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:31 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:32.374659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:32.375441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:32.399558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:32.400108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:32.400556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:32.401311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:32.401765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:32.402201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:32.546670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:58:32.791240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:32.807908 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b25141ab-2618-458f-9e3b-ab971484d05f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.460898 Aug 27 20:58:32.808516 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1208/2506] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:32 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:32.820730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8764d580-bb25-46a7-aef6-e8cc28f2e193 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84ff08c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:32.912434 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8764d580-bb25-46a7-aef6-e8cc28f2e193 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.102775 Aug 27 20:58:32.920254 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1209/2507] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:32 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:32.925549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e6f3a8-fba1-4323-bb3b-4578b8a086c0", "tag": "50058a7b-1440-46f0-a537-2f7ab9aa6daa"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:32.950598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:32.950598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:32.950766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:32.988634 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] Creating event network-changed:50058a7b-1440-46f0-a537-2f7ab9aa6daa for instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 on nch1-master-1 Aug 27 20:58:32.999211 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b7d39848-a62a-4fd7-9904-072f308a1fb2 req-8459e6ea-594e-4924-bfe2-f046a2849203 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077118 Aug 27 20:58:33.002041 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1210/2508] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:33.016900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:33.018169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:33.042555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:33.043195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:33.047796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:33.049637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:33.050215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:33.050740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:33.555228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:33.568122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f576f837-f67c-4383-a6f9-fa1c54512a80 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 0.562348 Aug 27 20:58:33.592787 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1211/2509] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:33 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:33.601060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:33.601814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:33.615698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:33.616383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:33.617906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:33.618755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:33.624573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:33.628484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:34.177628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:34.188233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b901c29-78d6-4d1c-a1ff-37b12ff62a16 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.594114 Aug 27 20:58:34.189487 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1212/2510] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:33 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:34.194564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:34.195331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:34.208333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:34.209367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:34.209967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:34.210897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:34.211539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:34.212113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:34.933974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:34.943853 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b45e82f4-de73-4e7d-a75f-7b8428fa7e51 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.752853 Aug 27 20:58:34.956023 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1213/2511] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:34 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:34.964349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:34.965247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:34.974008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:34.986440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:34.987214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:34.990534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:34.994570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:34.996526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:35.186052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Updating instance_info_cache with network_info: [{"id": "dc153e44-4059-429a-a508-cf3f76521260", "address": "fa:16:3e:bc:e8:5c", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdc153e44-40", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:35.200011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Releasing lock "refresh_cache-e3c0f46e-25c2-4eec-8880-a726ced5f23b" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:58:35.200919 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d4f0932-40ef-4106-a966-f9292cccd991 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b/action" status: 202 len: 0 microversion: 2.1 time: 7.994335 Aug 27 20:58:35.204874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1299/2512] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:27 2022] POST /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b/action => generated 0 bytes in 7996 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:58:35.209831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7c2773d-e320-4244-a1b1-f16e2c3daf7c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f261dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:35.271065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7c2773d-e320-4244-a1b1-f16e2c3daf7c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.068125 Aug 27 20:58:35.272215 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1300/2513] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:35 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:35.277891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4705ab9d-bd89-489e-9394-9f1981221188", "tag": "67b9a364-db5b-42bd-bc03-65d4bec9d4f3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:35.289276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:35.290004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:35.290660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:35.303761 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] Creating event network-changed:67b9a364-db5b-42bd-bc03-65d4bec9d4f3 for instance 4705ab9d-bd89-489e-9394-9f1981221188 on nch2-master-1 Aug 27 20:58:35.310054 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-5deabb48-8c52-4a4e-88b5-891edb022db3 req-d9fbbbe9-9b7a-41f5-83ce-1e1f8ede1352 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036414 Aug 27 20:58:35.311821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1301/2514] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:35.319203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:35.320076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:35.327786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:35.328865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:35.329675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:35.330556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:35.331266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:35.331886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.102759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:36.114791 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dde75181-8b0f-48cf-bb3f-b3e3a04b0b05 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 1.156859 Aug 27 20:58:36.116124 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1214/2515] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:34 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:36.121440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c0f46e-25c2-4eec-8880-a726ced5f23b", "tag": "dc153e44-4059-429a-a508-cf3f76521260"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:36.151231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.151908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.153834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.175095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] Creating event network-changed:dc153e44-4059-429a-a508-cf3f76521260 for instance e3c0f46e-25c2-4eec-8880-a726ced5f23b on nch2-master-1 Aug 27 20:58:36.192470 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cc328431-16a1-4cee-b052-54daab7c626f req-46d0faf1-3eff-47fe-bd97-d4fb28798b3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063018 Aug 27 20:58:36.194548 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1215/2516] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:36.208432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:36.209757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:36.226765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.233970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.234997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.236248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.236904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.237612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.618957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:36.627806 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5286ca40-9d40-40c7-9a24-1609e8232e8a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 1.314611 Aug 27 20:58:36.647089 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1302/2517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:35 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:36.658925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:36.659333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:36.670748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.671242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.671700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.672397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.672842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.673374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.732073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:58:36.933873 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f97b0415-20f5-4aac-b123-c32f4aa6825c tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 204 len: 0 microversion: 2.1 time: 0.283726 Aug 27 20:58:36.935115 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1303/2518] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:58:36 2022] DELETE /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:58:36.947274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7aff3d3-bde8-4425-9497-f076941eb88e", "name": "network-vif-plugged", "status": "completed", "tag": "425d80a0-fb4c-41fe-8c2b-19075304a84f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:36.963556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:36.964566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:36.965728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:36.987158 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] Creating event network-vif-plugged:425d80a0-fb4c-41fe-8c2b-19075304a84f for instance b7aff3d3-bde8-4425-9497-f076941eb88e on nch2-master-1 Aug 27 20:58:36.994421 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9f1b37a1-195c-4070-9f77-01255c233967 req-69926e31-ec81-4138-99fc-71cff2bae10c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057428 Aug 27 20:58:36.996358 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1304/2519] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:37.004293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:37.006479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:37.018536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.019443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.020503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.021428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.022881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.023602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.024504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:37.072910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:37.099992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:37.107929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7fdc1891-b892-4a49-bceb-5f307ceb0e92 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.911748 Aug 27 20:58:37.119100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1216/2520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:36 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:37.134766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc7a41d5-e80f-4487-9439-f1f36c636895 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857d70160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:37.205225 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc7a41d5-e80f-4487-9439-f1f36c636895 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.084609 Aug 27 20:58:37.205826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1217/2521] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:37 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:37.223116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.241"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:37.225557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:37.237181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.237674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.238308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.239188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.239896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.241071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.302218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:58:37.302891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquired lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:58:37.388440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:37.404067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=6,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:37.414212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-277c44d6-6765-468e-9f72-c288a5331438 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.415907 Aug 27 20:58:37.429907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1305/2522] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:36 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:37.442399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:37.443299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:37.450439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.450929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.451730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.452633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.453235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.453650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.790630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:37.803028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3d73acd-45e9-4c36-ab0c-29f3b99e5437 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.371583 Aug 27 20:58:37.817131 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1306/2523] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:37 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:37.827001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb57d1c3-f5fc-4d49-81f8-d30db3157f93", "tag": "6648f441-dd54-4e83-be99-21014992d6c2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:37.843575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.844684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.845372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.876056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] Creating event network-changed:6648f441-dd54-4e83-be99-21014992d6c2 for instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 on nch1-master-1 Aug 27 20:58:37.882863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-43ac412e-d859-43c9-b845-8681627fc1b5 req-4265bf6e-e874-4f29-9e6c-52d037d76f84 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063655 Aug 27 20:58:37.887867 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1307/2524] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:37.895757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:37.897474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:37.905804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.906630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.907292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:37.908468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:37.909484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:37.910121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:38.538126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=13 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:38.624082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:38.638856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e3f56e9-fbde-466f-83ac-fe278b833880 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1292 microversion: 2.1 time: 0.748802 Aug 27 20:58:38.639588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1308/2525] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:37 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1292 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:38.648941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:38.650374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:38.657291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:38.658492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:38.659573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:38.660530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:38.661210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:38.661982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:39.197826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:39.207016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81186e0c-1667-44a6-bb7c-537136660679 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.566140 Aug 27 20:58:39.219594 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1309/2526] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:38 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:39.219594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7cae3eb3-e346-433f-9d03-b60c9f1bc489 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e642280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:39.265747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7cae3eb3-e346-433f-9d03-b60c9f1bc489 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.056612 Aug 27 20:58:39.266518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1310/2527] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:39 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:39.445956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-236145948", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:39.521673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:40.446687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:40.448830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:40.449564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:40.450126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:40.450804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:40.481605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:40.482368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:40.488797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:40.492485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:40.493635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:40.495670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:40.523916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Getting quotas for project d909cdd2a0f94f94a65a0737a39dd911. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:40.532020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Getting quotas for user 1eaee129221b45b596e46ff13bd034bd and project d909cdd2a0f94f94a65a0737a39dd911. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:40.550466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:40.553317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:40.619437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e32a617a-8129-4660-ba2e-1cec96de6333 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351178 Aug 27 20:58:40.626190 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1311/2528] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:40.631361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392e6399-0788-42cd-91a9-9650efaf3b08", "tag": "6ff904d4-2703-47cc-abe2-69880fa06b9c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:40.656257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:40.657700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:40.658324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:40.670367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] Creating event network-changed:6ff904d4-2703-47cc-abe2-69880fa06b9c for instance 392e6399-0788-42cd-91a9-9650efaf3b08 on nch2-master-1 Aug 27 20:58:40.677253 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ef894cad-c8bc-456b-96d5-a41b819d2893 req-10c8f053-f265-4f7c-9826-f3664ed6e782 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049552 Aug 27 20:58:40.678173 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1312/2529] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:40.684007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:40.684944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:40.693331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:40.694007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:40.694653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:40.706083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:40.707491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:40.708166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:41.022173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Building network info cache for instance {{(pid=140433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:58:41.145664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:41.161846 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-891f7266-f2d0-4dea-85bf-79905f408a8a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.482274 Aug 27 20:58:41.162644 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1313/2530] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:40 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:41.168165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:41.169883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:41.182496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:41.183204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:41.183888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:41.185797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:41.186914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:41.187536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:41.361156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:41.593264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:41.605313 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee0cd86d-da43-4e06-a597-08b20daee2bc tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.440705 Aug 27 20:58:41.680455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1314/2531] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:41 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:41.714012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2807b8-4761-4028-bcfe-ab65761a19f9", "name": "network-vif-plugged", "status": "completed", "tag": "41405498-6abd-4854-80fa-b5e83fbf5a35"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:41.753320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:41.759529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:41.763085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:41.832029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] Creating event network-vif-plugged:41405498-6abd-4854-80fa-b5e83fbf5a35 for instance ff2807b8-4761-4028-bcfe-ab65761a19f9 on nch1-master-1 Aug 27 20:58:41.856454 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c291b456-acfc-4cb8-ba88-578a24c54dac req-3098645d-ec34-4b67-a1e8-22f79ad78624 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169574 Aug 27 20:58:41.857084 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1315/2532] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:41.865811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:41.866843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:41.883090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:41.884632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:41.885251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:41.886101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:41.888894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:41.889488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:43.527916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:43.541603 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1ec92d5f-0934-455d-a656-8b77b9703b67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1474 microversion: 2.1 time: 1.683207 Aug 27 20:58:43.561644 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1316/2533] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:41 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1474 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:43.597248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c0f46e-25c2-4eec-8880-a726ced5f23b", "name": "network-vif-deleted", "tag": "dc153e44-4059-429a-a508-cf3f76521260"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:43.634647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:43.635543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:43.636209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:43.667611 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] Creating event network-vif-deleted:dc153e44-4059-429a-a508-cf3f76521260 for instance e3c0f46e-25c2-4eec-8880-a726ced5f23b on nch2-master-1 Aug 27 20:58:43.679909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-61931cec-9a00-4e22-8e27-c3025ea74383 req-95a1f478-a21f-45c8-8776-5657b292da65 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116488 Aug 27 20:58:43.689290 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1317/2534] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:43.702643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:43.703807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:43.725009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:43.730323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:43.732790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:43.738151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:43.742098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:43.742823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:43.933493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Updating instance_info_cache with network_info: [{"id": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d", "address": "fa:16:3e:b8:db:0f", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa812c4bc-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:43.954862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Releasing lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:58:43.956275 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3602abe8-445c-4dc0-83dd-e00465d70229 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action" status: 202 len: 0 microversion: 2.1 time: 6.737875 Aug 27 20:58:43.964202 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1218/2535] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:37 2022] POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action => generated 0 bytes in 6758 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:58:43.981845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc1e8df7-5178-4350-9955-f11504f4dd14 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff857d709d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:44.813429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:44.823052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-526cbb18-bf7d-40b2-9fdd-f36daf2d7883 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 1.131049 Aug 27 20:58:44.827642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1318/2536] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:43 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:44.852956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:44.863233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:44.891205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:44.892075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:44.893184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:44.900176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:44.900977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:44.901575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:45.176460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:45.188221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49d8b0ac-0da1-43d1-9ea7-e045de161700 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1279 microversion: 2.1 time: 0.342705 Aug 27 20:58:45.207129 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1319/2537] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:44 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1279 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:45.216584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:45.228679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:45.250283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:45.250792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:45.251411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:45.252141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:45.252681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:45.253004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:45.694164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:45.703269 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef9423d5-990b-401b-b3bd-85f367c1ab39 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.494735 Aug 27 20:58:45.722540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1320/2538] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:45 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:45.729812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:45.730428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:45.747510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:45.752575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:45.753265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:45.754061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:45.754544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:45.754985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:46.374618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:46.406442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1332f41-24cb-4849-967a-2cfbc57df7a5 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.682627 Aug 27 20:58:46.420916 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1321/2539] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:45 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:46.456606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:46.517943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:46.518858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:46.521347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:46.589251 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] Creating event network-changed:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:58:46.613222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8ab9199e-3fbc-4909-99a7-87d6e41dfbdd req-0f37fad9-c446-439b-9158-9c457c3eb1bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187973 Aug 27 20:58:46.628567 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1322/2540] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:46.671239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1036578830", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:46.903406 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc1e8df7-5178-4350-9955-f11504f4dd14 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 2.937095 Aug 27 20:58:46.904252 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1219/2541] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:43 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 2939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:46.918192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:58:46.922849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3911a44-7404-43c9-b986-1e8fb37b33cc tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '.version_select at 0x7ff84f1c0a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:47.230767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:47.759412 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3911a44-7404-43c9-b986-1e8fb37b33cc tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/1f7f6135-23d5-4357-81fd-799e186aeb1e" status: 200 len: 184 microversion: 2.1 time: 0.850454 Aug 27 20:58:47.761934 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1220/2542] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 20:58:46 2022] GET /compute/v2.1/os-floating-ips/1f7f6135-23d5-4357-81fd-799e186aeb1e => generated 184 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:47.780427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b08606-ff14-4c09-a896-66d93151ecdb", "name": "network-vif-plugged", "status": "completed", "tag": "b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3"}, {"server_uuid": "4705ab9d-bd89-489e-9394-9f1981221188", "name": "network-vif-plugged", "status": "completed", "tag": "67b9a364-db5b-42bd-bc03-65d4bec9d4f3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:47.869293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:47.872688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:47.878697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:47.947861 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Creating event network-vif-plugged:b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3 for instance 68b08606-ff14-4c09-a896-66d93151ecdb on nch1-master-1 Aug 27 20:58:47.964432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] Creating event network-vif-plugged:67b9a364-db5b-42bd-bc03-65d4bec9d4f3 for instance 4705ab9d-bd89-489e-9394-9f1981221188 on nch2-master-1 Aug 27 20:58:48.001307 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-45bc83e5-ab52-4a98-979c-db354de41e54 req-92ef680f-d1ff-46ac-b027-2d0e9289420c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.229215 Aug 27 20:58:48.002369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1221/2543] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:48.050460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:48.055784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:48.109294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:48.109801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:48.120660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:48.121435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:48.121928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:48.122372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:48.803865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:58:48.804852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:58:48.806616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:58:48.807183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:58:48.807773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:58:48.826532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:48.838864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:48.842545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:48.843894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:48.847098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:48.847787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:48.848388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:48.903698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:48.927439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c9bb166-128a-4712-b7f6-a87f0eb9a61b tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.923366 Aug 27 20:58:48.930875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1222/2544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:48 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:48.949362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:48.949997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:48.972206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:58:48.982922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:48.983540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:48.983988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:48.984745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:49.001407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:49.001946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:49.003592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:58:49.033935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:58:49.042944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:58:49.150514 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d58da7de-40c0-48be-977d-23c8c282c7c3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514495 Aug 27 20:58:49.156895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1323/2545] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:58:49.163947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:49.164596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:49.180834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:49.182157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:49.182666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:49.183714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:49.192560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:49.193059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:49.194110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:49.198733 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42759d39-6994-4840-9b28-962f68715897 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1279 microversion: 2.1 time: 0.266389 Aug 27 20:58:49.203419 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1223/2546] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:48 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:49.220539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:49.224037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:49.253949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:49.254640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:49.255097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:49.255840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:49.259095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:49.259585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:49.720353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:49.731718 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-136b95f5-7885-4fdc-a409-fab5190f6fbe tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.574342 Aug 27 20:58:49.737729 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1324/2547] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:49 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:49.760588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.241"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:49.812289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:49.830364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-562bb057-9bed-452e-ae1c-3d485ced1796 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1322 microversion: 2.1 time: 0.624122 Aug 27 20:58:49.830985 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1224/2548] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:49 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:49.844296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0d8a2c6-ad0a-4742-baec-87dfb1f7349c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f32a820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:49.938436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0d8a2c6-ad0a-4742-baec-87dfb1f7349c tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.102779 Aug 27 20:58:49.946133 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1225/2549] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:49 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:49.958193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:49.958869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:50.041232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:58:50.092606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:50.093134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:50.106862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:50.167387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:50.178411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:50.180606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:50.183300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:50.185520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:50.186688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:50.188597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:50.275395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'flavor' on Instance uuid 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:50.469946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'system_metadata' on Instance uuid 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:50.714289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'metadata' on Instance uuid 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:50.784384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:51.135013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:51.156119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:51.157343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:51.381706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Compute host nch1-master-1 not found during service up check, going to local delete instance {{(pid=140433) _delete /opt/stack/nova/nova/compute/api.py:2526}} Aug 27 20:58:51.382187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Doing local delete in cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140433) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 20:58:51.383076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:51.383590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:51.384030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:51.384475 ncdv-master-1 devstack@n-api.service[140433]: WARNING nova.compute.api [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] instance's host nch1-master-1 is down, deleting from database Aug 27 20:58:51.385597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'flavor' on Instance uuid 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:51.403302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'metadata' on Instance uuid 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:58:51.425600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] deallocate_for_instance() {{(pid=140433) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 20:58:51.530804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Instance cache missing network info. {{(pid=140433) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Aug 27 20:58:51.546065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Updating instance_info_cache with network_info: [] {{(pid=140433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:51.733437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:58:51.734966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquired lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:58:52.160525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.scheduler.client.report [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Deleted allocations for instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 Aug 27 20:58:52.514284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-28f6ae63-44ae-467a-9e7c-0f91a13eec0b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1" status: 204 len: 0 microversion: 2.1 time: 2.570338 Aug 27 20:58:52.519328 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1226/2550] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:58:49 2022] DELETE /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 => generated 0 bytes in 2574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:58:52.525491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:52.526134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:52.534880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:52.535513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:52.535965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:52.536879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:52.537477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:52.537968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:53.107089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:53.124836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c26840b4-a3de-4b8a-930e-1272f8639918 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.603519 Aug 27 20:58:53.136327 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1227/2551] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:52 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:53.143501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e6f3a8-fba1-4323-bb3b-4578b8a086c0", "name": "network-vif-plugged", "status": "completed", "tag": "50058a7b-1440-46f0-a537-2f7ab9aa6daa"}, {"server_uuid": "eb57d1c3-f5fc-4d49-81f8-d30db3157f93", "name": "network-vif-plugged", "status": "completed", "tag": "6648f441-dd54-4e83-be99-21014992d6c2"}, {"server_uuid": "392e6399-0788-42cd-91a9-9650efaf3b08", "name": "network-vif-plugged", "status": "completed", "tag": "6ff904d4-2703-47cc-abe2-69880fa06b9c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:53.156833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:53.157479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:53.158087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:53.192457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Creating event network-vif-plugged:50058a7b-1440-46f0-a537-2f7ab9aa6daa for instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 on nch1-master-1 Aug 27 20:58:53.193271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Creating event network-vif-plugged:6648f441-dd54-4e83-be99-21014992d6c2 for instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 on nch1-master-1 Aug 27 20:58:53.193632 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] Creating event network-vif-plugged:6ff904d4-2703-47cc-abe2-69880fa06b9c for instance 392e6399-0788-42cd-91a9-9650efaf3b08 on nch2-master-1 Aug 27 20:58:53.208352 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-db00df1d-434a-4348-b750-71b29bf24c7f req-50f5b520-3191-4cc7-9ade-29e4e3b231d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069355 Aug 27 20:58:53.208352 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1228/2552] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:53.215598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:53.216671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:53.236937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:53.237534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:53.237995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:53.238769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:53.239246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:53.241487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:54.133020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:54.147459 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad019c36-d9c9-4142-b80b-37191f2bfad0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1321 microversion: 2.1 time: 0.937077 Aug 27 20:58:54.152433 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1229/2553] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:53 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1321 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:54.171282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:54.177381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:54.189463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:54.190090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:54.192489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:54.193256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:54.193832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:54.208029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:54.460690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:54.483915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:58:54.487227 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1381d3d4-9b86-4c64-8350-00891dfeffd8 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1331 microversion: 2.1 time: 0.332959 Aug 27 20:58:54.497161 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1230/2554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:54 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1331 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:54.519629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:54.519629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:54.531403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:54.534272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:54.534958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:54.538539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:54.539809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:54.540614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:55.353106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:55.365000 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5361dc0b-7d47-4ea1-aec3-14d6522c26fe tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1516 microversion: 2.1 time: 0.865953 Aug 27 20:58:55.365772 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1231/2555] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:54 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1516 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:55.401471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c8d0551-3120-4479-9b45-c78d023ad1cd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f145f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:55.499090 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c8d0551-3120-4479-9b45-c78d023ad1cd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1437 microversion: 2.1 time: 0.118477 Aug 27 20:58:55.506530 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1232/2556] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:55 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1437 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:55.527579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:55.533599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:55.543563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:55.544405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:55.545041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:55.546584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:55.547260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:55.548073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:55.573245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 HTTP/1.1 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7268dfc6-5d34-43fe-8fb9-f314a38cd7b1'} Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:55.584312 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8274c8e2-1e20-4a9e-ae8d-0012b8c49c23 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1" status: 404 len: 111 microversion: 2.1 time: 0.077244 Aug 27 20:58:55.588196 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1233/2557] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:55 2022] GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:58:55.601567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0945198a-59f1-42c7-af44-6b0d56c21537", "tag": "f1dd7e6f-9356-4065-bb67-243f6b95f497"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:55.641298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:55.642723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:55.648901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:55.681295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] Creating event network-changed:f1dd7e6f-9356-4065-bb67-243f6b95f497 for instance 0945198a-59f1-42c7-af44-6b0d56c21537 on nch2-master-1 Aug 27 20:58:55.725792 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-acb07a0d-a2a5-403e-b3c1-8b4f09e5259c req-d6fb6e84-859d-4087-a18b-9783ed59600e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131069 Aug 27 20:58:55.729469 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1234/2558] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:58:55.746505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:55.747580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:55.773892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:55.778422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:55.780192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:55.781190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:55.781808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:55.782793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.362488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Updating instance_info_cache with network_info: [{"id": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d", "address": "fa:16:3e:b8:db:0f", "network": {"id": "4f261ca6-acbc-469d-a994-54baa54a161a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1538561385-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dced4e2c73df4f4485ef8442b0afe00e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa812c4bc-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:58:56.384662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Releasing lock "refresh_cache-848193dd-e1e9-4a01-adf4-8b55863607f9" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:58:56.386040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9e12d45-9618-4d4b-af76-c31dc6b8abcb tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action" status: 202 len: 0 microversion: 2.1 time: 6.646718 Aug 27 20:58:56.386735 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1325/2559] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:58:49 2022] POST /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9/action => generated 0 bytes in 6648 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:58:56.388881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:56.398637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:56.399289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:56.400626 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1b8baff-0c20-4454-9418-9a8960f0acc5 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1316 microversion: 2.1 time: 0.669644 Aug 27 20:58:56.402567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1235/2560] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:55 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:56.409258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:56.410180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:56.417572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.418068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.419245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.420115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.420758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.421747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.422404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.423937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.443763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.444940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.446519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.447148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.722651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:56.737475 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6dc5162-4cb7-4382-940d-a85c11816159 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1515 microversion: 2.1 time: 0.332344 Aug 27 20:58:56.740704 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1236/2561] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:56 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:56.746116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:56.746732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:56.782706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.783212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.790966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.791821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:56.792331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:56.792761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:56.827094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:56.840979 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-595c326a-7889-479f-be86-7501e10d047b tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1321 microversion: 2.1 time: 0.452875 Aug 27 20:58:56.850475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1326/2562] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:56 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:56.855885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-175629447", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:58:57.013376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:58:57.016461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:57.025173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd2abb26-2faa-4422-8242-7e76b13ba542 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1535 microversion: 2.1 time: 0.283342 Aug 27 20:58:57.026570 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1237/2563] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:58:56 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1535 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:58:57.031536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:57.032739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:58:57.050111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:57.050991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:57.051799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:57.052677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:58:57.053288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:58:57.053868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:58:57.089601 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] HTTP exception thrown: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Request method failure captured: Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b HTTP/1.1 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoUeJNWjsfCZhZaeMPqJpajzhcpsOledBPRLczsSOaqOk1toDc9XXLRLXNlJtAHe6ewJVCWYY7VL4hgDGwJbACk1yG24l3QR4WDPP-UW9yqIjMfim_PrgAAZ73MlD5gDWudJ884PnAycW_NiRH_gfndSyG4vDJVLfQKhknNSpswyN3g Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dced4e2c73df4f4485ef8442b0afe00e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}] Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8c6a5cc460f744ee8b958eafbe2e995b Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e3c0f46e-25c2-4eec-8880-a726ced5f23b'} Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:58:57.092198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:58:57.096475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:58:57.098238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Returning 404 to user: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:58:57.102246 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89fda06f-6603-45e6-ada7-8ffd2225b36b tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 404 len: 111 microversion: 2.1 time: 0.071647 Aug 27 20:58:57.103052 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1238/2564] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:58:57 2022] DELETE /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:58:57.115813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27511f83-d521-41f8-88c1-a54c8e3df546 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f145d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:58:58.897971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:58:59.022395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:00.966084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:00.981764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27511f83-d521-41f8-88c1-a54c8e3df546 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1446 microversion: 2.1 time: 3.877131 Aug 27 20:59:00.986903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1239/2565] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:58:57 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1446 bytes in 3883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:00.998287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:00.998933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:01.007754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.008256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.008702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.009418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.009879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.010870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.237334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:01.249972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47ee3ba7-3abd-449c-aebc-e3a33e25a63b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 200 len: 1516 microversion: 2.1 time: 0.260710 Aug 27 20:59:01.254074 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1240/2566] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:00 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:01.263066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f9c3e41-676b-4d55-a4dc-112c7a735870 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'create', calling method: .version_select at 0x7ff84f0799d0>, body: {"pool": "ec7c1b95-2dc9-4874-b493-291fb9275706"} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:01.379184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:01.799990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:01.801149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:01.801704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:01.802207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:01.802700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:01.818101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.819478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.820123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.821055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.821717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.822367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.842001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:01.861077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:01.868649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:01.884751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:01.887651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:01.941215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d23b3673-14bf-4ea1-9857-803f2ba574d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.089111 Aug 27 20:59:01.942757 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1327/2567] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 5091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:01.948131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:01.949512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: e3c0f46e-25c2-4eec-8880-a726ced5f23b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:01.956704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.957443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.958050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.958941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:01.959581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:01.960156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:01.979780 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] HTTP exception thrown: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Request method failure captured: Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b HTTP/1.1 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUeJNWjsfCZhZaeMPqJpajzhcpsOledBPRLczsSOaqOk1toDc9XXLRLXNlJtAHe6ewJVCWYY7VL4hgDGwJbACk1yG24l3QR4WDPP-UW9yqIjMfim_PrgAAZ73MlD5gDWudJ884PnAycW_NiRH_gfndSyG4vDJVLfQKhknNSpswyN3g Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dced4e2c73df4f4485ef8442b0afe00e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}] Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8c6a5cc460f744ee8b958eafbe2e995b Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'e3c0f46e-25c2-4eec-8880-a726ced5f23b'} Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:01.982029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. Aug 27 20:59:01.985881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:01.988140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Returning 404 to user: Instance e3c0f46e-25c2-4eec-8880-a726ced5f23b could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:01.989205 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25fb12f9-a516-446d-8c1a-2aa3c1244681 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b" status: 404 len: 111 microversion: 2.1 time: 0.044870 Aug 27 20:59:01.989987 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1328/2568] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:01 2022] GET /compute/v2.1/servers/e3c0f46e-25c2-4eec-8880-a726ced5f23b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:01.996023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:01.996891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:02.004176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.005039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.005687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.006614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.007269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.008154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.260086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:02.273125 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14c39eb9-abfe-4286-96c6-2be35f123ceb tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1505 microversion: 2.1 time: 0.281842 Aug 27 20:59:02.273713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1329/2569] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:01 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:02.286143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:02.288542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:02.314034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.315121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.315958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.325635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.326553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.328597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.682497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:02.695116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbc86d29-f0ea-4579-89e5-c52a72fd26f3 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1321 microversion: 2.1 time: 0.418096 Aug 27 20:59:02.695866 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1330/2570] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:02 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:02.700604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:02.729827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.730477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.730913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.752975 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] Creating event network-changed:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:59:02.763425 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-256eb92c-e92d-4561-879e-6354f168ac44 req-b557c457-6a1f-4bab-95f3-ea2c7e13a924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066139 Aug 27 20:59:02.770851 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1331/2571] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:02.779959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb370d24-b594-49a5-a62c-1d43af683320 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e53c8b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:02.853450 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb370d24-b594-49a5-a62c-1d43af683320 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 200 len: 1446 microversion: 2.1 time: 0.080892 Aug 27 20:59:02.863384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1332/2572] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:59:02 2022] GET /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:02.868431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:02.869115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:02.875943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.877222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.877674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.878398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:02.878852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:02.879277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:02.927680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:03.098593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c190d2d2-65ff-4417-a69b-af58e2f939e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 204 len: 0 microversion: 2.1 time: 0.233849 Aug 27 20:59:03.099229 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1333/2573] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:02 2022] DELETE /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:03.104660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:03.105672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:03.113271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:03.114056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:03.116114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:03.117099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:03.117745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:03.118330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:03.225752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:03.235064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-538a55e6-ff75-46c3-a061-ecae012aa695 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1272 microversion: 2.1 time: 0.134548 Aug 27 20:59:03.247367 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1334/2574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:03 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:03.247367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e24656dd-889d-4dec-9b1c-4e3e59914850 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '.version_select at 0x7ff84e53c5e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:03.675719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f9c3e41-676b-4d55-a4dc-112c7a735870 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.419977 Aug 27 20:59:03.676507 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1241/2575] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:59:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:03.690165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:03.690721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:03.699179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:03.699924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:03.700550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:03.701409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:03.702017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:03.702665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:03.750872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:03.752208 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b36d403-abb5-4ed9-a4d5-77a62c8a3225 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/os-instance-actions/req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884" status: 200 len: 313 microversion: 2.1 time: 0.067012 Aug 27 20:59:03.760865 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1242/2576] 10.222.0.40 () {58 vars in 1419 bytes} [Sat Aug 27 20:59:03 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/os-instance-actions/req-c66d6aa3-80fd-4fe5-bc3e-39e5e29d3884 => generated 313 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:03.770021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0945198a-59f1-42c7-af44-6b0d56c21537", "name": "network-vif-plugged", "status": "completed", "tag": "f1dd7e6f-9356-4065-bb67-243f6b95f497"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:03.781373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:03.782139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:03.783368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:03.801764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] Creating event network-vif-plugged:f1dd7e6f-9356-4065-bb67-243f6b95f497 for instance 0945198a-59f1-42c7-af44-6b0d56c21537 on nch2-master-1 Aug 27 20:59:03.807457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8662137a-7bbe-4d3f-b4f7-facb83046350 req-217a7dcf-521f-4a59-b3ba-dff36aff0eac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045102 Aug 27 20:59:03.808567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1243/2577] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:03.815741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-13a085bc-b23d-4e24-94df-2dbab90cffec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f079f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:04.377428 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e24656dd-889d-4dec-9b1c-4e3e59914850 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/1f7f6135-23d5-4357-81fd-799e186aeb1e" status: 202 len: 0 microversion: 2.1 time: 1.140042 Aug 27 20:59:04.378721 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1335/2578] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:59:03 2022] DELETE /compute/v2.1/os-floating-ips/1f7f6135-23d5-4357-81fd-799e186aeb1e => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:59:04.386779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:04.387683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:04.398004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.399163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.399871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:04.400860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.401467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.402097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:04.491307 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-13a085bc-b23d-4e24-94df-2dbab90cffec tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 204 len: 0 microversion: 2.1 time: 0.681291 Aug 27 20:59:04.491918 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1244/2579] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:03 2022] DELETE /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:04.496986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.244"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:04.500529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:04.517509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.518040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.518495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:04.519248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.519758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.520188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:04.592026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:59:04.592431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquired lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:59:04.627050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:04.638320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15d8854e-aa4f-4ef9-acda-68faed41a44a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 200 len: 1522 microversion: 2.1 time: 0.258129 Aug 27 20:59:04.647412 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1336/2580] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:04 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:04.659964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:04.660704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:04.670463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.671299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.671987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:04.674306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:04.676614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:04.677266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.424292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:05.433411 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cab8139f-e17d-4a37-98f6-75627b7e638c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1321 microversion: 2.1 time: 0.790151 Aug 27 20:59:05.434005 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1337/2581] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:04 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1321 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:05.441497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:05.444118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:05.456518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.457244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.458436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.459305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.459936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.460501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.580769 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08a65430-43bf-4222-b3e6-41c80dcec9ce tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "POST /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/action" status: 202 len: 0 microversion: 2.1 time: 0.142675 Aug 27 20:59:05.582605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1338/2582] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:05 2022] POST /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:59:05.592691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:05.593412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:05.604395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.604898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.605340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.606060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.606519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.607214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.730475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:05.738743 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6b611a5-15ec-43f4-bb91-f1931a597e49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1290 microversion: 2.1 time: 0.156009 Aug 27 20:59:05.769232 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1339/2583] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:05 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1290 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:05.774363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:05.774883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:05.793747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.794249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.794885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.802669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:05.803408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:05.804001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:05.877299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:06.721627 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8535e1e-9993-41ca-954d-668dc38d95d9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "DELETE /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 204 len: 0 microversion: 2.1 time: 0.950107 Aug 27 20:59:06.723722 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1340/2584] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:05 2022] DELETE /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 0 bytes in 954 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:06.730958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:06.731831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:06.741066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:06.742508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:06.743673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:06.744550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:06.745152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:06.745861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:06.786421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:06.858482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:06.906250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c68eb888-00a3-4205-8d3c-c026f9abe14f tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 204 len: 0 microversion: 2.1 time: 0.180182 Aug 27 20:59:06.910685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1341/2585] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:06 2022] DELETE /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:06.937495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:06.944913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:06.957980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:06.960823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:06.962510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:06.963520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:06.977694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:06.978174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.459533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:07.476477 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f34b3d66-86a1-4ef5-8b63-258f89382b9a tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1507 microversion: 2.1 time: 0.548283 Aug 27 20:59:07.477665 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1342/2586] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:06 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:07.483952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:07.483952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:07.507172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.508243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.508396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.509186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.509727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.510213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.522115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Building network info cache for instance {{(pid=140433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:59:07.599490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.600124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.600643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.601236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lazy-loading 'fault' on Instance uuid 68b08606-ff14-4c09-a896-66d93151ecdb {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:07.689258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:07.698015 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-240e8bee-8ed2-4a3b-98a1-fd6e756f30f3 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 200 len: 1312 microversion: 2.1 time: 0.219118 Aug 27 20:59:07.699263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1343/2587] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:07 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:07.707522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2807b8-4761-4028-bcfe-ab65761a19f9", "name": "network-vif-unplugged", "status": "completed", "tag": "41405498-6abd-4854-80fa-b5e83fbf5a35"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:07.733130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.733788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.734037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.753665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] Creating event network-vif-unplugged:41405498-6abd-4854-80fa-b5e83fbf5a35 for instance ff2807b8-4761-4028-bcfe-ab65761a19f9 on nch1-master-1 Aug 27 20:59:07.811496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-639da9d6-7c89-4f5a-813a-309acd16912d req-787c8e52-5131-4531-aa34-8f274776cf7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110821 Aug 27 20:59:07.812123 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1344/2588] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:07.818040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b08606-ff14-4c09-a896-66d93151ecdb", "name": "network-vif-deleted", "tag": "b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:07.843109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.843906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.845569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.864954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] Creating event network-vif-deleted:b7015fb4-25bc-4483-87dd-d4dcc8e7aaa3 for instance 68b08606-ff14-4c09-a896-66d93151ecdb on nch1-master-1 Aug 27 20:59:07.873317 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-67822560-1ec5-4539-b1dc-4defdddfd68c req-afa61e8d-256b-4b3b-add4-8e7bf1c74015 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059356 Aug 27 20:59:07.874375 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1345/2589] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:07.890243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:07.891044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:07.903956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.904447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.904886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:07.905597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:07.906054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:07.906478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:08.213457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:08.224806 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62313cf2-8f24-4861-a915-f65a1108a773 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1471 microversion: 2.1 time: 0.349214 Aug 27 20:59:08.229825 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1346/2590] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:07 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:08.240438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:08.243909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:08.258027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:08.258538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:08.258986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:08.259746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:08.264429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:08.264941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:08.542533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:08.552796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59d22516-e065-41ff-8a56-51bd4b441994 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1525 microversion: 2.1 time: 0.321859 Aug 27 20:59:08.556322 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1347/2591] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:08 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:08.562779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:08.564439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:08.572091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Updating instance_info_cache with network_info: [{"id": "6ff904d4-2703-47cc-abe2-69880fa06b9c", "address": "fa:16:3e:89:13:e5", "network": {"id": "55e991bc-e3d2-4ac7-85bd-77602d68921c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1873508102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f3beed612074a54b8ee14f7abcee3ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff904d4-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:59:08.585719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:08.586231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:08.586663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:08.587439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:08.587993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:08.588533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:08.593192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Releasing lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:59:08.594881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c81bdc54-398b-4fce-848a-e7e2cc11c6ea tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 202 len: 0 microversion: 2.1 time: 4.101255 Aug 27 20:59:08.597374 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1245/2592] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:04 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 0 bytes in 4105 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:59:08.604267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1229603667", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5b97881f-89ac-4440-8b19-f267ffb14088"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:08.726988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] validate_networks() for [('5b97881f-89ac-4440-8b19-f267ffb14088', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:09.181018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:09.189169 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a726d172-f0c0-447d-98c0-034a31156a83 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 0.629964 Aug 27 20:59:09.189670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1348/2593] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:08 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:09.194612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392e6399-0788-42cd-91a9-9650efaf3b08", "tag": "6ff904d4-2703-47cc-abe2-69880fa06b9c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:09.205456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.205964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.206398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.218109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] Creating event network-changed:6ff904d4-2703-47cc-abe2-69880fa06b9c for instance 392e6399-0788-42cd-91a9-9650efaf3b08 on nch2-master-1 Aug 27 20:59:09.223622 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-04829260-a32e-483b-a16f-c9b0b8463b50 req-5887627b-eedf-4a1a-833b-f21adc9c5c22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 Aug 27 20:59:09.224257 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1349/2594] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:09.285665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:09.286466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] [instance: a411e514-f004-4dc2-b315-982843d6f022] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:09.293167 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] HTTP exception thrown: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Request method failure captured: Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/a411e514-f004-4dc2-b315-982843d6f022/action HTTP/1.1 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 15 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoV9bUX96td9amrGFQ-6J-e-wegsbF8kPtiiA9bgGKy_O3bJX4dM97fXoMpHCLmy0Zfw148HvAL7x7r2cD7h8IU2nEcYbR-_YjhbhYoORPsPONs1F6PKOG_zctOECzCH487kQs8aKPCp8qEYv2dqU2cx244P7j4OL6lv_wZ1OMZOR4k Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f75ac7cda3f4c249c9985bc25433097", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}] Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5c957c1e21ee4ace90541918dd59fb63 Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: {"migrate": {}} Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a411e514-f004-4dc2-b315-982843d6f022', 'body': {'migrate': {}}} Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:09.302774 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Returning 404 to user: Instance a411e514-f004-4dc2-b315-982843d6f022 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:09.306408 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a09cf01e-d49f-4222-8417-fc212eacaef1 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/a411e514-f004-4dc2-b315-982843d6f022/action" status: 404 len: 111 microversion: 2.1 time: 0.079070 Aug 27 20:59:09.315298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1350/2595] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:09 2022] POST /compute/v2.1/servers/a411e514-f004-4dc2-b315-982843d6f022/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:09.320232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:09.320880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:09.328250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.328952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.329460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.330347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.331170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.332065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.615197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:09.623763 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0a15b0f7-c964-4eab-92b6-7061af8401f8 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1507 microversion: 2.1 time: 0.307246 Aug 27 20:59:09.624376 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1351/2596] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:09 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:09.628952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15e4d658-1738-47a3-9ba9-b761470b7f49 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'create', calling method: .version_select at 0x7ff84e57bf70>, body: {"pool": "ec7c1b95-2dc9-4874-b493-291fb9275706"} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:09.727747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:09.728365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:09.729087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:09.729760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:09.730417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:09.750751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.751309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.752381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.753210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.753668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.754101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.772880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:09.778141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Getting quotas for user ede90e55159a4d3192505c74a2a69a51 and project e1f7e5f0366a4113922c93cee71427d4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:09.791427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:09.793786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:09.843512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20bea9d2-3516-4025-9a30-0ca2d7c77e93 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244682 Aug 27 20:59:09.844426 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1246/2597] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:09.850028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:09.850758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:09.858307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.858818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.859263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.861398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.861878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.862317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.906024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:09.908886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:09.910125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:09.910446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lazy-loading 'fault' on Instance uuid 68b08606-ff14-4c09-a896-66d93151ecdb {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:09.996481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:10.006413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70581e58-9fcd-4186-8c0b-5ea6e1bf57e0 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 200 len: 1312 microversion: 2.1 time: 0.160565 Aug 27 20:59:10.019265 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1247/2598] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:09 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:10.193506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ed14215-e76f-4c65-96ad-77f2ce6ebda6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Action: 'create', calling method: .version_select at 0x7ff84f54d3a0>, body: {"keypair": {"name": "tempest-keypair-1573040286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxpF+lChqOQJVxy/LHSrXFnJ0P2iXkpeAevCPzHAGWaI2Oy+Xjr6p/fziH96MxM1o478FSImiDbW2flpZM+tSdQ+uGlD8jw8we2LcAd7PEmhaS2azoePo5JoO/rVW7f8Q=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:10.215876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2ed14215-e76f-4c65-96ad-77f2ce6ebda6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Getting quotas for project 296e209e3b624bb9a75b2c8fad0b8b5b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:10.222229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2ed14215-e76f-4c65-96ad-77f2ce6ebda6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Getting quotas for user 69894e287f1d457dacc403bf68c314af and project 296e209e3b624bb9a75b2c8fad0b8b5b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:10.249338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ed14215-e76f-4c65-96ad-77f2ce6ebda6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239824 Aug 27 20:59:10.251698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1248/2599] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:59:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:10.257085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1028729636", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:10.351125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:10.819105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:10.819732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:10.820046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:10.820491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:10.820906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:10.832158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:10.832867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:10.833461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:10.834601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:10.835226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:10.835849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:10.855202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Getting quotas for project d909cdd2a0f94f94a65a0737a39dd911. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:10.861898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Getting quotas for user 1eaee129221b45b596e46ff13bd034bd and project d909cdd2a0f94f94a65a0737a39dd911. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:10.876110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:10.878858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:10.891470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:10.926893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec18154e-7cf2-48a0-a710-355796921313 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673808 Aug 27 20:59:10.928206 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1249/2600] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:10.939844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:10.940466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:10.948986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:10.950030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:10.950887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:10.951913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:10.952558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:10.953154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.334734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:11.350093 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be8f72d2-af8f-4973-aedc-e01a5a9e40a3 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1525 microversion: 2.1 time: 0.420673 Aug 27 20:59:11.351423 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1250/2601] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:10 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1525 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:11.365925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:11.366911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:11.381319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:11.382211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:11.382876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.383854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:11.384524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:11.385157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.691735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:11.701978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d72d6d2-40af-4ea6-876b-cfcac7322e56 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1204 microversion: 2.1 time: 0.349119 Aug 27 20:59:11.716919 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1251/2602] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:11 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1204 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:11.723946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ff9cdd-9ec6-47d4-9a94-4b13efbd624f", "tag": "22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:11.735013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:11.735927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:11.736646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.749876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] Creating event network-changed:22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9 for instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f on nch1-master-1 Aug 27 20:59:11.756096 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-866a8584-6f71-46b6-aedd-6a85d86d8383 req-d02bf138-eb51-4d34-b114-615780711e41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037380 Aug 27 20:59:11.757579 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1252/2603] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:11.762926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:11.764018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:11.771392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:11.772089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:11.772734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.773642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:11.774248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:11.774856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:11.842374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:11.878881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:12.167424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:12.177722 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e372f7e-d4ad-4d89-8557-277224984a9f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 0.418726 Aug 27 20:59:12.178845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1253/2604] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:11 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:12.184037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.184627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.191623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.192152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.192969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.193984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.194703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.195736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.663911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15e4d658-1738-47a3-9ba9-b761470b7f49 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.038205 Aug 27 20:59:12.664584 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1352/2605] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 20:59:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:12.668553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:12.678430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.681203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c986e07f-d34d-401a-a84e-03ff76cb2a41 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1505 microversion: 2.1 time: 0.501032 Aug 27 20:59:12.697925 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1254/2606] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:12.698273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.698370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.698370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.698549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.699004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.713685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.725611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] HTTP exception thrown: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb HTTP/1.1 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '68b08606-ff14-4c09-a896-66d93151ecdb'} Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:12.727787 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:12.732180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:12.733572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 404 to user: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:12.735529 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f9b78874-b2fc-4dfc-9aec-68f5bc450d1a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 404 len: 111 microversion: 2.1 time: 0.052712 Aug 27 20:59:12.736467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1255/2607] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:12.742286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848193dd-e1e9-4a01-adf4-8b55863607f9", "name": "network-vif-deleted", "tag": "a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:12.753489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.754002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.754437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.766777 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] Creating event network-vif-deleted:a812c4bc-89b6-4b6a-9d89-dab05e9fdc2d for instance 848193dd-e1e9-4a01-adf4-8b55863607f9 on nch1-master-1 Aug 27 20:59:12.771886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7b5fdbc2-84d2-439f-bcc2-ee8f15019f86 req-5e9816a0-abd4-4388-9edc-0a9fa57c515e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034071 Aug 27 20:59:12.772490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1256/2608] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:12.772625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:12.777717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.778425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.780988 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d57635a1-1f6f-41f2-8763-45b83e1df868 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1218 microversion: 2.1 time: 0.109663 Aug 27 20:59:12.781556 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1353/2609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:12.785454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.785948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.786389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.786831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.158"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:12.787095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.787579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.788010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.789345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.795634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.796121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.796557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.797246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.797757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.798181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.824091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:59:12.824593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquired lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:59:12.863127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:12.871436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4bf34de-aea5-4533-b783-18412460d343 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1483 microversion: 2.1 time: 0.097818 Aug 27 20:59:12.872044 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1257/2610] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1483 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:12.876809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '.version_select at 0x7ff84f151a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.877366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.883747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.884399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.884977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.885828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.886282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.886705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.918138 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa1f9d77-4ecc-4ef1-8d3e-87e395742efd tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.045071 Aug 27 20:59:12.919133 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1258/2611] 10.222.0.40 () {58 vars in 1296 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93/os-instance-actions => generated 611 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:12.923460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:12.926017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:12.930487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.930980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.931457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:12.932168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:12.932664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:12.933091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.027161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:13.036346 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9cf8963-289d-4bfe-9856-1c3b9f10e7ed tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1260 microversion: 2.1 time: 0.116618 Aug 27 20:59:13.036916 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1259/2612] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:12 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1260 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:13.041531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.046621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:13.048792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:13.054011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.054484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.054911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.055653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.056104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.056524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.140570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03f0c8ad-20f2-4178-b4d8-db97b6a74a11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.102441 Aug 27 20:59:13.141269 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1260/2613] 10.222.0.40 () {58 vars in 1230 bytes} [Sat Aug 27 20:59:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:59:13.146071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-787824528", "imageRef": "d0d2668b-46be-4c83-aafb-55772501da5b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c3004410-4abf-4679-b06b-e87cb8e5653a"}], "security_groups": [{"name": "tempest-securitygroup--104093992"}], "key_name": "tempest-keypair-1573040286", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:13.274852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706.", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 20:59:13.275557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Releasing lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:59:13.276115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] HTTP exception thrown: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.276115 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Request method failure captured: Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action HTTP/1.1 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 46 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVkcfjAwRUxA0GPFva0sO1h7JkN8X5Gr70ZROFLaLpj9klca9GqM3lIHoLM8WUegFKayhVmUAGwhlkFUBDqOxvCH0SYwF2MejqDXkZVGBp1T9j6USizpZYTtSnaXtdO0oF2g6pPvPKZGEGtFHbAD-d77maJWUs8UlAiXv9Q2HNUimY Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f3beed612074a54b8ee14f7abcee3ab", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}] Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 18552094160c4c72bccdc1f412e9f95c Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: {"addFloatingIp": {"address": "172.35.5.158"}} Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '392e6399-0788-42cd-91a9-9650efaf3b08', 'body': {'addFloatingIp': {'address': '172.35.5.158'}}} Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 20:59:13.286057 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] Aug 27 20:59:13.290134 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.293426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] validate_networks() for [('c3004410-4abf-4679-b06b-e87cb8e5653a', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:13.293837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Returning 400 to user: Cannot associate floating IP 172.35.5.158 (2e6209c1-2738-46bb-9ffa-69e58f4d81fa) with port 6ff904d4-2703-47cc-abe2-69880fa06b9c using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network ec7c1b95-2dc9-4874-b493-291fb9275706. Aug 27 20:59:13.293837 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-6de22e09-685d-4682-928b-496ba7ffcf2f'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:13.293837 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b33030a3-05a6-480b-b525-7e825fa7422a tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 400 len: 381 microversion: 2.1 time: 0.506803 Aug 27 20:59:13.293837 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1354/2614] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:12 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 381 bytes in 509 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:13.297102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.298001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:13.308383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.311170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.311726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.312505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.312955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.313380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.347625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:13.429121 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cb2c957-a447-46a7-98a2-d24314f417e7 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 204 len: 0 microversion: 2.1 time: 0.136012 Aug 27 20:59:13.429717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1355/2615] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:13 2022] DELETE /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:13.434648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b01bfe6-4117-4a28-8fda-aef351830f48 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b01bfe6-4117-4a28-8fda-aef351830f48 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 20:59:13.452671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b01bfe6-4117-4a28-8fda-aef351830f48 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b01bfe6-4117-4a28-8fda-aef351830f48 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.023858 Aug 27 20:59:13.460917 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1356/2616] 10.222.0.40 () {58 vars in 1182 bytes} [Sat Aug 27 20:59:13 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:13.462073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.462828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:13.470862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.471566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.472077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.472854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.473318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.473750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.694883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:13.706327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-797d35ca-0f64-47c2-969f-7e51151da77a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 0.249608 Aug 27 20:59:13.706918 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1357/2617] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:13 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:13.711653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59d8410a-a8ac-4cf3-ac7b-ca3174024c3b tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '.version_select at 0x7ff84f2070d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.826406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:13.826828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:13.827297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:13.827728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:13.828160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:13.839307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.840005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.840661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.841758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.842215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.842645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.860663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Getting quotas for project 296e209e3b624bb9a75b2c8fad0b8b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:13.865929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Getting quotas for user 69894e287f1d457dacc403bf68c314af and project 296e209e3b624bb9a75b2c8fad0b8b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:13.879614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:13.882011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d0d2668b-46be-4c83-aafb-55772501da5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:13.931780 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cb5de11-a55c-46ab-ba75-2430d44e7211 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.789166 Aug 27 20:59:13.932445 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1261/2618] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:13.937092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:13.937710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:13.944586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.945012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.945451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:13.946156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:13.946610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:13.947037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.248762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.261671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94f4a89b-89af-49a5-956a-1770d15f7cb3 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1511 microversion: 2.1 time: 0.325111 Aug 27 20:59:14.277059 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1262/2619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:13 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:14.288615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.299647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.300405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:14.313748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.315020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.316049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.317051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.317673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.318274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.336144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:14.349351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:59:14.382690 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c556a489-dd37-45cd-843c-133683d146d8 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.104126 Aug 27 20:59:14.383282 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1263/2620] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers => generated 681 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:14.387929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2807b8-4761-4028-bcfe-ab65761a19f9", "name": "network-vif-deleted", "tag": "41405498-6abd-4854-80fa-b5e83fbf5a35"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:14.398658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.399538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.400260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.414279 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] Creating event network-vif-deleted:41405498-6abd-4854-80fa-b5e83fbf5a35 for instance ff2807b8-4761-4028-bcfe-ab65761a19f9 on nch1-master-1 Aug 27 20:59:14.419307 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5a0d6035-8298-4bbf-ac7a-f8e04accb62d req-b3e20dae-3cb3-46f9-bdce-2d75e846f810 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034715 Aug 27 20:59:14.420256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1264/2621] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:14.425776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.426482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:14.433282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.434025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.434641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.435576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.436047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.436478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.631279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.640110 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed1de654-b02b-4022-ad0e-d458f4e9b2c0 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1274 microversion: 2.1 time: 0.218651 Aug 27 20:59:14.640789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1265/2622] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:14.645588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.646196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:14.652108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.652768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.653208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.654106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.654568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.654999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.750879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.759494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cba4f86-8c93-4726-9092-3983b6280b06 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1308 microversion: 2.1 time: 0.117577 Aug 27 20:59:14.760187 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1266/2623] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:14.765171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.766083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:14.776904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.778136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.778595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.779981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.780469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.781118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.798582 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59d8410a-a8ac-4cf3-ac7b-ca3174024c3b tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/2e6209c1-2738-46bb-9ffa-69e58f4d81fa" status: 202 len: 0 microversion: 2.1 time: 1.090524 Aug 27 20:59:14.802940 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1358/2624] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:59:13 2022] DELETE /compute/v2.1/os-floating-ips/2e6209c1-2738-46bb-9ffa-69e58f4d81fa => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:59:14.805846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.806471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:14.814630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.815129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.815871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.816585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.817197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.817779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.850712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.859658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f6481d80-23d0-4e07-b72b-8684f3b4a2dc tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1297 microversion: 2.1 time: 0.098255 Aug 27 20:59:14.861593 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1267/2625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:14.866278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.871651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.872451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.compute.servers [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Removing options 'limit' from query {{(pid=140433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 20:59:14.873232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:14.878905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.879388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.879831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.880574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.881058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.881482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.887979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:14.897063 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5caf9ff5-b8df-4e65-8ea3-814e16be5829 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1260 microversion: 2.1 time: 0.096198 Aug 27 20:59:14.899752 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1359/2626] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1260 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:14.912145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:14.912920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:14.916468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:59:14.919038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.919584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.920029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.920734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:14.921185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:14.921617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:14.948592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec633698-83ef-40f6-8f36-7c00e6cbaa5f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.085845 Aug 27 20:59:14.950014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1268/2627] 10.222.0.40 () {58 vars in 1144 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:14.956283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.244"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:15.142259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:15.146687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:15.149034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.149604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.150090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.150807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.151260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.151716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.155285 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e86d81e7-5670-4970-980d-80a4a4be01c2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 0.254308 Aug 27 20:59:15.156366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1360/2628] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:14 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:15.160818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f8c94c2-5b7e-4f0c-a844-a6b6e5bd357a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f8c94c2-5b7e-4f0c-a844-a6b6e5bd357a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '-1' Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 20:59:15.164970 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f8c94c2-5b7e-4f0c-a844-a6b6e5bd357a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:15.169488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f8c94c2-5b7e-4f0c-a844-a6b6e5bd357a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009219 Aug 27 20:59:15.171877 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1361/2629] 10.222.0.40 () {58 vars in 1142 bytes} [Sat Aug 27 20:59:15 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:15.176793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a27a96a-fc92-4269-832d-6286a4fdc713 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a27a96a-fc92-4269-832d-6286a4fdc713 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: action_args: {} Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 20:59:15.180716 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a27a96a-fc92-4269-832d-6286a4fdc713 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:15.185086 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a27a96a-fc92-4269-832d-6286a4fdc713 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009461 Aug 27 20:59:15.186634 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1362/2630] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 20:59:15 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:15.193875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13439629-4f45-4aa2-9295-3064dcfb93f1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:15.198899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-13439629-4f45-4aa2-9295-3064dcfb93f1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:15.199715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-13439629-4f45-4aa2-9295-3064dcfb93f1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:15.206647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.servers [None req-13439629-4f45-4aa2-9295-3064dcfb93f1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Flavor 'non_existing_flavor' could not be found {{(pid=140434) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 20:59:15.207708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-13439629-4f45-4aa2-9295-3064dcfb93f1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018363 Aug 27 20:59:15.208240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1363/2631] 10.222.0.40 () {58 vars in 1178 bytes} [Sat Aug 27 20:59:15 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:59:15.220569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:15.225332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:15.225993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:15.231301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.231794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.232218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.233316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.233437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.233786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.319120 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f2010df-ed4c-4395-9d72-ae787644fc11 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.102640 Aug 27 20:59:15.319772 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1364/2632] 10.222.0.40 () {58 vars in 1174 bytes} [Sat Aug 27 20:59:15 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 20:59:15.324575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:15.326795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:15.336987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.337526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.337972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.338667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:15.339334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:15.339782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:15.378516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:59:15.379030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquired lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:59:16.075790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119d47518a96468180e55a660c5d397b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44941fb23b241c08ef26b631843b693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:16.089452 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d4bb42c9-da5b-40a0-98ab-0a0b8f233217 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 200 len: 1511 microversion: 2.1 time: 0.768189 Aug 27 20:59:16.115379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1365/2633] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:15 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 1511 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:16.120773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:16.129314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:16.130889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:16.146403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.149670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.155125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.157464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.158560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.159731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.393864 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d4e1e7ec-65af-4785-996d-dc196de2825e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.277045 Aug 27 20:59:16.403378 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1366/2634] 10.222.0.40 () {58 vars in 1184 bytes} [Sat Aug 27 20:59:16 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:59:16.430045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:16.431014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:16.450872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.452783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.455519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.456529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.463997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.464638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.557187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:16.700316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:16.709828 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82205cb1-ba87-46ad-bd09-4d8c67852680 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1274 microversion: 2.1 time: 0.291688 Aug 27 20:59:16.710466 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1367/2635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:16 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:16.728157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:16.733946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:16.756515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.757311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.757925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.758846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.759506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.760149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.838856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:16.839684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:16.840280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:16.840900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lazy-loading 'fault' on Instance uuid 848193dd-e1e9-4a01-adf4-8b55863607f9 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:17.370312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c6a5cc460f744ee8b958eafbe2e995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dced4e2c73df4f4485ef8442b0afe00e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:17.386716 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32f95733-7ea1-412f-9863-ea07e56b8dc9 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 200 len: 1313 microversion: 2.1 time: 0.663635 Aug 27 20:59:17.392826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1368/2636] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:16 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:17.402671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:17.406722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:17.431352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:17.435470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:17.436073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:17.440661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:17.441573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:17.442208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:17.562527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:17.576595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4fa302e6-ba8a-4067-94ac-ca4da4d81133 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1303 microversion: 2.1 time: 0.181593 Aug 27 20:59:17.577761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1369/2637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:17 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:17.585722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:17.586849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:17.632766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:17.633293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:17.633917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:17.634813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:17.635864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:17.636999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:17.968326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:18.005094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4eeb962-01fb-4c4e-a3c4-ec3631446f24 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1266 microversion: 2.1 time: 0.419748 Aug 27 20:59:18.008252 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1370/2638] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:17 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1266 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:18.035798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:18.036991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:18.078913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:18.081773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:18.093108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:18.098947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:18.102625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:18.105082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:18.931252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Building network info cache for instance {{(pid=140433) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 20:59:19.124891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:19.138946 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d356aede-ad52-47e1-afea-d30b6c96d684 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 1.127038 Aug 27 20:59:19.139560 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1371/2639] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:18 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:19.153995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:19.161378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:19.174199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:19.187191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:19.188532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:19.189137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:19.190069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:19.190725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:19.192082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:19.309359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:59:19.459501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:19.484778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:19.488983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:19.489667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:20.101997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-31d591ae-ca54-44e4-8fd7-bf63a9ab99f7 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.957334 Aug 27 20:59:20.103967 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1372/2640] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 20:59:19 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:20.109280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:20.110381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] [instance: eb57d1c3-f5fc-4d49-81f8-d30db3157f93] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:20.130434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:20.135729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:20.136346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:20.137128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:20.137582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:20.138014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:20.179485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] HTTP exception thrown: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Request method failure captured: Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 HTTP/1.1 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVtc89HkRRTgQMlMgQE2E9lSpoJwTU48R6v_GC9pT-V1tysk_4BMd055_6lu-ld72cuqyJ41BjZOqIhwjeoHuBZjjlDGfWhnO94_FclfI3uy9NBwwKdKBhNz_0gz4gjHG9vxyqf0uJgeJAqaz8ZKgIy6_Wu5FkcLXr97wkvs2FoZBg Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f44941fb23b241c08ef26b631843b693 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceActionsTestJSON-759828791 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f44941fb23b241c08ef26b631843b693"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f44941fb23b241c08ef26b631843b693"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f44941fb23b241c08ef26b631843b693", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f44941fb23b241c08ef26b631843b693"}]}] Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceActionsTestJSON-759828791 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f44941fb23b241c08ef26b631843b693 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceActionsTestJSON-759828791 Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceActionsTestJSON-759828791-project Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 119d47518a96468180e55a660c5d397b Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceActionsTestJSON-759828791-project Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'eb57d1c3-f5fc-4d49-81f8-d30db3157f93'} Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:20.190209 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. Aug 27 20:59:20.194795 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:20.200698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] Returning 404 to user: Instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:20.201925 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c908024e-940c-404d-8bff-cf77905df8c4 tempest-InstanceActionsTestJSON-759828791 tempest-InstanceActionsTestJSON-759828791-project] 10.222.0.40 "GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93" status: 404 len: 111 microversion: 2.1 time: 0.096788 Aug 27 20:59:20.202778 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1373/2641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:20 2022] GET /compute/v2.1/servers/eb57d1c3-f5fc-4d49-81f8-d30db3157f93 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:20.218223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:20.219014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:20.227653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:20.228460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:20.231456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:20.232398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:20.233093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:20.233676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:21.943098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:21.954420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69a746a8-06a4-4a26-bed7-c3b9fdfa8e60 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 1.746674 Aug 27 20:59:21.955141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1374/2642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:20 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:21.970591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb57d1c3-f5fc-4d49-81f8-d30db3157f93", "name": "network-vif-deleted", "tag": "6648f441-dd54-4e83-be99-21014992d6c2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:21.990361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:21.990849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:21.991353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.006960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] Creating event network-vif-deleted:6648f441-dd54-4e83-be99-21014992d6c2 for instance eb57d1c3-f5fc-4d49-81f8-d30db3157f93 on nch1-master-1 Aug 27 20:59:22.013359 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3aadb424-ff14-4bcf-8022-cbf7f9d9fce3 req-016acb47-318a-4b51-b83a-846cae292ebb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053860 Aug 27 20:59:22.014276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1375/2643] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:22.021627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:22.022400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] [instance: 848193dd-e1e9-4a01-adf4-8b55863607f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:22.028891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.029385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.030023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.030735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.032049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.032481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.051860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] HTTP exception thrown: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Request method failure captured: Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 HTTP/1.1 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoUeJNWjsfCZhZaeMPqJpajzhcpsOledBPRLczsSOaqOk1toDc9XXLRLXNlJtAHe6ewJVCWYY7VL4hgDGwJbACk1yG24l3QR4WDPP-UW9yqIjMfim_PrgAAZ73MlD5gDWudJ884PnAycW_NiRH_gfndSyG4vDJVLfQKhknNSpswyN3g Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/dced4e2c73df4f4485ef8442b0afe00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_dced4e2c73df4f4485ef8442b0afe00e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/dced4e2c73df4f4485ef8442b0afe00e"}]}] Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: dced4e2c73df4f4485ef8442b0afe00e Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1321179954 Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 8c6a5cc460f744ee8b958eafbe2e995b Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1321179954-project Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '848193dd-e1e9-4a01-adf4-8b55863607f9'} Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:22.053995 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] Returning 404 to user: Instance 848193dd-e1e9-4a01-adf4-8b55863607f9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:22.057983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ca89370-c6d5-4e52-a19f-c09971526f71 tempest-FloatingIPsAssociationTestJSON-1321179954 tempest-FloatingIPsAssociationTestJSON-1321179954-project] 10.222.0.40 "GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9" status: 404 len: 111 microversion: 2.1 time: 0.040138 Aug 27 20:59:22.059881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1376/2644] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:22 2022] GET /compute/v2.1/servers/848193dd-e1e9-4a01-adf4-8b55863607f9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:22.065209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ff9cdd-9ec6-47d4-9a94-4b13efbd624f", "name": "network-vif-plugged", "status": "completed", "tag": "22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:22.092815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.093597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.095397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.123191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] Creating event network-vif-plugged:22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9 for instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f on nch1-master-1 Aug 27 20:59:22.129258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d7db026d-aa1f-459c-89e2-035ab5b79810 req-373463e5-2fcb-4659-9f9d-71e2a6298d33 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068117 Aug 27 20:59:22.130365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1377/2645] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:22.135163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Updating instance_info_cache with network_info: [{"id": "6ff904d4-2703-47cc-abe2-69880fa06b9c", "address": "fa:16:3e:89:13:e5", "network": {"id": "55e991bc-e3d2-4ac7-85bd-77602d68921c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1873508102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4f3beed612074a54b8ee14f7abcee3ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6ff904d4-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140433) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 20:59:22.150746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:22.151790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:22.158906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Releasing lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140433) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:59:22.160287 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6a3c7fc-4886-497b-b77f-4cd51c435b4f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 202 len: 0 microversion: 2.1 time: 7.208904 Aug 27 20:59:22.164952 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1269/2646] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:14 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 0 bytes in 7214 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 20:59:22.171636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.173953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.175188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.178479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.179894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.181216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.183284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392e6399-0788-42cd-91a9-9650efaf3b08", "tag": "6ff904d4-2703-47cc-abe2-69880fa06b9c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:22.226129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.228309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.229782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.245391 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] Creating event network-changed:6ff904d4-2703-47cc-abe2-69880fa06b9c for instance 392e6399-0788-42cd-91a9-9650efaf3b08 on nch2-master-1 Aug 27 20:59:22.252487 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5bc025b1-baf6-46b4-9ad2-c461db1d3d1f req-ac8d2da4-6f2d-4e14-bba0-399719a9c869 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085666 Aug 27 20:59:22.253679 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1270/2647] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:22.263642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:22.264813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:22.277032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.278330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.279804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:22.280767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:22.281396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:22.282389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:23.432758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:23.436099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:23.443479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-695c2316-1297-44ec-828b-2fdfe728e7e3 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 1.311372 Aug 27 20:59:23.458796 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7b9a57ba-12c4-4fc3-bc57-904222aa29f5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 1.203700 Aug 27 20:59:23.475467 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1378/2649] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:22 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:23.479311 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1271/2649] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:22 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:23.491317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:23.492219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dcbe1aa6-512c-43a4-94da-f9fde886841f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:23.492485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:23.499709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:23.501459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:23.502071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:23.503003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:23.504071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dcbe1aa6-512c-43a4-94da-f9fde886841f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:23.504204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:23.505321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dcbe1aa6-512c-43a4-94da-f9fde886841f tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.027684 Aug 27 20:59:23.508681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:23.517423 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1379/2650] 10.222.0.40 () {58 vars in 1178 bytes} [Sat Aug 27 20:59:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 20:59:23.527856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d610d6d0-4147-4502-a8fd-787c68f3a199 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '.version_select at 0x7ff84f207430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:23.873486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=22 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:24.128263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:24.153328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55ec7048-d047-4777-bf3e-b7ccbbf594cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1320 microversion: 2.1 time: 0.672723 Aug 27 20:59:24.155252 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1272/2651] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:23 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:24.162069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:24.163071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:24.174279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:24.175636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:24.176418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:24.177366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:24.177968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:24.200110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:24.888111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:25.061065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:25.087955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4b507d0-66a5-48a7-a459-afe703b2a838 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.921275 Aug 27 20:59:25.092159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1273/2652] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:24 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:25.099203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:25.108138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:25.109645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Searching by: {'deleted': False, 'project_id': 'b385f04d9af64d83bf4104606c716af7'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:25.125444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:25.126511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:25.128162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:25.130481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:25.132175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:25.135136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:25.200876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 20:59:25.289822 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a001d0bf-4a0a-43e4-9469-ea3324a37420 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.192049 Aug 27 20:59:25.290882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1274/2653] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:59:25 2022] GET /compute/v2.1/servers => generated 681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:25.310326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786b116c-cd33-42e0-ab70-e4d9e2f87a26", "tag": "9da1b438-30f3-4e55-aebb-13b1d7d2c379"}, {"name": "network-changed", "server_uuid": "06d1a9e8-9946-4aa0-997d-0c7e5932ea88", "tag": "e359cca4-4d7d-4534-9b34-62120cf40026"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:25.337756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:25.338174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:25.340666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:25.394779 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Creating event network-changed:9da1b438-30f3-4e55-aebb-13b1d7d2c379 for instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 on nch1-master-1 Aug 27 20:59:25.398009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] Creating event network-changed:e359cca4-4d7d-4534-9b34-62120cf40026 for instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 on nch1-master-1 Aug 27 20:59:25.421096 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-527fce7a-5e77-42be-8f74-860b79920bad req-c298254e-8a75-4f4b-9803-0c0f4f3008d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.126978 Aug 27 20:59:25.423948 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1275/2654] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:25.439286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:25.440261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:25.463083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:25.463799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:25.464765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:25.467334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:25.468167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:25.470102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:26.614618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:26.623453 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c6b31cd-7a12-4252-abed-c35117f17b6e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 1.198128 Aug 27 20:59:26.639940 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1276/2655] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:25 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:26.646678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:26.647719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:26.655149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:26.655966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:26.657482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:26.658601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:26.659721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:26.660382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:26.998246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d610d6d0-4147-4502-a8fd-787c68f3a199 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/341756cc-711b-43d8-bfae-4e920a573387" status: 202 len: 0 microversion: 2.1 time: 3.479607 Aug 27 20:59:26.998926 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1380/2656] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 20:59:23 2022] DELETE /compute/v2.1/os-floating-ips/341756cc-711b-43d8-bfae-4e920a573387 => generated 0 bytes in 3481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:59:27.006432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.007363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.017427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.017934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.018388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.019139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.019633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.020067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.050629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:27.064464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9954b43b-8aa6-4b34-b16a-273e774d042d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 0.422021 Aug 27 20:59:27.065382 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1277/2657] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:26 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:27.075107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.075835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.087973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.088532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.090466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.091730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.092530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.093118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.116395 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] HTTP exception thrown: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb HTTP/1.1 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '68b08606-ff14-4c09-a896-66d93151ecdb'} Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:27.119046 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:27.123305 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.126064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 404 to user: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:27.127151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dcb6f4d8-4ee4-451a-a230-1a57e71ec279 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 404 len: 111 microversion: 2.1 time: 0.060566 Aug 27 20:59:27.127916 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1278/2658] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:27 2022] DELETE /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:27.137169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.138074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.145587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.146354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.147031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.147950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.148580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.149148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.372682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:27.382119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e84cc176-6018-4686-ad01-4f25a8cabab4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1501 microversion: 2.1 time: 0.380761 Aug 27 20:59:27.399788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1381/2659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:26 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1501 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:27.407150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020754e8-22da-42fd-9277-05b26763be99", "tag": "7a5a0ced-d3a6-4e61-8d14-b966c69b11dd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:27.420784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.421494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.422257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.438772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] Creating event network-changed:7a5a0ced-d3a6-4e61-8d14-b966c69b11dd for instance 020754e8-22da-42fd-9277-05b26763be99 on nch2-master-1 Aug 27 20:59:27.445459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fa1f413f-48ae-4982-9d2b-5db884371b8d req-f8c22733-9bb4-4b92-8abd-7c1d2ef26054 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043204 Aug 27 20:59:27.446404 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1382/2660] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:27.456975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:27.457621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7524b30c-2247-4ea5-b61a-97ab72248974 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7524b30c-2247-4ea5-b61a-97ab72248974 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Request method failure captured: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action HTTP/1.1 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 34 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVkcfjAwRUxA0GPFva0sO1h7JkN8X5Gr70ZROFLaLpj9klca9GqM3lIHoLM8WUegFKayhVmUAGwhlkFUBDqOxvCH0SYwF2MejqDXkZVGBp1T9j6USizpZYTtSnaXtdO0oF2g6pPvPKZGEGtFHbAD-d77maJWUs8UlAiXv9Q2HNUimY Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f3beed612074a54b8ee14f7abcee3ab", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}] Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 18552094160c4c72bccdc1f412e9f95c Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: {"addFloatingIp": {"address": ""}} Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '392e6399-0788-42cd-91a9-9650efaf3b08', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '' Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:27.463400 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7524b30c-2247-4ea5-b61a-97ab72248974 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7524b30c-2247-4ea5-b61a-97ab72248974 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 400 len: 142 microversion: 2.1 time: 0.017503 Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1383/2661] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:27 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.474061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.480209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.480830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.481282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.482003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.482467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.482905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.483775 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc9527ff-766e-441a-9ee1-7f585adbe2de tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.350935 Aug 27 20:59:27.497282 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1279/2662] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:27 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:27.503038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.504272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.511591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.512084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.512530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.513216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.513923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.514490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.521697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:27.631766 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd208be5-b039-4ae0-abe3-bb9e91f1501e tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 204 len: 0 microversion: 2.1 time: 0.163926 Aug 27 20:59:27.633805 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1384/2663] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:27 2022] DELETE /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:27.644818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:27.649845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.666783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.667387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.667825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.668559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.680458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.681074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.716684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 20:59:27.717432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquired lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 20:59:27.844496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:27.849946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:27.863003 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef6a9794-6e66-48be-9ec2-89f4d91ebe93 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1501 microversion: 2.1 time: 0.364236 Aug 27 20:59:27.864982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1280/2664] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:27 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:27.870602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.871361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:27.884414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.885840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.886944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.888529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:27.889436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:27.890256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:27.927667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:27.958863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Releasing lock "refresh_cache-392e6399-0788-42cd-91a9-9650efaf3b08" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 20:59:27.959815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] HTTP exception thrown: floating IP not found Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Request method failure captured: Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action HTTP/1.1 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 41 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVkcfjAwRUxA0GPFva0sO1h7JkN8X5Gr70ZROFLaLpj9klca9GqM3lIHoLM8WUegFKayhVmUAGwhlkFUBDqOxvCH0SYwF2MejqDXkZVGBp1T9j6USizpZYTtSnaXtdO0oF2g6pPvPKZGEGtFHbAD-d77maJWUs8UlAiXv9Q2HNUimY Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f3beed612074a54b8ee14f7abcee3ab", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}] Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 18552094160c4c72bccdc1f412e9f95c Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: exception: floating IP not found Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '392e6399-0788-42cd-91a9-9650efaf3b08', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 20:59:27.962238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 20:59:27.965729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:27.969149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Returning 404 to user: floating IP not found {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:27.970538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9761245a-5e17-4132-b13e-79b3566137cb tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 404 len: 67 microversion: 2.1 time: 0.335305 Aug 27 20:59:27.972463 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1385/2665] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:27 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 67 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:27.981978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:27.984449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.005601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.006241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.006850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.007896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.008740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.010792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.038846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-14dc74c1-af4c-4760-bd19-25346670c0d1 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 204 len: 0 microversion: 2.1 time: 0.171991 Aug 27 20:59:28.043145 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1281/2666] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:27 2022] DELETE /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:28.050882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.051667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.058845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.059553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.060273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.061051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.061596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.062111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.104137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:28.195098 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cbd92357-7a9e-4a6c-a22a-2a535c58e83a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 204 len: 0 microversion: 2.1 time: 0.149431 Aug 27 20:59:28.199560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1282/2667] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:28 2022] DELETE /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:28.205856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-782e20cd-62b7-4f00-9792-7fe4433bd702 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:28.309042 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-782e20cd-62b7-4f00-9792-7fe4433bd702 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-782e20cd-62b7-4f00-9792-7fe4433bd702 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Request method failure captured: Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action HTTP/1.1 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 44 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVkcfjAwRUxA0GPFva0sO1h7JkN8X5Gr70ZROFLaLpj9klca9GqM3lIHoLM8WUegFKayhVmUAGwhlkFUBDqOxvCH0SYwF2MejqDXkZVGBp1T9j6USizpZYTtSnaXtdO0oF2g6pPvPKZGEGtFHbAD-d77maJWUs8UlAiXv9Q2HNUimY Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f3beed612074a54b8ee14f7abcee3ab", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}] Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 18552094160c4c72bccdc1f412e9f95c Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP not found for address 0.0.0.0. Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '392e6399-0788-42cd-91a9-9650efaf3b08', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 20:59:28.311870 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-782e20cd-62b7-4f00-9792-7fe4433bd702 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:28.317304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-782e20cd-62b7-4f00-9792-7fe4433bd702 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action" status: 404 len: 88 microversion: 2.1 time: 0.114305 Aug 27 20:59:28.318972 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1283/2668] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:28 2022] POST /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08/action => generated 88 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:28.328476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.330298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 68b08606-ff14-4c09-a896-66d93151ecdb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.338158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.339208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.340234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.341540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.341723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.342410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.367543 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] HTTP exception thrown: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb HTTP/1.1 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '68b08606-ff14-4c09-a896-66d93151ecdb'} Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.369645 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 404 to user: Instance 68b08606-ff14-4c09-a896-66d93151ecdb could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:28.374078 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7381d3e3-f189-49fb-a968-fbe07aa8898a tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb" status: 404 len: 111 microversion: 2.1 time: 0.051734 Aug 27 20:59:28.378172 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1284/2669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:28 2022] GET /compute/v2.1/servers/68b08606-ff14-4c09-a896-66d93151ecdb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:28.386179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.386698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.390809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:28.396037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.396603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.397090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.398069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.398696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.399113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.444732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:28.471428 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e0c1bab-d793-43ea-a122-0aa51f1f0979 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.497404 Aug 27 20:59:28.474400 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1386/2670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:27 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:28.487605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.489369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.500725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.501669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.502240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.503062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.503663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.504196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.920100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:28.925194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:28.929186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:28.929711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fce13898-5c9b-4015-9af7-107a6aad3ac2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 0.550082 Aug 27 20:59:28.930478 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1285/2671] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:28 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:28.935294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.936106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.947467 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d5d41001-82da-472a-b3ff-0df69be8cb76 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1507 microversion: 2.1 time: 0.471710 Aug 27 20:59:28.948395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1387/2672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:28 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1507 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:28.953643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:28.954355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:28.964943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.966496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.966496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.967210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.967622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.968135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.968584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.969450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:28.969940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.970364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:28.971582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:28.972081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.003323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:29.104204 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4fb2f07-d2bf-4840-8b51-8f1e6d832e80 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "DELETE /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 204 len: 0 microversion: 2.1 time: 0.172314 Aug 27 20:59:29.107923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1286/2673] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:28 2022] DELETE /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:29.113397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:29.114107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:29.120322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.120817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.121261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.121963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.122423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.122846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.214052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:29.310477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:29.321430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4714aa64-ad65-4a9a-8e2c-eeea6a352d30 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1521 microversion: 2.1 time: 0.371698 Aug 27 20:59:29.324211 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1388/2674] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:28 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:29.335157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:29.336075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:29.343221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.344568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.345221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.346157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.346933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.348091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.428243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:29.437030 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8bed4704-0e67-4f9e-ac9c-4b4a808f63bb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.331099 Aug 27 20:59:29.437746 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1287/2675] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:29 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:29.444167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:29.495327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:29.496263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:29.506992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.507525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.508001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:29.508721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:29.509175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:29.509601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.070534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.088372 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ccd1600-2f60-428e-9b81-ad6b60ee037d tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1541 microversion: 2.1 time: 0.752251 Aug 27 20:59:30.102804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1389/2676] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:29 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1541 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:30.108439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:30.109368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:30.124882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.125678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.126264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.127150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.130677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.131308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.163785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.176569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-463d954a-cbc4-488f-8fc6-93ff7d87b642 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.684806 Aug 27 20:59:30.177225 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1288/2677] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:29 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:30.189112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:30.190118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:30.198115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.198977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.199761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.200764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.201416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.202037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.439144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.442269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.452859 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ca3174e-70cc-4a3e-b676-430bdfbc314a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1507 microversion: 2.1 time: 0.267637 Aug 27 20:59:30.467369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1289/2678] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:30 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:30.467369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:30.467369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:30.467369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.467369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.468653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.468653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.469071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.469422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.474083 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd31b123-cc2e-491e-a5d7-01619845354e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 0.369355 Aug 27 20:59:30.497064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1390/2679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:30 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:30.511045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:30.513609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:30.526213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.526719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.527172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.527979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.528436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.528867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.780953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.805764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7bef4e2-f2ca-47a6-b6b2-1f2251f47916 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1521 microversion: 2.1 time: 0.348412 Aug 27 20:59:30.807312 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1290/2680] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:30 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:30.815527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b116c-cd33-42e0-ab70-e4d9e2f87a26", "name": "network-vif-plugged", "status": "completed", "tag": "9da1b438-30f3-4e55-aebb-13b1d7d2c379"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:30.848708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:30.849507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:30.850081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:30.867616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] Creating event network-vif-plugged:9da1b438-30f3-4e55-aebb-13b1d7d2c379 for instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 on nch1-master-1 Aug 27 20:59:30.876503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c6f13932-cc34-4a7a-950a-b1ffa2c3b9f3 req-1a39caa2-0655-4f92-8206-56fcf37429ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067732 Aug 27 20:59:30.877433 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1291/2681] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:30.910917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:30.918993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-803fae0d-4259-412b-a7f9-63463dd2bcdb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.420174 Aug 27 20:59:30.933392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1391/2682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:30 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:31.111662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.112489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.126465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.127996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.129040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.130508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.131841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.133911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.198357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.199059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.210153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.210900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.211499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.212306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.213986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.214637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.507633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:31.525385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86b479b7-5fa8-436b-9c43-ece1a295a394 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1541 microversion: 2.1 time: 0.418172 Aug 27 20:59:31.526753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1292/2683] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1541 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:31.531778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.532576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.537578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:31.541136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.541843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.543224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.545296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.545968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.546664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.558327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e9fae01-917b-446f-b51a-9d2a7a911a69 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.362188 Aug 27 20:59:31.560102 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1392/2684] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:31.567598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.569112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.590295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.590787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.591648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.592512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.593117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.593771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.813352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:31.816695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:31.826055 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-713b08cf-d0f2-4f4b-bd10-819e5a94918d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1507 microversion: 2.1 time: 0.298026 Aug 27 20:59:31.827578 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b067fd72-50f3-4a86-999c-01abeb674962 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 0.266073 Aug 27 20:59:31.829040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1393/2685] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:31.829530 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1293/2686] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:31.835353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.836334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.846342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.847459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.848074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.862973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.863771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.864344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.942032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:31.942859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:31.959137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.959927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.960548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:31.961417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:31.962008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:31.962582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:32.167956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:32.186843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-493a4447-3943-4655-870f-e87ad0f8e771 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1521 microversion: 2.1 time: 0.354325 Aug 27 20:59:32.188318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1394/2687] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:32.230601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:32.234084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:32.246384 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dad1b68e-ed90-4bb3-a9aa-ca351a9afa25 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.309827 Aug 27 20:59:32.249903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1294/2688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:31 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:59:32.361956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-462743419", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "154f2839-d1aa-47e2-921c-e90e06c89fb7"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:32.425433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] validate_networks() for [('154f2839-d1aa-47e2-921c-e90e06c89fb7', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:32.551199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:32.552417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:32.570357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:32.570858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:32.571294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:32.574714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:32.575187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:32.575649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:32.959734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:32.972358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97905b8b-fdd4-425b-a289-13f4b0c6017e tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1541 microversion: 2.1 time: 0.425187 Aug 27 20:59:32.973251 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1295/2689] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:32 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1541 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:59:32.982280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:32.985053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:32.998072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.005258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.006082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.007067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.007753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.008439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.248695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:33.249215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:33.249679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:33.250186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:33.250677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:33.263760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.264183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.264690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.265667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.266153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.266615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.292721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:33.300065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for user 00f7b7e727ee43158239b911a436d656 and project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:33.303777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:33.323220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-660e49df-6191-4061-bc5f-8518b7a635b5 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.346223 Aug 27 20:59:33.324087 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1296/2690] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:32 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:33.329010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:33.334870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:33.345450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:33.348537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:33.351924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.352493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.352951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.355754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.356446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.357062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.389572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:33.412085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e28cd2b-d76e-44b3-9cf8-4a737a8fc3fc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221140 Aug 27 20:59:33.413132 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1395/2691] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:33.434725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:33.434860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:33.446174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.454115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.455010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.455961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.456578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.457162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.673700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:33.687288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e0c4f13-6b40-4607-9413-1a7e5753e4cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1507 microversion: 2.1 time: 0.357947 Aug 27 20:59:33.690889 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1297/2692] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:33 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:33.698160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d1a9e8-9946-4aa0-997d-0c7e5932ea88", "name": "network-vif-plugged", "status": "completed", "tag": "e359cca4-4d7d-4534-9b34-62120cf40026"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:33.713241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.713848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.714525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.731012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:33.740999 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20b02c83-0501-468d-94fd-91701b178b4d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1308 microversion: 2.1 time: 0.326608 Aug 27 20:59:33.742902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1396/2693] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:33 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:33.752874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:33.754056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:33.764772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] Creating event network-vif-plugged:e359cca4-4d7d-4534-9b34-62120cf40026 for instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 on nch1-master-1 Aug 27 20:59:33.766985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.767869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.768592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.769948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.770713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.774227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.779507 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-47b63793-b8e9-430a-a167-9ddbeedbce38 req-72c37e86-1a75-40b6-a035-61c9126e5a17 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081466 Aug 27 20:59:33.782566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1298/2694] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:33.795537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:33.796470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:33.834428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.834922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.835383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:33.842055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:33.843091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:33.844428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:34.463632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:34.474185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ed191fc-3f99-4386-a6d7-247544483024 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1521 microversion: 2.1 time: 0.727390 Aug 27 20:59:34.478380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1397/2695] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:33 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1521 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:34.497329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1253232717", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "154f2839-d1aa-47e2-921c-e90e06c89fb7"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:34.635126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] validate_networks() for [('154f2839-d1aa-47e2-921c-e90e06c89fb7', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:34.725802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:34.754144 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca2a4687-560f-432b-9164-6a2f1414625f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1322 microversion: 2.1 time: 0.969976 Aug 27 20:59:34.759386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1299/2696] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:33 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1322 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:34.776838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:34.777900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:34.795154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:34.796449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:34.798517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:34.801760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:34.802588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:34.808066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:35.145559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:35.306218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:35.315952 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8fc07c51-589e-4ac1-b62b-4a8d9db03113 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1541 microversion: 2.1 time: 0.555223 Aug 27 20:59:35.320177 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1300/2697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:34 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1541 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:35.332213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:35.333209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:35.340876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:35.341958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:35.342674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:35.343654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:35.344946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:35.347553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.085829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:36.106311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-69b8095d-2f62-47d3-a645-76b70e01102c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.781865 Aug 27 20:59:36.123518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1301/2698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:35 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:36.129825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:36.130748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:36.137424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.138558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.139211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.140169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.141145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.141795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.237626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.239091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.240308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.241680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:36.351571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:36.368402 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7cdd7509-e290-4989-a2f1-9599cf75f3b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 200 len: 1310 microversion: 2.1 time: 0.243231 Aug 27 20:59:36.382578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1302/2699] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:36 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:36.391856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:36.396361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:36.414400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.415280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.415936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.416833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.417475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.418119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.456574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:36.458628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:36.461720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:36.462467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:36.463131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:36.492136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.492628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.493254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.494237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.494887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.495535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.539715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:36.552192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for user 00f7b7e727ee43158239b911a436d656 and project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:36.571422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:36.574022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:36.651114 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b8245a53-35ac-4fb4-8265-34b63803c040 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171001 Aug 27 20:59:36.652488 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1398/2700] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:36.672271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e6f3a8-fba1-4323-bb3b-4578b8a086c0", "name": "network-vif-deleted", "tag": "50058a7b-1440-46f0-a537-2f7ab9aa6daa"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:36.674748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:36.695766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.696268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.696926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.698056 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b92a53ca-3c7e-44ab-b010-4af28b95a6d2 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1488 microversion: 2.1 time: 0.313891 Aug 27 20:59:36.710494 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1303/2701] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:36 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1488 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:36.710494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:36.710494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:36.724717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] Creating event network-vif-deleted:50058a7b-1440-46f0-a537-2f7ab9aa6daa for instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 on nch1-master-1 Aug 27 20:59:36.728642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.729397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.729920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.730683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.731208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.731731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.740258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aa33ebc0-24f9-4bd2-bc5a-cd95319cf86e req-09ff5ff7-d48d-4d5e-ac85-0dc398b89cd5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084344 Aug 27 20:59:36.742406 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1399/2702] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:36.752727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:36.754515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:36.762793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.763298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.764073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.764947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.765697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.766478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.816752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.817576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.818206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:36.821084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lazy-loading 'fault' on Instance uuid f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:36.939748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:36.959881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49c51de8-6cd4-46ba-b1eb-266052b73544 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 200 len: 1312 microversion: 2.1 time: 0.255074 Aug 27 20:59:36.960484 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1304/2703] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:36 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:36.975099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:36.975952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:36.995639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:36.998781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:36.999489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:37.000611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:37.001367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:37.002027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:37.180446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:37.193952 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a382998b-bffa-4d57-8424-b4c913e7d33a tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1471 microversion: 2.1 time: 0.448617 Aug 27 20:59:37.196311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1400/2704] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:36 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:37.201926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-683828182"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:37.220212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:37.237436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:37.238772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:37.239424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:37.240317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:37.240976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:37.241551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:37.330255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:37.338300 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ce45ab9-fb66-468b-9c46-6bb4506be8bd tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1541 microversion: 2.1 time: 0.376753 Aug 27 20:59:37.340782 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1305/2705] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:36 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1541 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:37.347795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2019588833", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "451", "networks": [{"uuid": "154f2839-d1aa-47e2-921c-e90e06c89fb7"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:37.421362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] validate_networks() for [('154f2839-d1aa-47e2-921c-e90e06c89fb7', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:37.701626 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4985a51-bc52-4b41-9c2f-84d4ed3cc0ce tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "POST /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26/action" status: 202 len: 0 microversion: 2.1 time: 0.503577 Aug 27 20:59:37.703826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1401/2706] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:37 2022] POST /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 20:59:37.714923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:37.724047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:37.733949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:37.734905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:37.736050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:37.737107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:37.737709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:37.738329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.061245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:38.071196 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4619103d-2390-49f8-8d6e-74bd220e22b7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.365865 Aug 27 20:59:38.072057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1402/2707] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:37 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:38.079839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:38.080097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:38.105361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.105916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.106456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.110667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.111214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.111703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.132846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:38.133107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:38.134854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:38.134854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:38.136010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:38.153129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.153769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.154161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lazy-loading 'flavor' on Instance uuid 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:38.154283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.155170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.155732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.156270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.249429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:38.272947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Getting quotas for user 00f7b7e727ee43158239b911a436d656 and project b22f74c2c47b434b8783c8579636f04e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:38.301882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:38.305268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:38.337171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:38.378199 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-255ab72c-9a69-42c8-b3dc-cebc9199e854 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88/action" status: 202 len: 0 microversion: 2.1 time: 0.304925 Aug 27 20:59:38.382095 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1403/2708] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:38 2022] POST /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 20:59:38.386580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:38.387431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:38.397120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.397629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.398704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.399465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.399933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.400431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.410617 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0862305c-d889-4120-9cca-1573515f5d42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.068066 Aug 27 20:59:38.411641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1306/2709] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:38.428171 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f HTTP/1.1 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '05ff9cdd-9ec6-47d4-9a94-4b13efbd624f'} Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.432694 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.437732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:38.439133 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4c43128-f297-433b-bbb2-ee961767a062 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 404 len: 111 microversion: 2.1 time: 0.057073 Aug 27 20:59:38.440859 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1404/2710] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:38.441474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5952ab98-b6d9-4ebb-8d46-3d4eda3d000e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f137700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:38.462887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:38.464178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: f7e6f3a8-fba1-4323-bb3b-4578b8a086c0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:38.484975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.485486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.485933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.486656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.487112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.487590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.541842 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] HTTP exception thrown: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 HTTP/1.1 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'f7e6f3a8-fba1-4323-bb3b-4578b8a086c0'} Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.543662 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. Aug 27 20:59:38.547145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:38.556982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 404 to user: Instance f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:38.559797 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1dca20e-efaf-4640-98ef-347241a897e6 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0" status: 404 len: 111 microversion: 2.1 time: 0.106282 Aug 27 20:59:38.563869 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5952ab98-b6d9-4ebb-8d46-3d4eda3d000e tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf" status: 200 len: 1411 microversion: 2.1 time: 0.141293 Aug 27 20:59:38.565068 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1307/2711] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:38.566087 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1405/2712] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/servers/f7e6f3a8-fba1-4323-bb3b-4578b8a086c0 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:38.576612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:38.577254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:38.586298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:38.603086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:38.605129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.606046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.607280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.609394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.610300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.612225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.619536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.622285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.622821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.626465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.627254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.628203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.690836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:38.691965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:38.693351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:38.694055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lazy-loading 'fault' on Instance uuid 392e6399-0788-42cd-91a9-9650efaf3b08 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:38.968866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:38.993461 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-852c07aa-146c-4522-8ae6-b0ec7fd6f014 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1321 microversion: 2.1 time: 0.414670 Aug 27 20:59:38.997734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1308/2713] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:39.005026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7aca0e00-82c3-400e-af95-439ecc26cfa8 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:39.005903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7aca0e00-82c3-400e-af95-439ecc26cfa8 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:39.099879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7aca0e00-82c3-400e-af95-439ecc26cfa8 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:39.110554 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7aca0e00-82c3-400e-af95-439ecc26cfa8 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1221 microversion: 2.1 time: 0.109978 Aug 27 20:59:39.111833 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1309/2714] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:39.125801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e275b22b-e529-42a5-9c3e-4c00015da735 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: .version_select at 0x7ff857c63820>, body: {"keypair": {"name": "tempest-key-1113703586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBco8xKWnIFm2Gkrw5ylsivX5IIc2bcxm6CY7ZYkebtgZdYpeyqvbqZ+UySjSkuPOvJzZUQgsEuuTFTBBn5/7F1OT/jonSUW2FFVQPzFXCO81VMq9Se3hiO42U7vUJBZTg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:39.142898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e275b22b-e529-42a5-9c3e-4c00015da735 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:39.149382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e275b22b-e529-42a5-9c3e-4c00015da735 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:39.181013 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e275b22b-e529-42a5-9c3e-4c00015da735 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.059613 Aug 27 20:59:39.181849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1310/2715] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 20:59:39 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:39.188797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:39.190569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:39.200922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.201905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.202917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:39.204976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.205694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.206242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:39.262206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.262942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.263519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:39.264407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lazy-loading 'fault' on Instance uuid 4705ab9d-bd89-489e-9394-9f1981221188 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:39.376410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:39.385610 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63091bd0-a829-48c0-b714-fde62656ad68 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1312 microversion: 2.1 time: 0.202373 Aug 27 20:59:39.402372 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1311/2716] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:39 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:39.409115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f8412cbf-ab59-4d83-9522-faf21b3f0b52 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e7f3af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:39.474164 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f8412cbf-ab59-4d83-9522-faf21b3f0b52 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf" status: 200 len: 1411 microversion: 2.1 time: 0.069764 Aug 27 20:59:39.478078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1312/2717] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:59:39 2022] GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:39.491010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ff9cdd-9ec6-47d4-9a94-4b13efbd624f", "name": "network-vif-deleted", "tag": "22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9"}, {"server_uuid": "4705ab9d-bd89-489e-9394-9f1981221188", "name": "network-vif-deleted", "tag": "67b9a364-db5b-42bd-bc03-65d4bec9d4f3"}, {"server_uuid": "392e6399-0788-42cd-91a9-9650efaf3b08", "name": "network-vif-deleted", "tag": "6ff904d4-2703-47cc-abe2-69880fa06b9c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:39.507806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.508565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.509011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:39.531450 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Creating event network-vif-deleted:22b2e1b8-7aff-4d74-b9e5-f8d820d9b6c9 for instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f on nch1-master-1 Aug 27 20:59:39.534939 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Creating event network-vif-deleted:67b9a364-db5b-42bd-bc03-65d4bec9d4f3 for instance 4705ab9d-bd89-489e-9394-9f1981221188 on nch2-master-1 Aug 27 20:59:39.542830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] Creating event network-vif-deleted:6ff904d4-2703-47cc-abe2-69880fa06b9c for instance 392e6399-0788-42cd-91a9-9650efaf3b08 on nch2-master-1 Aug 27 20:59:39.563813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b281c38b-2ebb-4925-b960-615a706b37cf req-84087220-89fe-4330-8091-893de4f76970 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.084229 Aug 27 20:59:39.565758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1313/2718] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:39.571112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:39.577884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:39.593683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.594493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.595000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:39.595845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:39.596488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:39.597075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.430203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:40.442256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d098d259-c492-47a5-83b2-eea965641d1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.875162 Aug 27 20:59:40.443025 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1314/2719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:39 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:40.450257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6077f8ff-2c8b-48e1-891d-bd3f5fdab3f3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '.version_select at 0x7ff84f239e50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:40.472380 ncdv-master-1 devstack@n-api.service[140433]: WARNING oslo_db.sqlalchemy.utils [None req-6077f8ff-2c8b-48e1-891d-bd3f5fdab3f3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 20:59:40.477314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ac3eea2-981c-49fb-9e47-2e14d3cd1022 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1630 microversion: 2.1 time: 1.910063 Aug 27 20:59:40.482900 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6077f8ff-2c8b-48e1-891d-bd3f5fdab3f3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.038389 Aug 27 20:59:40.484221 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1315/2720] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 20:59:40 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:40.484743 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1406/2721] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:38 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1630 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:40.489713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29f04393-75c6-48a9-a939-b3db621de9b1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e78e9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:40.491148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:40.491890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:40.508556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.509054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.509495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.510207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.510669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.511093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.587581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.588122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.588566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.589028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lazy-loading 'fault' on Instance uuid 392e6399-0788-42cd-91a9-9650efaf3b08 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:40.681409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18552094160c4c72bccdc1f412e9f95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3beed612074a54b8ee14f7abcee3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:40.700993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29f04393-75c6-48a9-a939-b3db621de9b1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf" status: 204 len: 0 microversion: 2.1 time: 0.214433 Aug 27 20:59:40.701754 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1316/2722] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:40 2022] DELETE /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:40.713907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:40.714529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:40.716927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-814799b0-69fd-4143-9743-59a19edb146f tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 200 len: 1321 microversion: 2.1 time: 0.230487 Aug 27 20:59:40.719984 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1407/2723] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:40 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:40.727710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:40.728906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:40.732738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.735686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.736394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.738542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.739017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.739474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.749214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.750324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.751020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.752078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.753100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.753998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.818231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:40.819768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:40.820522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:40.821218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lazy-loading 'fault' on Instance uuid 4705ab9d-bd89-489e-9394-9f1981221188 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:40.978401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:40.991934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00adcff2-ec1d-48e4-8965-5663d3043823 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1225 microversion: 2.1 time: 0.284897 Aug 27 20:59:41.003275 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1317/2724] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:40 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1225 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:41.003635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb681daa8ff4485b8605f79a32bd45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b385f04d9af64d83bf4104606c716af7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:41.003770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-138060269", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-key-1113703586", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:41.009457 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56086609-07ff-490c-8326-0da75a4b44e2 tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 200 len: 1312 microversion: 2.1 time: 0.288193 Aug 27 20:59:41.010062 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1408/2725] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:40 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:41.025714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5bf41ae-6f8f-41ff-906e-590cdb0c34d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f37a3a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:41.026785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:41.101604 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e5bf41ae-6f8f-41ff-906e-590cdb0c34d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Image not found. Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5bf41ae-6f8f-41ff-906e-590cdb0c34d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf HTTP/1.1 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '66434b7d-e15c-4d86-a48c-61c8a36b1ebf'} Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66434b7d-e15c-4d86-a48c-61c8a36b1ebf Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 20:59:41.121817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66434b7d-e15c-4d86-a48c-61c8a36b1ebf could not be found. Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5bf41ae-6f8f-41ff-906e-590cdb0c34d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:41.126550 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5bf41ae-6f8f-41ff-906e-590cdb0c34d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf" status: 404 len: 62 microversion: 2.1 time: 0.111583 Aug 27 20:59:41.130246 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1409/2726] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 20:59:41 2022] GET /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:41.138272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:41.138513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:41.139828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:41.149561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:41.150110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:41.150569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:41.151775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:41.152506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:41.152891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:41.692521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:41.710037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a524fc7-05e0-43d7-97b5-7687ca443d42 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1506 microversion: 2.1 time: 0.577119 Aug 27 20:59:41.724786 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1410/2727] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:41 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:41.726622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:41.727552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:41.744914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:41.745736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:41.746369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:41.747545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:41.748306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:41.749108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.121474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:42.135025 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-26272317-6a00-49c2-9668-df387a8fde1a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.422806 Aug 27 20:59:42.135675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1411/2728] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:41 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:42.140233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:42.141259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:42.147671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.148892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.149555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.150447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.151101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.151568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.377594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:42.378068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:42.378499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:42.378905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:42.379624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:42.390631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.391613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.392257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.393288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.393824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.394379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.429004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:42.440465 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec4a957c-0f8f-4e94-bc75-ca0ca207d1ea tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1613 microversion: 2.1 time: 0.303537 Aug 27 20:59:42.441062 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1412/2729] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:42 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1613 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:42.458715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:42.465700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea28d73-15e3-4c7d-8474-380dd29e5a4b", "tag": "76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:42.468988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:42.478800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.479661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.480303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.494225 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] Creating event network-changed:76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278 for instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b on nch1-master-1 Aug 27 20:59:42.500633 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-0dcbcc76-dffd-4a76-9117-7521a6addb2b req-ace133e4-383e-45bc-95f3-e9ed4f7e197d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Aug 27 20:59:42.502034 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1413/2730] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:42.508239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:42.509313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] [instance: 392e6399-0788-42cd-91a9-9650efaf3b08] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:42.513337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:42.517006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:42.517865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.518465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.519201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.520206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.520937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.521568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.549906 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] HTTP exception thrown: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Request method failure captured: Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 HTTP/1.1 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVkcfjAwRUxA0GPFva0sO1h7JkN8X5Gr70ZROFLaLpj9klca9GqM3lIHoLM8WUegFKayhVmUAGwhlkFUBDqOxvCH0SYwF2MejqDXkZVGBp1T9j6USizpZYTtSnaXtdO0oF2g6pPvPKZGEGtFHbAD-d77maJWUs8UlAiXv9Q2HNUimY Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4f3beed612074a54b8ee14f7abcee3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4f3beed612074a54b8ee14f7abcee3ab", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4f3beed612074a54b8ee14f7abcee3ab"}]}] Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 4f3beed612074a54b8ee14f7abcee3ab Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 18552094160c4c72bccdc1f412e9f95c Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '392e6399-0788-42cd-91a9-9650efaf3b08'} Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. Aug 27 20:59:42.552248 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. Aug 27 20:59:42.555751 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.560379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] Returning 404 to user: Instance 392e6399-0788-42cd-91a9-9650efaf3b08 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:42.561654 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ddde1865-0000-48f4-83a0-d47614e150e7 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222 tempest-FloatingIPsAssociationNegativeTestJSON-1729504222-project] 10.222.0.40 "GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08" status: 404 len: 111 microversion: 2.1 time: 0.058323 Aug 27 20:59:42.562539 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1414/2731] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:42 2022] GET /compute/v2.1/servers/392e6399-0788-42cd-91a9-9650efaf3b08 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:42.577685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:42.578909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:42.590012 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9509847-e599-4af8-a5d2-eb717dd881c9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593169 Aug 27 20:59:42.592742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.593486 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1318/2732] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:42.596044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.596781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.598162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.598852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.603772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.605782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:42.608540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] [instance: 4705ab9d-bd89-489e-9394-9f1981221188] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:42.619885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.620389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.620828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.621580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.622034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.622454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.641151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] HTTP exception thrown: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Request method failure captured: Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 HTTP/1.1 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVjdlyMmKNfo0sYcXO5AgRCs_c5cmxG_D3hH3pdWFxQ07MYINkeREW_PQgRpT65JcWz3eXGV3lRRC4xQm_r61MgZvusY9FNVE4KcqFj5eKUOei0d9Yew_RCiR_qNuvc5Sf0_ZdSaGYPpKGIHoW8-Z0dYkvtrFspMwxwEPguL4SkP7A Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b385f04d9af64d83bf4104606c716af7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b385f04d9af64d83bf4104606c716af7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b385f04d9af64d83bf4104606c716af7"}]}] Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b385f04d9af64d83bf4104606c716af7 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-351389911 Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: beb681daa8ff4485b8605f79a32bd45b Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListServersNegativeTestJSON-351389911-project Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4705ab9d-bd89-489e-9394-9f1981221188'} Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.642861 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] Returning 404 to user: Instance 4705ab9d-bd89-489e-9394-9f1981221188 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9899b56-ddaa-4dae-b8e6-e65d58ebcc4b tempest-ListServersNegativeTestJSON-351389911 tempest-ListServersNegativeTestJSON-351389911-project] 10.222.0.40 "GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188" status: 404 len: 111 microversion: 2.1 time: 0.048677 Aug 27 20:59:42.646283 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1319/2733] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:42 2022] GET /compute/v2.1/servers/4705ab9d-bd89-489e-9394-9f1981221188 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:42.649858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:42.650705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:42.657963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.659567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.660184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.661050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:42.661695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:42.662317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:42.751497 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] HTTP exception thrown: Cannot 'migrate' instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 while it is in vm_state suspended Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Request method failure captured: Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88/action HTTP/1.1 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 15 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoV9bUX96td9amrGFQ-6J-e-wegsbF8kPtiiA9bgGKy_O3bJX4dM97fXoMpHCLmy0Zfw148HvAL7x7r2cD7h8IU2nEcYbR-_YjhbhYoORPsPONs1F6PKOG_zctOECzCH487kQs8aKPCp8qEYv2dqU2cx244P7j4OL6lv_wZ1OMZOR4k Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f75ac7cda3f4c249c9985bc25433097", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}] Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5c957c1e21ee4ace90541918dd59fb63 Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: {"migrate": {}} Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'migrate' instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 while it is in vm_state suspended Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '06d1a9e8-9946-4aa0-997d-0c7e5932ea88', 'body': {'migrate': {}}} Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:42.753703 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 while it is in vm_state suspended Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 while it is in vm_state suspended Aug 27 20:59:42.757370 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:42.760464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Returning 409 to user: Cannot 'migrate' instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 while it is in vm_state suspended {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:42.761638 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b60477c-ba40-46b9-a2f1-fb571be032a5 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88/action" status: 409 len: 148 microversion: 2.1 time: 0.115713 Aug 27 20:59:42.771378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1320/2734] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:42 2022] POST /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88/action => generated 148 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:42.771378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3efcf2bc-94d3-4da9-bdb5-55dcbdd0ac9a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:42.771378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3efcf2bc-94d3-4da9-bdb5-55dcbdd0ac9a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:43.161737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:43.174727 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-639975db-0e1d-4b6e-a871-65dbfabb7f4c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1291 microversion: 2.1 time: 0.606495 Aug 27 20:59:43.175656 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1415/2735] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:42 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1291 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:43.185920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:43.186738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:43.202047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.205847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.206494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.207499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.208245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.211148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.277863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3efcf2bc-94d3-4da9-bdb5-55dcbdd0ac9a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:43.286605 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3efcf2bc-94d3-4da9-bdb5-55dcbdd0ac9a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1228 microversion: 2.1 time: 0.522748 Aug 27 20:59:43.303984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1321/2736] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:42 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1228 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:43.313020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b7a6def-2cc5-4a28-bc97-aab089d386fc tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b7a6def-2cc5-4a28-bc97-aab089d386fc tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Request method failure captured: Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action HTTP/1.1 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 39 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoV9bUX96td9amrGFQ-6J-e-wegsbF8kPtiiA9bgGKy_O3bJX4dM97fXoMpHCLmy0Zfw148HvAL7x7r2cD7h8IU2nEcYbR-_YjhbhYoORPsPONs1F6PKOG_zctOECzCH487kQs8aKPCp8qEYv2dqU2cx244P7j4OL6lv_wZ1OMZOR4k Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f75ac7cda3f4c249c9985bc25433097", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}] Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5c957c1e21ee4ace90541918dd59fb63 Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: {"os-resetState": {"state": "invalid"}} Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '0945198a-59f1-42c7-af44-6b0d56c21537', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:43.317098 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 20:59:43.321198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.325584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b7a6def-2cc5-4a28-bc97-aab089d386fc tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:43.328169 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1b7a6def-2cc5-4a28-bc97-aab089d386fc tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action" status: 400 len: 144 microversion: 2.1 time: 0.020317 Aug 27 20:59:43.330324 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1322/2737] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:43 2022] POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:43.343639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:43.345745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:43.356453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.360150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.360689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.361649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.362222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.362739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.725480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:43.741458 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc52082c-0aed-4b0f-ab0a-dcd48275dee9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1506 microversion: 2.1 time: 0.560615 Aug 27 20:59:43.742318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1416/2738] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:43 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1506 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:43.771959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64ce87c0-3d86-456d-bcdc-2ebcdcb5780e tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:43.775220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64ce87c0-3d86-456d-bcdc-2ebcdcb5780e tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Request method failure captured: Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action HTTP/1.1 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 31 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoV9bUX96td9amrGFQ-6J-e-wegsbF8kPtiiA9bgGKy_O3bJX4dM97fXoMpHCLmy0Zfw148HvAL7x7r2cD7h8IU2nEcYbR-_YjhbhYoORPsPONs1F6PKOG_zctOECzCH487kQs8aKPCp8qEYv2dqU2cx244P7j4OL6lv_wZ1OMZOR4k Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f75ac7cda3f4c249c9985bc25433097", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}] Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5c957c1e21ee4ace90541918dd59fb63 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: {"os-resetState": {"state": 1}} Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0945198a-59f1-42c7-af44-6b0d56c21537', 'body': {'os-resetState': {'state': 1}}} Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 1 Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 20:59:43.796673 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 20:59:43.800566 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.801181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26b015e0-4aa7-4027-99f8-5a2c46125189 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.464035 Aug 27 20:59:43.801181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1323/2739] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:43 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:43.805478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64ce87c0-3d86-456d-bcdc-2ebcdcb5780e tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:43.806672 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64ce87c0-3d86-456d-bcdc-2ebcdcb5780e tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action" status: 400 len: 120 microversion: 2.1 time: 0.052030 Aug 27 20:59:43.809303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1417/2740] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 20:59:43 2022] POST /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537/action => generated 120 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:43.823654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:43.827602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Failed to fetch instance by id 999 {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 20:59:43.828561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Request method failure captured: Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 37 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoV9bUX96td9amrGFQ-6J-e-wegsbF8kPtiiA9bgGKy_O3bJX4dM97fXoMpHCLmy0Zfw148HvAL7x7r2cD7h8IU2nEcYbR-_YjhbhYoORPsPONs1F6PKOG_zctOECzCH487kQs8aKPCp8qEYv2dqU2cx244P7j4OL6lv_wZ1OMZOR4k Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7f75ac7cda3f4c249c9985bc25433097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7f75ac7cda3f4c249c9985bc25433097", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7f75ac7cda3f4c249c9985bc25433097"}]}] Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 7f75ac7cda3f4c249c9985bc25433097 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1017052049 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5c957c1e21ee4ace90541918dd59fb63 Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1017052049-project-admin Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: {"os-resetState": {"state": "error"}} Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 999 could not be found. Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:43.861494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:43.865559 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:43.865559 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 20:59:43.865559 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:43.868214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:43.869396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a38004c-517e-4fed-95b2-e13715527846 tempest-ServersAdminNegativeTestJSON-1017052049 tempest-ServersAdminNegativeTestJSON-1017052049-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.052518 Aug 27 20:59:43.870515 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1324/2741] 10.222.0.40 () {60 vars in 1179 bytes} [Sat Aug 27 20:59:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:43.885554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:43.886245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:43.897066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.898568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.899179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.900142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:43.900776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:43.901420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:43.985473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:44.150223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-071d1cf0-20e8-4476-bf18-4a980c6f31b5 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "DELETE /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 204 len: 0 microversion: 2.1 time: 0.272849 Aug 27 20:59:44.152304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1418/2742] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:43 2022] DELETE /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:44.159993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:44.160618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:44.177138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.177623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.179655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.183042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.183816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.184210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.197545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:44.207595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:44.222812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.229510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.233154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.234357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.234928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.235611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.688821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:44.701942 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91125961-95d9-4b0b-8ab5-3ad50803d63f tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1468 microversion: 2.1 time: 0.546216 Aug 27 20:59:44.703804 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1325/2743] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:44 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1468 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:44.709116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:44.710110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:44.717774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.718849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.719571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.721416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.722061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.722682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.869281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:44.885524 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd9dd356-964a-4042-8bed-3779707687f5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1286 microversion: 2.1 time: 0.180385 Aug 27 20:59:44.887068 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1326/2744] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:44 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:44.901299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786b116c-cd33-42e0-ab70-e4d9e2f87a26", "name": "network-vif-plugged", "status": "completed", "tag": "9da1b438-30f3-4e55-aebb-13b1d7d2c379"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:44.929412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:44.931523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.934356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.937247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.945072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba7f9e08-3c69-4354-9e58-7a1cd20cd481 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.746288 Aug 27 20:59:44.947527 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1419/2745] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:44 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:44.961852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:44.962999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:44.972944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] Creating event network-vif-plugged:9da1b438-30f3-4e55-aebb-13b1d7d2c379 for instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 on nch1-master-1 Aug 27 20:59:44.977967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.978641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.979409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:44.990189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6b74bd16-5ee0-44be-98ce-046356f22eb7 req-1c485cd5-384a-4a03-95b8-d6e7c8d60a4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094948 Aug 27 20:59:44.991109 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1327/2746] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:44.991489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:44.992176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:44.992780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:45.004396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:45.006624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:45.022729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:45.026526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:45.027288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:45.029045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:45.031094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:45.032560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:45.941267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:45.959943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ea4515c-7610-4cf5-8dcb-0583cb258adb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1506 microversion: 2.1 time: 1.011053 Aug 27 20:59:45.962724 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1420/2747] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:44 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:45.969682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:45.970560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:45.980644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:45.982959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:45.984414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:45.988084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:45.988610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:45.989066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:46.018056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:46.040358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11ec0a38-7d75-4893-a16c-e7d411347b43 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 1.047598 Aug 27 20:59:46.041645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1328/2748] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:44 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:46.046741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:46.048397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:46.064420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:46.076455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:46.076850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:46.077612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:46.078110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:46.078544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:46.340074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:46.354547 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f2f3c68-db05-4d30-a224-e8efe213cd5f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1286 microversion: 2.1 time: 0.308973 Aug 27 20:59:46.355190 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1329/2749] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:46 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1286 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:46.364298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:46.365615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:46.381929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:46.382961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:46.383549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:46.384358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:46.384806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:46.389480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:46.513381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:46.564975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:47.012807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:47.023071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21f66fcb-5f2f-4eae-a62a-618fcc8598ec tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1468 microversion: 2.1 time: 1.058903 Aug 27 20:59:47.024445 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1421/2750] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:45 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1468 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:47.031765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:47.032717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:47.041585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.042393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.043005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.043942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.044556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.045137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.071900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:47.218830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:47.236851 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4a80ac8-b7c0-4bb7-8cfd-0a7d3da6ab1c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.880301 Aug 27 20:59:47.237794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1330/2751] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:46 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:47.257754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:47.259484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:47.271136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.272128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.272783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.274716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.275600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.291961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.568996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:47.584532 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6afc1605-27e0-479e-8514-deefe536796d tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1488 microversion: 2.1 time: 0.558791 Aug 27 20:59:47.585140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1422/2752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:47 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1488 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:47.784220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:47.801240 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49e59887-3e5b-41aa-983f-45fe19975cfd tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.561916 Aug 27 20:59:47.801842 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1331/2753] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:47 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:47.806561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:47.807175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:47.822211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.822717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.823159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.823903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.824359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.824786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.849296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020754e8-22da-42fd-9277-05b26763be99", "name": "network-vif-plugged", "status": "completed", "tag": "7a5a0ced-d3a6-4e61-8d14-b966c69b11dd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:47.864828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.865336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.865759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.913630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] Creating event network-vif-plugged:7a5a0ced-d3a6-4e61-8d14-b966c69b11dd for instance 020754e8-22da-42fd-9277-05b26763be99 on nch2-master-1 Aug 27 20:59:47.937561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-17eea9dd-7417-47c8-b0f0-326a1792ba75 req-d1cebf72-5a3d-4add-8299-991b83bccab4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335633 Aug 27 20:59:47.938846 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1423/2754] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:47.944917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:47.951238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:47.966744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.981121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.981572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:47.982817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:47.983455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:47.984165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:48.043503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:48.166136 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-465fa722-6fa6-408f-be64-f957174ba5e0 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 204 len: 0 microversion: 2.1 time: 0.225258 Aug 27 20:59:48.167140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1424/2755] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:47 2022] DELETE /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:48.173978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d458d6ef-270a-43b7-a7c9-b2bf3494d426", "tag": "576e346c-95ad-48a7-b385-e05c644d10cf"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:48.185606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:48.186390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:48.186914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:48.201176 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] Creating event network-changed:576e346c-95ad-48a7-b385-e05c644d10cf for instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 on nch1-master-1 Aug 27 20:59:48.207672 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-26a9917b-5be8-4e4e-abb1-af75bdf13316 req-c9ce0e60-a656-4a8f-8374-1ed81c8cf53f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038692 Aug 27 20:59:48.208392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1425/2756] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:48.214681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:48.215686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:48.224754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:48.225475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:48.226111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:48.227010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:48.227666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:48.228245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:48.590708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:48.608366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4081125f-ed35-4b58-982a-2edade1ca607 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.805373 Aug 27 20:59:48.609425 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1332/2757] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:47 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:48.614608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32947e4f-6613-45f1-9a62-15a88db3b48b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e775820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:48.685097 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-32947e4f-6613-45f1-9a62-15a88db3b48b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Image not found. Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32947e4f-6613-45f1-9a62-15a88db3b48b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf HTTP/1.1 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '66434b7d-e15c-4d86-a48c-61c8a36b1ebf'} Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66434b7d-e15c-4d86-a48c-61c8a36b1ebf to delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66434b7d-e15c-4d86-a48c-61c8a36b1ebf could not be found. Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.688582 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:59:48.692136 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:48.695274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32947e4f-6613-45f1-9a62-15a88db3b48b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:48.696738 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32947e4f-6613-45f1-9a62-15a88db3b48b tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf" status: 404 len: 62 microversion: 2.1 time: 0.086154 Aug 27 20:59:48.698102 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1333/2758] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:48 2022] DELETE /compute/v2.1/images/66434b7d-e15c-4d86-a48c-61c8a36b1ebf => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:48.707976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:48.711247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:48.736296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:48.739040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:48.739798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:48.740707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:48.746187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:48.746786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.194550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:49.205153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1719cc4e-99a7-45b4-931f-2cb1d8bb2288 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1468 microversion: 2.1 time: 0.995239 Aug 27 20:59:49.205981 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1426/2759] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:48 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1468 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:49.210479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:49.211504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:49.220983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.221697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.222324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.223179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.223822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.224399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.256611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:49.335124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Instance is already in deleting state, ignoring this request Aug 27 20:59:49.337062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1221908-2419-49de-a502-3e64a4875716 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 204 len: 0 microversion: 2.1 time: 0.129593 Aug 27 20:59:49.338472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1427/2760] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:49 2022] DELETE /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:49.345764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:49.346600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:49.354059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.355020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.355681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.356535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.357205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.358049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.564603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:49.581971 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7c431be-8dce-45e3-9010-0b2f5e983cc7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.882563 Aug 27 20:59:49.582904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1334/2761] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:48 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:49.587528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:49.591015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:49.601992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.602680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.610368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:49.611330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:49.612011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:49.612584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.239794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:50.257379 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d44d6ce-942f-4eff-a0aa-7e277315d96f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1370 microversion: 2.1 time: 0.917428 Aug 27 20:59:50.258749 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1428/2762] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:49 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1370 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:50.267805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:50.269906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:50.279955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.282612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.284680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.285761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.286815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.287560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.320356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:50.341980 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49e0a6bd-3878-42cf-b483-adc66b18c6bf tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1494 microversion: 2.1 time: 0.755754 Aug 27 20:59:50.344447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1335/2763] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:49 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1494 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:50.356398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d1a9e8-9946-4aa0-997d-0c7e5932ea88", "name": "network-vif-deleted", "tag": "e359cca4-4d7d-4534-9b34-62120cf40026"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:50.386461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.388968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.389655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.419946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] Creating event network-vif-deleted:e359cca4-4d7d-4534-9b34-62120cf40026 for instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 on nch1-master-1 Aug 27 20:59:50.437571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-52aed24b-667f-40d2-a157-886b1a7ef2ad req-888a2242-1afd-4f90-b2b6-d9f233fe29d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090595 Aug 27 20:59:50.439312 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1336/2764] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:50.447242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea28d73-15e3-4c7d-8474-380dd29e5a4b", "name": "network-vif-plugged", "status": "completed", "tag": "76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278"}, {"server_uuid": "786b116c-cd33-42e0-ab70-e4d9e2f87a26", "name": "network-vif-unplugged", "status": "completed", "tag": "9da1b438-30f3-4e55-aebb-13b1d7d2c379"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:50.466674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.467472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.468099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.485378 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Creating event network-vif-plugged:76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278 for instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b on nch1-master-1 Aug 27 20:59:50.486139 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] Creating event network-vif-unplugged:9da1b438-30f3-4e55-aebb-13b1d7d2c379 for instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 on nch1-master-1 Aug 27 20:59:50.494019 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-031f66e8-56d0-4433-8157-19951a5c8fc7 req-5176011b-3421-4bb4-961c-c3fe489909cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.052957 Aug 27 20:59:50.499708 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1337/2765] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:50.522695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:50.525000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:50.546032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.546573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.551446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.552210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.556280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.556601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.664987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.666315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.668268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.669142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lazy-loading 'fault' on Instance uuid 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:50.869117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:50.881394 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c11ef86c-08c5-4db7-a7a1-71e586d14f62 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 200 len: 1312 microversion: 2.1 time: 0.379680 Aug 27 20:59:50.885084 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1338/2766] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:50 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:50.892275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:50.893160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:50.904585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.905665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.909561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.912002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:50.913358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:50.916384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:50.982366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:50.991970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3490f64d-425d-43ce-be49-bd3e11420353 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.731705 Aug 27 20:59:50.992556 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1429/2767] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:50 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:51.278414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:51.284690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:51.298050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:51.298564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:51.299744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:51.300726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:51.301383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:51.301822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:51.946393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:51.955538 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03f78773-f663-4a28-b034-5a259023b9cd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 1.069357 Aug 27 20:59:51.956158 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1339/2768] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:50 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:51.960918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:51.961459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:51.967889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:51.969002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:51.969566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:51.970251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:51.970875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:51.971294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.107870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:52.117098 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26ab34fe-bff2-43d2-a19e-cf447255e7d1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1452 microversion: 2.1 time: 0.159974 Aug 27 20:59:52.117677 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1340/2769] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:51 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:52.122079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:52.122680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 06d1a9e8-9946-4aa0-997d-0c7e5932ea88] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:52.128905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.129388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.129819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.130510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.130956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.131394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.147707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] HTTP exception thrown: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Request method failure captured: Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 HTTP/1.1 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoV8OIM-LX9sDLy9E9NNWv1Y1O9x27umN7EdIMSBeD5k-v7ZXTdmFsGXXNCyXIGUdAu3PXn6Tj07Fsqla5Ltu13aLkMbcD9JJmLk7steOPuTQmXY3VUHajOukVhmqbWuY9O-z98bM7Vsedpy3hRwxxfS1U83XrIBlQ6-fAGx7F1s5q8 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d909cdd2a0f94f94a65a0737a39dd911 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909cdd2a0f94f94a65a0737a39dd911"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d909cdd2a0f94f94a65a0737a39dd911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d909cdd2a0f94f94a65a0737a39dd911", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909cdd2a0f94f94a65a0737a39dd911"}]}] Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d909cdd2a0f94f94a65a0737a39dd911 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1314421224-project Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1eaee129221b45b596e46ff13bd034bd Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1314421224-project Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '06d1a9e8-9946-4aa0-997d-0c7e5932ea88'} Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:52.149413 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Returning 404 to user: Instance 06d1a9e8-9946-4aa0-997d-0c7e5932ea88 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee56c28d-a3dd-430c-9387-c2a67d4bcaaa tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88" status: 404 len: 111 microversion: 2.1 time: 0.032183 Aug 27 20:59:52.156669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1341/2770] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:52 2022] GET /compute/v2.1/servers/06d1a9e8-9946-4aa0-997d-0c7e5932ea88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:52.158405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:52.159141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:52.164096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:52.167661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.168257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.168701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.169894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.170569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.171079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.177264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b352a7bd-c4a2-4dc6-84eb-c0a1909cae9f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1556 microversion: 2.1 time: 0.902943 Aug 27 20:59:52.181241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1430/2771] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:51 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1556 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:52.194651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:52.195247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:52.209998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.210739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.211628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.212640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.214956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.216076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.258986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 20:59:52.373555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:52.406850 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e3e8ef2-dd5e-4522-a9dd-59ab2806002c tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 204 len: 0 microversion: 2.1 time: 0.223684 Aug 27 20:59:52.407847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1431/2772] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:52 2022] DELETE /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 20:59:52.413264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:52.415111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:52.422645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.423451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.424052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.425272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.426103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.426699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.428527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:52.663775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-052c658c-d53b-4367-9823-4da2236c9519 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254466 Aug 27 20:59:52.664633 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1432/2773] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 20:59:52 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:52.669533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:52.670332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:52.683028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.688114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.688581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.689334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.689974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.690408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.701862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:52.704326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:52.713799 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b961ca65-8fdc-44b4-b6da-b096e555743f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.560839 Aug 27 20:59:52.739178 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1342/2774] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:52 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:52.897940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85d9bb0-7b3e-4069-a18d-10a072260bd5", "tag": "120749e1-e698-49dc-ae24-06be800b81e2"}, {"name": "network-changed", "server_uuid": "287ce978-0c3f-4b10-8fbb-4ec5054ca75a", "tag": "d1f2f728-fa93-4176-a105-224d50d652ad"}, {"server_uuid": "786b116c-cd33-42e0-ab70-e4d9e2f87a26", "name": "network-vif-deleted", "tag": "9da1b438-30f3-4e55-aebb-13b1d7d2c379"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:52.926604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:52.927366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:52.928005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:52.945401 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Creating event network-changed:120749e1-e698-49dc-ae24-06be800b81e2 for instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 on nch2-master-1 Aug 27 20:59:52.946312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Creating event network-changed:d1f2f728-fa93-4176-a105-224d50d652ad for instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a on nch2-master-1 Aug 27 20:59:52.947020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] Creating event network-vif-deleted:9da1b438-30f3-4e55-aebb-13b1d7d2c379 for instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 on nch1-master-1 Aug 27 20:59:52.961577 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d88e1a13-65e5-484e-b717-6fea9321342f req-8ba963e1-0679-4553-af89-6663d2ab2e3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.220761 Aug 27 20:59:52.962490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1343/2775] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:53.050119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1690089386", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b7be105a-9ed2-4ae5-82e2-5284d901aff4"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:53.136165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] validate_networks() for [('b7be105a-9ed2-4ae5-82e2-5284d901aff4', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 20:59:53.138906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:53.149716 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3fcc8a13-d32c-4612-8787-6df920f2465d tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1477 microversion: 2.1 time: 0.481630 Aug 27 20:59:53.165106 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1433/2776] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:52 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:53.184514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:53.185417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:53.203460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.203460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.203460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.205793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.205793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.205793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.286516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=20 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:53.488221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:53.514185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e419716d-68b9-4df6-a3b6-31c98467ae42 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.347362 Aug 27 20:59:53.515442 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1434/2777] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:53 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:53.532507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:53.533764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:53.542876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.544552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.554859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.557200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.557965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.558766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.604223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.605036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.605662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.606295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lazy-loading 'fault' on Instance uuid 786b116c-cd33-42e0-ab70-e4d9e2f87a26 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:53.666567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:53.673194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:53.676647 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0c2e3d55-581c-4486-ae72-08b911b0be05 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1298 microversion: 2.1 time: 0.158705 Aug 27 20:59:53.691938 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1435/2778] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:53 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:53.744698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:53.745368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:53.760118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.760638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.761085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:53.763433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:53.764115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:53.769027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.033339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 20:59:54.033834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 20:59:54.034234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 20:59:54.034783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 20:59:54.035779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 20:59:54.051742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.051925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:54.052543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.053079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.053954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.054514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.055029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.064310 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0adc161-96d8-45e4-bdeb-23681c4a64cf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.323659 Aug 27 20:59:54.065258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1436/2779] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:53 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:54.096169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Getting quotas for project d74eff4731ba40669a6e1fea39edb442. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 20:59:54.108064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Getting quotas for user 011f2af1a813465bb4541f2d0af04e17 and project d74eff4731ba40669a6e1fea39edb442. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 20:59:54.134676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Going to run 2 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 20:59:54.139068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 4c69baf5-a2fd-4a01-8b6e-d5843e844a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:54.172721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:54.173580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:54.189501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.193238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.193752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.195034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.195639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.196310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.206935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=4c69baf5-a2fd-4a01-8b6e-d5843e844a44,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 20:59:54.379723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15d2fbc6-d8b7-4654-9290-354a290fd372 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402451 Aug 27 20:59:54.384848 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1344/2780] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 20:59:54.398190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:54.414822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:54.415688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Searching by: {'deleted': False, 'project_id': 'd74eff4731ba40669a6e1fea39edb442'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 20:59:54.474112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.474575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.474965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.475905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.477561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.478009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.512996 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ce3580f-9b5c-4e79-82a9-be6167c736b2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.121319 Aug 27 20:59:54.518006 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1345/2781] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 20:59:54 2022] GET /compute/v2.1/servers => generated 677 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:54.527113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec067881-2773-4b5b-aaa1-b216445661d5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:54.527836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec067881-2773-4b5b-aaa1-b216445661d5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:54.596861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:54.614171 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f02b64a9-cbfb-49d0-8a29-c3f273b47a92 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1477 microversion: 2.1 time: 0.445902 Aug 27 20:59:54.620890 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1437/2782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:54 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:54.637095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:54.638996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:54.658185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.660050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.661981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.664773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.666806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.667790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.691201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec067881-2773-4b5b-aaa1-b216445661d5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:54.703790 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec067881-2773-4b5b-aaa1-b216445661d5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1220 microversion: 2.1 time: 0.181908 Aug 27 20:59:54.706701 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1346/2783] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:54 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1220 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:59:54.720282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:54.723263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:54.740440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.744118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.745432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.745606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.750198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.750711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.839102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:54.840161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:54.840826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:54.842003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lazy-loading 'fault' on Instance uuid 786b116c-cd33-42e0-ab70-e4d9e2f87a26 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 20:59:54.973976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede90e55159a4d3192505c74a2a69a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f7e5f0366a4113922c93cee71427d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:54.989166 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f61bc34-f4a1-4889-9662-ce2b2205a5fb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 200 len: 1298 microversion: 2.1 time: 0.279892 Aug 27 20:59:54.990850 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1347/2784] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:54 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:55.058752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:55.088895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:55.089906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:55.098485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05116460-55b2-4aa9-be8f-b28df9870f0c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.476398 Aug 27 20:59:55.104857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:55.105456 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1438/2785] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:54 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:55.106506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:55.108551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:55.110977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:55.111640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:55.113835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:55.619458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:55.635244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b9ac0f6-73ee-41c6-b778-c5df892b627b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.550370 Aug 27 20:59:55.636473 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1348/2786] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:55 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 20:59:55.645154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:55.645843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:55.678567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:55.681024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:55.684313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:55.685973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:55.686453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:55.686984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:55.725686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4261da72-c909-4fa0-ac1d-9017d045d4e6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:55.726198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4261da72-c909-4fa0-ac1d-9017d045d4e6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:55.759205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:56.090349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4261da72-c909-4fa0-ac1d-9017d045d4e6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:56.115783 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4261da72-c909-4fa0-ac1d-9017d045d4e6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1220 microversion: 2.1 time: 0.393892 Aug 27 20:59:56.127679 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1349/2787] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:55 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1220 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:56.178458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.179090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 786b116c-cd33-42e0-ab70-e4d9e2f87a26] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.200201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.200725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.204978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.205944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.207581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.208055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.245540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 HTTP/1.1 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '786b116c-cd33-42e0-ab70-e4d9e2f87a26'} Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.252378 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance 786b116c-cd33-42e0-ab70-e4d9e2f87a26 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.257135 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e9e21e9-d179-47bb-9280-539bbf0b1dcd tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26" status: 404 len: 111 microversion: 2.1 time: 0.125128 Aug 27 20:59:56.260502 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1350/2788] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] GET /compute/v2.1/servers/786b116c-cd33-42e0-ab70-e4d9e2f87a26 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:56.265526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.266166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.286555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.287055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.287544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.289915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.291534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.291989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.373791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:56.385480 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0ee954db-641a-42c4-838c-98b9f2be1f22 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1477 microversion: 2.1 time: 0.753501 Aug 27 20:59:56.386622 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1439/2789] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:55 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1477 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:56.410720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43235af1-310d-460e-b292-e01b48f1bcb9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84f0eeb80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.462746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-43235af1-310d-460e-b292-e01b48f1bcb9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Image not found. Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43235af1-310d-460e-b292-e01b48f1bcb9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc HTTP/1.1 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd4236aad-38f3-435b-916a-c89df2fd85fc'} Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d4236aad-38f3-435b-916a-c89df2fd85fc to delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4236aad-38f3-435b-916a-c89df2fd85fc could not be found. Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.473184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:59:56.478210 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.482037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43235af1-310d-460e-b292-e01b48f1bcb9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.491033 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-43235af1-310d-460e-b292-e01b48f1bcb9 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc" status: 404 len: 62 microversion: 2.1 time: 0.102810 Aug 27 20:59:56.493484 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1440/2790] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] DELETE /compute/v2.1/images/d4236aad-38f3-435b-916a-c89df2fd85fc => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:56.520626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020754e8-22da-42fd-9277-05b26763be99", "tag": "7a5a0ced-d3a6-4e61-8d14-b966c69b11dd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:56.559666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.560413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.561113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.591954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] Creating event network-changed:7a5a0ced-d3a6-4e61-8d14-b966c69b11dd for instance 020754e8-22da-42fd-9277-05b26763be99 on nch2-master-1 Aug 27 20:59:56.607288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a2413cb3-bf5c-4319-b063-70c94061ac25 req-cc87bc0c-d3f6-4259-ad77-5de1774bd1a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108299 Aug 27 20:59:56.608943 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1441/2791] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:56.622162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.623156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.641438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.642784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.644889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.645929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.647551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.651944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.658614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:56.675839 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5eadc12-e37d-4c21-9e15-4a4ea3792637 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.410734 Aug 27 20:59:56.678112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1351/2792] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:56.690113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.692031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.692738 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 HTTP/1.1 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ff2807b8-4761-4028-bcfe-ab65761a19f9'} Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:56.694636 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.701484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.702642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1ee68cc-9290-4d36-b83d-12494360f2b5 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 404 len: 111 microversion: 2.1 time: 0.088379 Aug 27 20:59:56.709872 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1442/2793] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:56 2022] DELETE /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:56.715533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.732190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: ff2807b8-4761-4028-bcfe-ab65761a19f9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.739915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.740420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.743948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.746510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.747249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.749251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.750301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.750804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.757717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.764145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.765063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.768106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.799017 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 HTTP/1.1 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ff2807b8-4761-4028-bcfe-ab65761a19f9'} Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.816559 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance ff2807b8-4761-4028-bcfe-ab65761a19f9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cd69a8e-93e4-45e0-bc02-a9c9a44ac6b3 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9" status: 404 len: 111 microversion: 2.1 time: 0.107376 Aug 27 20:59:56.822668 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1443/2794] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] GET /compute/v2.1/servers/ff2807b8-4761-4028-bcfe-ab65761a19f9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:56.829677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69e8707f-2988-47b1-9286-181e8c04e3f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84e55d4c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.867631 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-69e8707f-2988-47b1-9286-181e8c04e3f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Image not found. Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69e8707f-2988-47b1-9286-181e8c04e3f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 HTTP/1.1 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b390f1bc-5edc-421d-8f45-db6a8c54bb86'} Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b390f1bc-5edc-421d-8f45-db6a8c54bb86 to delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b390f1bc-5edc-421d-8f45-db6a8c54bb86 could not be found. Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.869417 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69e8707f-2988-47b1-9286-181e8c04e3f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.875885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69e8707f-2988-47b1-9286-181e8c04e3f1 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86" status: 404 len: 62 microversion: 2.1 time: 0.046081 Aug 27 20:59:56.884208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1444/2795] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] DELETE /compute/v2.1/images/b390f1bc-5edc-421d-8f45-db6a8c54bb86 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:56.904270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:56.904784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:56.928217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.929178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.929860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.930848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:56.931568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:56.932225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:56.960820 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 HTTP/1.1 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0df002a9-8f41-4e21-be95-8c45b19650d4'} Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:56.971067 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:56.975052 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:56.977878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:56.979751 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d7924324-ad52-4500-b572-c6f20a8f5c47 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 404 len: 111 microversion: 2.1 time: 0.094350 Aug 27 20:59:56.982958 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1445/2796] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:56 2022] DELETE /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:57.000386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.001308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 0df002a9-8f41-4e21-be95-8c45b19650d4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.018465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.019234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.021921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.022981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.025479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.026167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.069380 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 HTTP/1.1 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0df002a9-8f41-4e21-be95-8c45b19650d4'} Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.071326 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. Aug 27 20:59:57.074924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.082832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance 0df002a9-8f41-4e21-be95-8c45b19650d4 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.084010 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85f75c06-818a-4f8f-88e1-e45dca181753 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4" status: 404 len: 111 microversion: 2.1 time: 0.096598 Aug 27 20:59:57.091536 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1446/2797] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] GET /compute/v2.1/servers/0df002a9-8f41-4e21-be95-8c45b19650d4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:57.103595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8212ce23-9ef6-4fc1-9d62-f6d791bc92c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '.version_select at 0x7ff84eeca310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.134483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:57.141488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8212ce23-9ef6-4fc1-9d62-f6d791bc92c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Image not found. Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8212ce23-9ef6-4fc1-9d62-f6d791bc92c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f HTTP/1.1 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '63ba5cad-1d00-4a52-b4b1-02b2ff54553f'} Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 63ba5cad-1d00-4a52-b4b1-02b2ff54553f to delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63ba5cad-1d00-4a52-b4b1-02b2ff54553f could not be found. Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.143269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8212ce23-9ef6-4fc1-9d62-f6d791bc92c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.146943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8212ce23-9ef6-4fc1-9d62-f6d791bc92c7 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f" status: 404 len: 62 microversion: 2.1 time: 0.051743 Aug 27 20:59:57.151281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1447/2798] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:57 2022] DELETE /compute/v2.1/images/63ba5cad-1d00-4a52-b4b1-02b2ff54553f => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 20:59:57.154592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52746b8a-895b-45f7-ae54-cc48a9d09d56 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.474249 Aug 27 20:59:57.155707 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1352/2799] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:56 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:57.161193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.162301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.169889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.171709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.172715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.173675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.174347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.175005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.354080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:57.368771 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-958be0d2-b0a2-4453-acc9-0387b82a9a07 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1272 microversion: 2.1 time: 0.211700 Aug 27 20:59:57.383026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1353/2800] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:57 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:57.395424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.397341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.419108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.421538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.422924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.424913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.429497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.430110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.460059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f41a6e24-02ad-4d8c-9a22-455fafba4b84 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1589340328", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:57.461894 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.466679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f41a6e24-02ad-4d8c-9a22-455fafba4b84 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] HTTP exception thrown: min_count must be <= max_count Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f41a6e24-02ad-4d8c-9a22-455fafba4b84 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Request method failure captured: Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 184 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXM9_6aWqWbIDZVzJKwKIj7uw7Vn_7FwfxaXmB3QTsc9dPu_sviywrAKjU27B8QdVHh2W5rfZ6uu6Mh-L5ZzXAhj-VurJ_ICd5APAvz62bam4Q3NQicO-7tOK6ROVbX-G8zDCHpdTQYT7spvyJk4S-qUVofdnvUioC126j-XtynNrI Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_579f8544a1a24ab799ac61de9b46bac3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}] Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 89b7d98112f44c558b02cb20b036260a Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1589340328", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: exception: min_count must be <= max_count Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1589340328', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 20:59:57.470431 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.476301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f41a6e24-02ad-4d8c-9a22-455fafba4b84 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Returning 400 to user: min_count must be <= max_count {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 HTTP/1.1 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '22ce3926-f2c1-4496-b23e-75b4cecb0c72'} Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:57.476735 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.480944 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.482084 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f41a6e24-02ad-4d8c-9a22-455fafba4b84 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.329287 Aug 27 20:59:57.482838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1448/2801] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:57 2022] POST /compute/v2.1/servers => generated 74 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 20:59:57.483564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.486473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5db3b6cb-9915-4ae0-b987-efb63d302bbb tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "DELETE /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 404 len: 111 microversion: 2.1 time: 0.103400 Aug 27 20:59:57.487760 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1354/2802] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 20:59:57 2022] DELETE /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:57.503012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.504040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] [instance: 22ce3926-f2c1-4496-b23e-75b4cecb0c72] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.516906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.522263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.533173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.533909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.537410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.538510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.541932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.542187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.543456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.545997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.547196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.548443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.549055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.549572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.607843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] HTTP exception thrown: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Request method failure captured: Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 HTTP/1.1 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoS6qyFotxBVaLA4XcZQFqM0mmZQ2EJMvDYMFhTihxjSYqxvLrkhUGYq6FD4PHzy1kfaZRVrr26Zp9W3kdgfZZlVdIRXTl4k71ZaQwl_IWbKDhdvnjnqC926w-LCWk5KajiDgj5XEFtJh8FUhWecxgon7yzmxBe50R3KhkxoPmHpW4g Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1f7e5f0366a4113922c93cee71427d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1f7e5f0366a4113922c93cee71427d4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1f7e5f0366a4113922c93cee71427d4"}]}] Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e1f7e5f0366a4113922c93cee71427d4 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesTestJSON-119225201 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: ede90e55159a4d3192505c74a2a69a51 Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesTestJSON-119225201-project Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '22ce3926-f2c1-4496-b23e-75b4cecb0c72'} Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.614915 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. Aug 27 20:59:57.619010 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.621080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] Returning 404 to user: Instance 22ce3926-f2c1-4496-b23e-75b4cecb0c72 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.622275 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e7f0f64-4dd5-4e1c-a9c6-700965c2b296 tempest-ImagesTestJSON-119225201 tempest-ImagesTestJSON-119225201-project] 10.222.0.40 "GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72" status: 404 len: 111 microversion: 2.1 time: 0.125721 Aug 27 20:59:57.627904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1355/2803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:57 2022] GET /compute/v2.1/servers/22ce3926-f2c1-4496-b23e-75b4cecb0c72 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 20:59:57.659592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc6f575-ada6-4e4a-b1b2-016d24179bd4 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2096682399", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "max_count": 0}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc6f575-ada6-4e4a-b1b2-016d24179bd4 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Request method failure captured: Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 168 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXM9_6aWqWbIDZVzJKwKIj7uw7Vn_7FwfxaXmB3QTsc9dPu_sviywrAKjU27B8QdVHh2W5rfZ6uu6Mh-L5ZzXAhj-VurJ_ICd5APAvz62bam4Q3NQicO-7tOK6ROVbX-G8zDCHpdTQYT7spvyJk4S-qUVofdnvUioC126j-XtynNrI Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_579f8544a1a24ab799ac61de9b46bac3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}] Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 89b7d98112f44c558b02cb20b036260a Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2096682399", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "max_count": 0}} Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2096682399', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'max_count': 0}}} Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 0 Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:57.682177 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc6f575-ada6-4e4a-b1b2-016d24179bd4 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:57.686250 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfc6f575-ada6-4e4a-b1b2-016d24179bd4 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.054559 Aug 27 20:59:57.688706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1356/2804] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:57.733150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:57.738699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:57.764709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.769466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.769466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:57.771083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:57.778629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:57.779410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:58.441083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:58.455118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-805aed01-4af0-4096-9e9e-38f1b9c052ed tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1477 microversion: 2.1 time: 0.970424 Aug 27 20:59:58.455749 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1449/2805] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:57 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1477 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:58.472486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b46f494-ba24-477f-b454-543f4efea490 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-624131241", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "max_count": 2.5}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b46f494-ba24-477f-b454-543f4efea490 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Request method failure captured: Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 169 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXM9_6aWqWbIDZVzJKwKIj7uw7Vn_7FwfxaXmB3QTsc9dPu_sviywrAKjU27B8QdVHh2W5rfZ6uu6Mh-L5ZzXAhj-VurJ_ICd5APAvz62bam4Q3NQicO-7tOK6ROVbX-G8zDCHpdTQYT7spvyJk4S-qUVofdnvUioC126j-XtynNrI Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_579f8544a1a24ab799ac61de9b46bac3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}] Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 89b7d98112f44c558b02cb20b036260a Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-624131241", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "max_count": 2.5}} Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-624131241', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:58.481671 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b46f494-ba24-477f-b454-543f4efea490 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:58.485656 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b46f494-ba24-477f-b454-543f4efea490 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026487 Aug 27 20:59:58.489908 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1450/2806] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:58.503183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:58.503888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:58.525014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:58.526829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:58.527289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:58.529838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:58.530924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:58.532859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:58.755694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:58.772485 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0b8a35ce-64df-4a27-81b8-ca6f2db0197b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 1.068480 Aug 27 20:59:58.773620 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1357/2807] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:57 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:58.778680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:58.781214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:58.789250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:58.790081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:58.790767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:58.793122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:58.793846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:58.794489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:58.946349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:58.958238 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90fab856-f886-4805-b136-db5a8ff68fe1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1278 microversion: 2.1 time: 0.181164 Aug 27 20:59:58.959231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1358/2808] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:58 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:58.968069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c35db00-dcc1-4453-bb22-d2be6c213838 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1015761349", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 0}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c35db00-dcc1-4453-bb22-d2be6c213838 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Request method failure captured: Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 168 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXM9_6aWqWbIDZVzJKwKIj7uw7Vn_7FwfxaXmB3QTsc9dPu_sviywrAKjU27B8QdVHh2W5rfZ6uu6Mh-L5ZzXAhj-VurJ_ICd5APAvz62bam4Q3NQicO-7tOK6ROVbX-G8zDCHpdTQYT7spvyJk4S-qUVofdnvUioC126j-XtynNrI Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_579f8544a1a24ab799ac61de9b46bac3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}] Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 89b7d98112f44c558b02cb20b036260a Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1015761349", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 0}} Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1015761349', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'min_count': 0}}} Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 0 Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:58.973547 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 20:59:58.977313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:58.980516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c35db00-dcc1-4453-bb22-d2be6c213838 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:58.981934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c35db00-dcc1-4453-bb22-d2be6c213838 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018540 Aug 27 20:59:58.983776 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1359/2809] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:59.045285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 20:59:59.055488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1349704-5e29-4dbb-88a9-3f9356562190 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.565247 Aug 27 20:59:59.058610 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1451/2810] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:58 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 20:59:59.135993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f33a34d-9fa9-4c2c-996b-e440e1229a94 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-793880654", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 2.5}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f33a34d-9fa9-4c2c-996b-e440e1229a94 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Request method failure captured: Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 169 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXM9_6aWqWbIDZVzJKwKIj7uw7Vn_7FwfxaXmB3QTsc9dPu_sviywrAKjU27B8QdVHh2W5rfZ6uu6Mh-L5ZzXAhj-VurJ_ICd5APAvz62bam4Q3NQicO-7tOK6ROVbX-G8zDCHpdTQYT7spvyJk4S-qUVofdnvUioC126j-XtynNrI Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/579f8544a1a24ab799ac61de9b46bac3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_579f8544a1a24ab799ac61de9b46bac3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/579f8544a1a24ab799ac61de9b46bac3"}]}] Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 579f8544a1a24ab799ac61de9b46bac3 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2104952572 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 89b7d98112f44c558b02cb20b036260a Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2104952572-project Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-793880654", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 2.5}} Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-793880654', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 20:59:59.144141 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 20:59:59.148505 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 20:59:59.149935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f33a34d-9fa9-4c2c-996b-e440e1229a94 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 20:59:59.151740 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f33a34d-9fa9-4c2c-996b-e440e1229a94 tempest-MultipleCreateNegativeTestJSON-2104952572 tempest-MultipleCreateNegativeTestJSON-2104952572-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020953 Aug 27 20:59:59.153449 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1360/2811] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 20:59:59 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 20:59:59.314847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85d9bb0-7b3e-4069-a18d-10a072260bd5", "name": "network-vif-plugged", "status": "completed", "tag": "120749e1-e698-49dc-ae24-06be800b81e2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 20:59:59.350477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:59.352255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:59.353709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:59.403333 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] Creating event network-vif-plugged:120749e1-e698-49dc-ae24-06be800b81e2 for instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 on nch2-master-1 Aug 27 20:59:59.422927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4df2ab86-6b84-4c77-af4e-f7514108796a req-dc7e83f0-1395-402f-ad37-06b30adc61ea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111290 Aug 27 20:59:59.424997 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1452/2812] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 20:59:59.483494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:59.484101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:59.495292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:59.496497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:59.499654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:59.500693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:59.501326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:59.502178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:59.797740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 20:59:59.799014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 20:59:59.810480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:59.811371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:59.812058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 20:59:59.812981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 20:59:59.813761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 20:59:59.814190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.351460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:00.366734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:00.393175 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9fc5a083-02fb-4ffa-a87f-cdff66dbb81d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.599122 Aug 27 21:00:00.396976 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1453/2813] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:59 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:00.405019 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7b787fe-6991-4c48-bc58-fb97f6bbcefb tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1477 microversion: 2.1 time: 0.921808 Aug 27 21:00:00.407641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1361/2814] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 20:59:59 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1477 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:00.416425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:00.418909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:00.420914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:00.421812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:00.437629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:00.442774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:00.446604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.447228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:00.449038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:00.449385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:00.450765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.451018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:00.451882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.453232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:00.459660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:00.460458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.682024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:00.693986 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b90b603c-0ceb-4e0e-a63f-44ce48ff8ad4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1278 microversion: 2.1 time: 0.291320 Aug 27 21:00:00.710419 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1454/2815] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:00 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:00.798567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0945198a-59f1-42c7-af44-6b0d56c21537", "name": "network-vif-deleted", "tag": "f1dd7e6f-9356-4065-bb67-243f6b95f497"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:00.836980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:00.837876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:00.838479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:00.860594 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] Creating event network-vif-deleted:f1dd7e6f-9356-4065-bb67-243f6b95f497 for instance 0945198a-59f1-42c7-af44-6b0d56c21537 on nch2-master-1 Aug 27 21:00:00.870184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1e7eef6d-e7df-4722-8f33-e99057d673ec req-49aa96f1-950e-43ce-a157-16b66eb1d483 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074547 Aug 27 21:00:00.871573 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1455/2816] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:00:00.895588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:00.904144 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40a7fbe0-719e-497f-af8b-c163ed0c974b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.494525 Aug 27 21:00:00.905401 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1362/2817] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:00 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:01.435022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:01.438344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:01.438678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:01.442208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:01.476848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.477461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.477990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.478516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.479914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.480786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.481331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.482639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.485415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.485831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.486547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.494590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.566841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.567474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.568141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.568816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lazy-loading 'fault' on Instance uuid 0945198a-59f1-42c7-af44-6b0d56c21537 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:00:01.782374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eaee129221b45b596e46ff13bd034bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd909cdd2a0f94f94a65a0737a39dd911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:01.791050 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24e3c9a7-e0f6-42de-a116-ea75f66be687 tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 200 len: 1311 microversion: 2.1 time: 0.364398 Aug 27 21:00:01.797961 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1363/2818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:01 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:01.822828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d458d6ef-270a-43b7-a7c9-b2bf3494d426", "name": "network-vif-plugged", "status": "completed", "tag": "576e346c-95ad-48a7-b385-e05c644d10cf"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:01.840152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.846729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.847327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.873870 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] Creating event network-vif-plugged:576e346c-95ad-48a7-b385-e05c644d10cf for instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 on nch1-master-1 Aug 27 21:00:01.885398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1138518a-a279-4ceb-9ba3-2c11d03745d1 req-2a83bb90-d2a8-46ec-98b7-e956278839c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070193 Aug 27 21:00:01.887803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1364/2819] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:01.898916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:01.900227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:01.910591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.911242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.911918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:01.912702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:01.913171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:01.913605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:02.192829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:02.228256 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fee9ed8-822d-4157-8209-ca49de91e78d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1321 microversion: 2.1 time: 0.808100 Aug 27 21:00:02.230847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1456/2820] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:01 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:02.249175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:02.251960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:02.285388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:02.285998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:02.286881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:02.289595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:02.290116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:02.291044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:02.418676 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:00:02.419244 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a (ip 10.222.0.40) !!! Aug 27 21:00:02.473285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:02.488348 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fb21b333-3168-448b-ae24-4e0f52d15ab0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.596015 Aug 27 21:00:02.488934 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1365/2821] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:01 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:02.819171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:02.819830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] [instance: 0945198a-59f1-42c7-af44-6b0d56c21537] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:02.838881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:02.839249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:02.839731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:02.848214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:02.848914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:02.849516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:02.893082 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] HTTP exception thrown: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Request method failure captured: Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 HTTP/1.1 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoV8OIM-LX9sDLy9E9NNWv1Y1O9x27umN7EdIMSBeD5k-v7ZXTdmFsGXXNCyXIGUdAu3PXn6Tj07Fsqla5Ltu13aLkMbcD9JJmLk7steOPuTQmXY3VUHajOukVhmqbWuY9O-z98bM7Vsedpy3hRwxxfS1U83XrIBlQ6-fAGx7F1s5q8 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d909cdd2a0f94f94a65a0737a39dd911 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909cdd2a0f94f94a65a0737a39dd911"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d909cdd2a0f94f94a65a0737a39dd911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d909cdd2a0f94f94a65a0737a39dd911", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d909cdd2a0f94f94a65a0737a39dd911"}]}] Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d909cdd2a0f94f94a65a0737a39dd911 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1314421224 Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1314421224-project Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1eaee129221b45b596e46ff13bd034bd Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1314421224-project Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '0945198a-59f1-42c7-af44-6b0d56c21537'} Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:02.894797 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] Returning 404 to user: Instance 0945198a-59f1-42c7-af44-6b0d56c21537 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:02.898689 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2679366e-89f3-4024-aac5-5154f528a9cd tempest-ServersAdminNegativeTestJSON-1314421224 tempest-ServersAdminNegativeTestJSON-1314421224-project] 10.222.0.40 "GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537" status: 404 len: 111 microversion: 2.1 time: 0.082040 Aug 27 21:00:02.900505 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1366/2822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:02 2022] GET /compute/v2.1/servers/0945198a-59f1-42c7-af44-6b0d56c21537 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:00:02.931232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:02.957939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c9e0f41-f601-4614-a638-4fcdfd788ba4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.709798 Aug 27 21:00:02.962398 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1457/2823] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:02 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:03.248716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:03.249571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:03.263523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:03.264016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:03.264459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:03.265274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:03.265731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:03.266150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:03.514036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:03.515424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:03.531703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:03.536061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:03.538263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:03.539040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:03.540718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:03.541552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.117729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:04.120915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:04.132299 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c52d8dfb-8226-4c31-b266-cb3b9c014390 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1512 microversion: 2.1 time: 0.887386 Aug 27 21:00:04.133339 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1367/2824] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:03 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1512 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:04.155290 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb4b043b-3742-4cda-838b-c74ac00c3709 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.647831 Aug 27 21:00:04.160728 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1458/2825] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:03 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:04.166792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:04.167757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:04.174501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.174997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.175458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.177021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.177643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.188108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.468020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c69baf5-a2fd-4a01-8b6e-d5843e844a44", "tag": "ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:04.482186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.482674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.483120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.496114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:04.521137 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] Creating event network-changed:ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6 for instance 4c69baf5-a2fd-4a01-8b6e-d5843e844a44 on nch1-master-1 Aug 27 21:00:04.533674 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1ecd98e9-dcfa-429e-9b20-741909e5958c req-d6ae6c16-31da-44ec-8b9b-1ce1e06a9405 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398597 Aug 27 21:00:04.535441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1368/2826] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:04.546112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287ce978-0c3f-4b10-8fbb-4ec5054ca75a", "name": "network-vif-plugged", "status": "completed", "tag": "d1f2f728-fa93-4176-a105-224d50d652ad"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:04.572844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.573343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.573779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.589352 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] Creating event network-vif-plugged:d1f2f728-fa93-4176-a105-224d50d652ad for instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a on nch2-master-1 Aug 27 21:00:04.596997 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d17697e2-1526-41f8-be51-46e7903247d5 req-bf06137c-1703-43ff-82c9-66e38db1c61f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059648 Aug 27 21:00:04.598438 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1369/2827] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:04.605507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:04.606806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:04.621726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.622589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.623229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.624293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:04.625017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:04.626060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:04.669140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:04.865084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:04.879761 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98921eab-5586-43e6-959c-8ee7c89eeeb2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.716357 Aug 27 21:00:04.881159 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1459/2828] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:04 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:05.042550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16bac075-04a5-4790-a10c-9cf8a5225ad3", "tag": "f9e530d4-37ec-46b5-b001-d184fd0143e9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:05.119303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:05.119843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:05.120982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:05.150263 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] Creating event network-changed:f9e530d4-37ec-46b5-b001-d184fd0143e9 for instance 16bac075-04a5-4790-a10c-9cf8a5225ad3 on nch1-master-1 Aug 27 21:00:05.161168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-251f8ec6-2100-4611-951a-36b4f5a590e2 req-19a44975-9d57-4a5d-ac10-1b11f4c8e7d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130473 Aug 27 21:00:05.164803 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1460/2829] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:05.180020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:05.182895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:05.204708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:05.207568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:05.208089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:05.208089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:05.209941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:05.210581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:05.212613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:05.240814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60a0ade5-0fb0-404a-8b37-a387e5336e60 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1511 microversion: 2.1 time: 0.640906 Aug 27 21:00:05.244321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1370/2830] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:04 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:05.265653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:05.266690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:05.276279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:05.281932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:05.282688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:05.284047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:05.284833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:05.287265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.006592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:06.017557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4cc80c7f-fd8b-4925-a477-972e809b00a1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1513 microversion: 2.1 time: 0.757004 Aug 27 21:00:06.022644 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1371/2831] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:05 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1513 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:06.038630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:06.039773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:06.048747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:06.052366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:06.056121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:06.056667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.058090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:06.059472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:06.060976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.062259 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe9cf835-9293-463a-b676-8c874680ddf2 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.887654 Aug 27 21:00:06.063202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1461/2832] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:05 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:06.074303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:06.090818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:06.092454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:06.100711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:06.122927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:06.123697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:06.124337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.125706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:06.126335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:06.126916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.254920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:06.271744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:06.388693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:06.411240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:06.411793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:06.415314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:06.970535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:07.004256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3aa56b1b-1ae3-4580-bcfb-8a0b6b94c18a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1328 microversion: 2.1 time: 0.979994 Aug 27 21:00:07.008773 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1372/2833] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:06 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1328 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:07.088708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:07.089416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:07.097284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:07.097832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:07.098395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:07.099117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:07.099605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:07.100035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:07.442340 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5db4dcb5-b97c-4fd7-8b52-9a21edf83292 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.377832 Aug 27 21:00:07.442976 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1462/2834] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 21:00:06 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:07.474899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:07.481128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:07.482729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-462743419', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:07.495631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:07.496155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:07.496793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:07.497881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:07.500066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:07.500673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:07.632479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:07.651591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:07.661841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-360aeea0-6e3a-43d4-a8d5-e848dd5c55d4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.581287 Aug 27 21:00:07.662427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1373/2835] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:07 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:07.742110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:07.748694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:07.749427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:07.750014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:07.871258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-736368dd-c042-40cb-85f5-d3ffeab24759 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84f137700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dP7M72flqgn6AHpLSE6pJ9OURAQGdnSjcX5HKvO8bbwosQdM+EGq6VabJSi2Xjg3Mv51gw8RzNwka5HBOOv34xByO4X66Kpvp8IvQCjf6ZYTD/eIydqSLbOefVMEvNA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-736368dd-c042-40cb-85f5-d3ffeab24759 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 257 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dP7M72flqgn6AHpLSE6pJ9OURAQGdnSjcX5HKvO8bbwosQdM+EGq6VabJSi2Xjg3Mv51gw8RzNwka5HBOOv34xByO4X66Kpvp8IvQCjf6ZYTD/eIydqSLbOefVMEvNA=="}} Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dP7M72flqgn6AHpLSE6pJ9OURAQGdnSjcX5HKvO8bbwosQdM+EGq6VabJSi2Xjg3Mv51gw8RzNwka5HBOOv34xByO4X66Kpvp8IvQCjf6ZYTD/eIydqSLbOefVMEvNA=='}}} Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 21:00:07.880187 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 21:00:07.884873 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.888719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-736368dd-c042-40cb-85f5-d3ffeab24759 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:07.889609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-736368dd-c042-40cb-85f5-d3ffeab24759 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.225445 Aug 27 21:00:07.896336 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1374/2836] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:07 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:00:07.903603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84e775d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1216212197", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:07.926278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:07.935122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for user 215684d000bf497183850747cd202f96 and project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:07.958186 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 2167 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1216212197", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:07.987886 ncdv-master-1 devstack@n-api.service[140433]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1216212197', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:07.990888 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:07.993860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:07.997204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:07.998649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-45b14693-15a2-4218-a565-ddad41a6949b tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100467 Aug 27 21:00:08.009272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1375/2837] 10.222.0.40 () {60 vars in 1160 bytes} [Sat Aug 27 21:00:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:00:08.015718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d67cf319-6880-43b5-b9e7-bcc9f9773f38 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84e6e3160>, body: {"keypair": {"name": "tempest-keypair-1201966206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjXKj9mkGXFMgiqh4xTepVr8t7MqApvye+PmG1rZ35zJK4qsrTbLoikTGOEEsl/0nRqyR26He1QJf+f50VzDaCWnjNiLSQfFidXSFW3CqPwq3xhEj67MNajy5ir3jfQ+g=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:08.038709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d67cf319-6880-43b5-b9e7-bcc9f9773f38 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:08.045760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d67cf319-6880-43b5-b9e7-bcc9f9773f38 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for user 215684d000bf497183850747cd202f96 and project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:08.087315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d67cf319-6880-43b5-b9e7-bcc9f9773f38 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075833 Aug 27 21:00:08.098783 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1376/2838] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:08.106783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:08.108848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:08.116769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.117723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.118990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.119966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.120594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.121181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.170910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1f2cdb1-924d-4e6d-8e0a-51ca79a51f3c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-462743419" status: 200 len: 1514 microversion: 2.1 time: 0.699769 Aug 27 21:00:08.188463 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1463/2839] 10.222.0.40 () {58 vars in 1261 bytes} [Sat Aug 27 21:00:07 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-462743419 => generated 1514 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:08.193964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84f350ee0>, body: {"keypair": {"name": "tempest-keypair-1201966206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWwL5GtZM7P/Ln3GrHP0OMu/XgFnf5fJjTEdsW3+PlJNgNuDfCeCVR3osZeCE849k/8UPibWBiTlx4nu+z06gKr3glLweRf8GrtO1aHZmXfQDeDxFD/jwQdU7H8lks6Og=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:08.211117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:08.218335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for user 215684d000bf497183850747cd202f96 and project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:08.280894 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] HTTP exception thrown: Key pair 'tempest-keypair-1201966206' already exists. Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 273 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: {"keypair": {"name": "tempest-keypair-1201966206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWwL5GtZM7P/Ln3GrHP0OMu/XgFnf5fJjTEdsW3+PlJNgNuDfCeCVR3osZeCE849k/8UPibWBiTlx4nu+z06gKr3glLweRf8GrtO1aHZmXfQDeDxFD/jwQdU7H8lks6Og=="}} Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: exception: Key pair 'tempest-keypair-1201966206' already exists. Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1201966206', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWwL5GtZM7P/Ln3GrHP0OMu/XgFnf5fJjTEdsW3+PlJNgNuDfCeCVR3osZeCE849k/8UPibWBiTlx4nu+z06gKr3glLweRf8GrtO1aHZmXfQDeDxFD/jwQdU7H8lks6Og=='}}} Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result.read() Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '215684d000bf497183850747cd202f96-tempest-keypair-1201966206' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 21:00:08.322217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result.read() Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 21:00:08.326947 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '215684d000bf497183850747cd202f96-tempest-keypair-1201966206' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 21, 0, 8, 249798), 'updated_at': None, 'name': 'tempest-keypair-1201966206', 'user_id': '215684d000bf497183850747cd202f96', 'fingerprint': '19:9b:2d:88:81:17:3f:92:3d:c4:77:e0:66:ee:a3:3f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWwL5GtZM7P/Ln3GrHP0OMu/XgFnf5fJjTEdsW3+PlJNgNuDfCeCVR3osZeCE849k/8UPibWBiTlx4nu+z06gKr3glLweRf8GrtO1aHZmXfQDeDxFD/jwQdU7H8lks6Og==', 'type': 'ssh'}] Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._create() Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1201966206' already exists. Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 21:00:08.330834 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1201966206' already exists. Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1201966206' already exists. Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 409 to user: Key pair 'tempest-keypair-1201966206' already exists. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36885988-4879-4df8-994b-1d46030f1a58 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.141987 Aug 27 21:00:08.339721 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1464/2840] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:08 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:00:08.354252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:08.367141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:08.368041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:08.397909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.404974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.405677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.412224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.412655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.415455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.707146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:08.721323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8febf6f7-5106-4a55-abcd-62b8b21f533e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1510 microversion: 2.1 time: 0.619158 Aug 27 21:00:08.724419 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1377/2841] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:08 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:08.735766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a0e431c-e333-4eb5-81b6-b528084769c1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Calling method '.version_select at 0x7ff84e7f3280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:08.747071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:08.786754 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a0e431c-e333-4eb5-81b6-b528084769c1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201966206" status: 202 len: 0 microversion: 2.1 time: 0.060960 Aug 27 21:00:08.789372 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1378/2842] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201966206 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:08.795176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:08.806707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:08.813334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.813842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.814284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.815373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.818196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.818641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:08.928937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:08.946462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:08.947059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:08.947549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.232502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:09.246585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e22557d7-67aa-42dc-86ff-757cd6f6c0d9 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.451649 Aug 27 21:00:09.247570 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1379/2843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:08 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:09.257727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:09.258365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:09.277588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.278109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.278773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.279804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.280473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.281067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.337664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7753310-7992-4927-bb2d-6d39b0a97172 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.004859 Aug 27 21:00:09.338464 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1465/2844] 10.222.0.40 () {58 vars in 1173 bytes} [Sat Aug 27 21:00:08 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:09.356965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e57e58b7-56b4-461f-a623-84ab235e7e83 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84eea4ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPywQfNNFUdeN9eOYntddhjbJ1HCG17kW4Jui5FZ0Gbe6OuEi9QCd25H3vlsUFIR8VHJbC0PZ+8xAJujcj8Tgye+q6cfjows992a5drrfxUYZSFHMtQi6QBpx9iFB6mxUA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e57e58b7-56b4-461f-a623-84ab235e7e83 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 247 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPywQfNNFUdeN9eOYntddhjbJ1HCG17kW4Jui5FZ0Gbe6OuEi9QCd25H3vlsUFIR8VHJbC0PZ+8xAJujcj8Tgye+q6cfjows992a5drrfxUYZSFHMtQi6QBpx9iFB6mxUA=="}} Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPywQfNNFUdeN9eOYntddhjbJ1HCG17kW4Jui5FZ0Gbe6OuEi9QCd25H3vlsUFIR8VHJbC0PZ+8xAJujcj8Tgye+q6cfjows992a5drrfxUYZSFHMtQi6QBpx9iFB6mxUA=='}}} Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '' Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:00:09.361661 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:00:09.365685 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.370711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e57e58b7-56b4-461f-a623-84ab235e7e83 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:09.371620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e57e58b7-56b4-461f-a623-84ab235e7e83 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.031999 Aug 27 21:00:09.383013 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1466/2845] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:00:09.401610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:09.412284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:09.412981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.servers [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Removing options 'limit' from query {{(pid=140434) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 21:00:09.414892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:09.421962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.422708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.423393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.424261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.425247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.425860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.478669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:09.490853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.491809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.493042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.791544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:09.802239 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48ea4e83-0abd-4619-b4a4-f37dd5c3e2d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1510 microversion: 2.1 time: 0.553509 Aug 27 21:00:09.802837 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1380/2846] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:09 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:09.812733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84e6e1ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1368572159", "public_key": " "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:09.857175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:09.872714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for user 215684d000bf497183850747cd202f96 and project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:09.905816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15e9e34d-ccee-4364-a400-f2eecf14036a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.521634 Aug 27 21:00:09.906560 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1467/2847] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 21:00:09 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:09.914283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 95 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1368572159", "public_key": " "}} Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1368572159', 'public_key': ' '}}} Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:09.916267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:09.920087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dec97381-2149-4954-be3b-c4d33352c356 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109362 Aug 27 21:00:09.928913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1381/2848] 10.222.0.40 () {60 vars in 1158 bytes} [Sat Aug 27 21:00:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:00:09.931523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:09.932027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:09.942097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:09.944945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.949366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.952213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.953183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.954135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:09.955360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.956571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.956910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:09.969152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.971293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.972032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:09.977747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:09.978646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:09.979239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:10.021885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:10.176030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:10.190426 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee563dcb-b977-47e3-8c0a-d95c06efe048 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 204 len: 0 microversion: 2.1 time: 0.262511 Aug 27 21:00:10.195257 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1468/2849] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:09 2022] DELETE /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:10.201694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9644217f-49e6-40e3-b1b0-ea4afc1c11d1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84eeb79d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDej6BcTW2fnfYKJseT3FuoGeIwSRiPjAG+wmqX4RIvIFYcLppsQoVxbfrtPc2MOr8xUWuzEVo2FgpajFIqBLx1ixOIogSE1cU1PGNuLxl5JUgp1PNMnw6M9r8+KBmCo5Q=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9644217f-49e6-40e3-b1b0-ea4afc1c11d1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 507 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDej6BcTW2fnfYKJseT3FuoGeIwSRiPjAG+wmqX4RIvIFYcLppsQoVxbfrtPc2MOr8xUWuzEVo2FgpajFIqBLx1ixOIogSE1cU1PGNuLxl5JUgp1PNMnw6M9r8+KBmCo5Q=="}} Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDej6BcTW2fnfYKJseT3FuoGeIwSRiPjAG+wmqX4RIvIFYcLppsQoVxbfrtPc2MOr8xUWuzEVo2FgpajFIqBLx1ixOIogSE1cU1PGNuLxl5JUgp1PNMnw6M9r8+KBmCo5Q=='}}} Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 21:00:10.213269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.216787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9644217f-49e6-40e3-b1b0-ea4afc1c11d1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:10.219185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9644217f-49e6-40e3-b1b0-ea4afc1c11d1 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021471 Aug 27 21:00:10.219185 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1469/2850] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:10 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:00:10.230022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:10.230678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:10.248223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:10.248868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:10.250436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:10.251208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:10.253883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:10.254437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:10.333727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-31d96a50-03e5-4be6-92b4-f4d409c63e2e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.403568 Aug 27 21:00:10.339020 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1382/2851] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:00:09 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:10.349909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Action: 'create', calling method: .version_select at 0x7ff84e7f3e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1202300610", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:10.389167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:10.407099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Getting quotas for user 215684d000bf497183850747cd202f96 and project f8df693ca46e4d97909a23954085dbc6. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:10.453360 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 118 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1202300610", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1202300610', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 21:00:10.457610 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:10.462102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:10.465383 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56500239-c486-4781-9070-5e5d3139ea49 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.121519 Aug 27 21:00:10.467966 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1383/2852] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:00:10.478859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:10.484273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:10.498946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:10.500635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:10.503234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:10.503969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:10.508600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:10.509256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:10.510900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:10.911209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:10.933998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ab415bf-2387-482b-a334-88add4390638 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.463840 Aug 27 21:00:10.936444 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1384/2853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:10 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:10.948874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:10.972885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93906be4-3cdd-4e8a-8c6c-db4b437c7646 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1516 microversion: 2.1 time: 0.748513 Aug 27 21:00:10.975735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:10.976474 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1470/2854] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:10 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1516 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:10.997679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:10.998664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.compute.servers [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Removing options 'limit' from query {{(pid=140433) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 21:00:11.000659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72d031f0-e601-4ab2-9867-b9c0c49ddfe3 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Calling method '.version_select at 0x7ff84ef329d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.003436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:11.020516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.023766 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-72d031f0-e601-4ab2-9867-b9c0c49ddfe3 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 Aug 27 21:00:11.024568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72d031f0-e601-4ab2-9867-b9c0c49ddfe3 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Request method failure captured: Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-561763495 HTTP/1.1 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXXfZQ_isIRd8BdhsMT5ZlILuizxTWqG8IawANJndYPVj-V9WzzCvFTNWBgTR5LBa01JTMJEYiAlpmIdCj1CBexfldDME541BxmWCoOz3lHTQcUGqq9Xcu5wKrhS4VGFvyaI3yJFJM_2cd7V0musrFJyBbEqqAL7KrZqSxOzTr27X8 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f8df693ca46e4d97909a23954085dbc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f8df693ca46e4d97909a23954085dbc6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f8df693ca46e4d97909a23954085dbc6"}]}] Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f8df693ca46e4d97909a23954085dbc6 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1686485206 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 215684d000bf497183850747cd202f96 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1686485206-project Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: exception: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'tempest-keypair-non-existent-561763495'} Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:11.026369 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:11.030776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72d031f0-e601-4ab2-9867-b9c0c49ddfe3 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] Returning 404 to user: Keypair tempest-keypair-non-existent-561763495 not found for user 215684d000bf497183850747cd202f96 {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:11.033733 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72d031f0-e601-4ab2-9867-b9c0c49ddfe3 tempest-KeyPairsNegativeTestJSON-1686485206 tempest-KeyPairsNegativeTestJSON-1686485206-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-561763495" status: 404 len: 144 microversion: 2.1 time: 0.050250 Aug 27 21:00:11.034260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.034510 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1471/2855] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 21:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-561763495 => generated 144 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:00:11.054123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.055501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.057047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.157196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:11.223754 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2e8f5c1-2981-4e3a-bef5-f94ab8fee06d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.285332 Aug 27 21:00:11.230862 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1385/2856] 10.222.0.40 () {58 vars in 1150 bytes} [Sat Aug 27 21:00:10 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:11.238466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.255015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:11.256459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:11.263194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:11.296056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.306006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.307610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.308737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.310254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.311137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.356560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:11.458449 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d81654c-ce40-4b5a-bb8d-5c6eafac1bd0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.214447 Aug 27 21:00:11.479005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.479554 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1472/2857] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:00:11 2022] GET /compute/v2.1/servers => generated 1011 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:11.488972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:11.489641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:11.528020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.528406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.529039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.529917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.530603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.531182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.699519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:11.803813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-677c111a-7061-43e2-a2ec-c2e4876b7e00 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.330961 Aug 27 21:00:11.819215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.824524 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1386/2858] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:00:11 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:11.826033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:11.826841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.servers [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Removing options 'limit' from query {{(pid=140434) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 21:00:11.827833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:11.838727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.840593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.843539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.844789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.846160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.848851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.913326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29e67e80-98fd-431f-bcb8-8df91d0000ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.097543 Aug 27 21:00:11.931599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.937361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:11.938070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-462743419', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:11.939507 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1473/2859] 10.222.0.40 () {58 vars in 1140 bytes} [Sat Aug 27 21:00:11 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:11.948979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.949375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.949824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.950540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.958111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:11.959524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:11.963092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.963552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.981406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.981905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.982342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:11.983070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:11.983684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:11.984110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:12.614322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:12.722064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1093a51-9488-444c-bab0-0914dd0ff53b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-462743419" status: 200 len: 345 microversion: 2.1 time: 0.795967 Aug 27 21:00:12.730272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1387/2860] 10.222.0.40 () {58 vars in 1240 bytes} [Sat Aug 27 21:00:11 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-462743419 => generated 345 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:12.737069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:12.737977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:12.744994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:12.746813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:12.751019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:12.752594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:12.753473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:12.753923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:12.754362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:12.761033 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d2a4fc5-9b05-45a3-90e6-0d0cc2729504 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.807467 Aug 27 21:00:12.780404 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1474/2861] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:11 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:12.786579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:12.793675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:12.794681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:12.795650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:12.835708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:00:12.919146 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-018b205e-748a-4e24-9831-c9b238c386b7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "POST /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.136888 Aug 27 21:00:12.920110 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1475/2862] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:00:12 2022] POST /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:12.946935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:12.948121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:12.963884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:12.965305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:12.966557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:12.968232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:12.969367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:12.969966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:13.394555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:13.418151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ceeb637c-f95e-4ae7-a84b-6fa9ee890f8c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1516 microversion: 2.1 time: 0.685583 Aug 27 21:00:13.438573 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1388/2863] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:12 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1516 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:13.463973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:13.476647 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d704e7f-d83e-42a7-9ea5-d4fd7ed6750b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.540742 Aug 27 21:00:13.477999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1476/2864] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:12 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:13.782580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:13.783441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:13.794872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:13.794872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:13.795247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:13.800767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:13.801267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:13.801718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:13.955238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287ce978-0c3f-4b10-8fbb-4ec5054ca75a", "name": "network-vif-deleted", "tag": "d1f2f728-fa93-4176-a105-224d50d652ad"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:14.009255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.020219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.022039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.063153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] Creating event network-vif-deleted:d1f2f728-fa93-4176-a105-224d50d652ad for instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a on nch2-master-1 Aug 27 21:00:14.076508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9a73d0b1-a95c-4e22-ab2a-2b18d8e1c6e5 req-cad87bb5-22c7-4947-ab13-65929e1618bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125696 Aug 27 21:00:14.081826 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1477/2865] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:14.145936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:14.155492 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ec694c6-7667-4fc1-a9e6-46d339df1315 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.376944 Aug 27 21:00:14.159218 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1389/2866] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:13 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:14.457463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:14.460514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:14.478331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.478331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.483662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.486917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.495845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.501870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.503946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:14.506600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:14.523649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.524486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.525089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.528300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.528979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.529576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.664877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:14.665394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:14.665845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:14.666427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 287ce978-0c3f-4b10-8fbb-4ec5054ca75a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:00:14.854034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:14.874520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a106c08e-953b-47c0-9d45-9980c0257567 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 200 len: 1318 microversion: 2.1 time: 0.435074 Aug 27 21:00:14.875559 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1478/2867] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:14 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:14.981831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:14.991990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1626fff-dd8f-497b-83ad-cf273419397b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.497705 Aug 27 21:00:14.998840 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1390/2868] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:14 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:15.178050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:15.179274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:15.186827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:15.187313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:15.187941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:15.189105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:15.189717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:15.192933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:15.231238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:15.504447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:15.528450 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b2800385-c166-4eca-9126-3e7383380bb3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.347830 Aug 27 21:00:15.547839 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1479/2869] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:15 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:15.903857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] Calling method '.version_select at 0x7ff84e775040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:15.957939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e789dfc6-aa94-43a8-ab94-9befc3d30df4 tempest-ListImageFiltersNegativeTestJSON-1316653587 tempest-ListImageFiltersNegativeTestJSON-1316653587-project] Calling method '.version_select at 0x7ff84ee65c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:15.989814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a could not be found", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:00:15.990516 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] HTTP exception thrown: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] Request method failure captured: Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-floating-ips/78c2ad1b-b8fd-42fc-a5db-e29d5e17062a HTTP/1.1 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXfH9_TyuAUXHzYNxB-w5orrJZPrPqfjHDwthpd-ySKoCOOj4CE-AXKDnuX1R-Y_PTjTimuUwY4TxWtUO8NxSP5mLzkeYgauaAufyC8Z5nh_hfg4PHoXSYfiHzlmO7vhOGMm6hf742EGIQ7OaGuW2n8dxYjB_4R1y9sKXoxsnfl2cA Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 134574946ca34fa2a7ab11693405ea5f Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-63411023 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/134574946ca34fa2a7ab11693405ea5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/134574946ca34fa2a7ab11693405ea5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_134574946ca34fa2a7ab11693405ea5f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/134574946ca34fa2a7ab11693405ea5f"}]}] Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-63411023 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 134574946ca34fa2a7ab11693405ea5f Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-63411023 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-63411023-project Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 477cea20ff9243e28bffe023927a3aa7 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-63411023-project Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: exception: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '78c2ad1b-b8fd-42fc-a5db-e29d5e17062a'} Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a could not be found Aug 27 21:00:15.993262 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82e5bd63-7c67-4e77-a8ef-d57e76bc5340'] Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a. Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a Aug 27 21:00:15.997428 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:15.999976 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e789dfc6-aa94-43a8-ab94-9befc3d30df4 tempest-ListImageFiltersNegativeTestJSON-1316653587 tempest-ListImageFiltersNegativeTestJSON-1316653587-project] HTTP exception thrown: Image not found. Aug 27 21:00:16.002227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] Returning 404 to user: Floating IP not found for ID 78c2ad1b-b8fd-42fc-a5db-e29d5e17062a {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e789dfc6-aa94-43a8-ab94-9befc3d30df4 tempest-ListImageFiltersNegativeTestJSON-1316653587 tempest-ListImageFiltersNegativeTestJSON-1316653587-project] Request method failure captured: Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/images/c72ad8f7-120e-4e58-9632-8f60f3b4108e HTTP/1.1 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoXfL52yCjAYDHOx8N9NLZEK5DrAPdhLPcS6gY0IX0QeKqeD069JwHiFf0wyUFG8g6D9FbBw95kqcH2Gbzet5Gq8z6MarsOVnEdJcXFFO4J0eSW-5bREwrD9XBChOmyPDZCQOO7EiCTL0lPcA_UckQXpLGDQ8zcHocbUnIA3h7fb0CY Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: cf45145e725d4d3187bcd6a05874c06e Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1316653587 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf45145e725d4d3187bcd6a05874c06e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cf45145e725d4d3187bcd6a05874c06e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cf45145e725d4d3187bcd6a05874c06e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cf45145e725d4d3187bcd6a05874c06e"}]}] Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1316653587 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: cf45145e725d4d3187bcd6a05874c06e Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1316653587 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListImageFiltersNegativeTestJSON-1316653587-project Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 02473176b88546b2bac6b4cb79feba11 Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1316653587-project Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'c72ad8f7-120e-4e58-9632-8f60f3b4108e'} Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c72ad8f7-120e-4e58-9632-8f60f3b4108e Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 21:00:16.002334 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c72ad8f7-120e-4e58-9632-8f60f3b4108e could not be found. Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e789dfc6-aa94-43a8-ab94-9befc3d30df4 tempest-ListImageFiltersNegativeTestJSON-1316653587 tempest-ListImageFiltersNegativeTestJSON-1316653587-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:16.007020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e789dfc6-aa94-43a8-ab94-9befc3d30df4 tempest-ListImageFiltersNegativeTestJSON-1316653587 tempest-ListImageFiltersNegativeTestJSON-1316653587-project] 10.222.0.40 "GET /compute/v2.1/images/c72ad8f7-120e-4e58-9632-8f60f3b4108e" status: 404 len: 62 microversion: 2.1 time: 0.255862 Aug 27 21:00:16.015367 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1480/2870] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:00:15 2022] GET /compute/v2.1/images/c72ad8f7-120e-4e58-9632-8f60f3b4108e => generated 62 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:00:16.015670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d7b2fcf-95fe-4c43-85b7-619f968f4962 tempest-FloatingIPDetailsNegativeTestJSON-63411023 tempest-FloatingIPDetailsNegativeTestJSON-63411023-project] 10.222.0.40 "GET /compute/v2.1/os-floating-ips/78c2ad1b-b8fd-42fc-a5db-e29d5e17062a" status: 404 len: 111 microversion: 2.1 time: 0.574467 Aug 27 21:00:16.015670 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1391/2871] 10.222.0.40 () {58 vars in 1260 bytes} [Sat Aug 27 21:00:15 2022] GET /compute/v2.1/os-floating-ips/78c2ad1b-b8fd-42fc-a5db-e29d5e17062a => generated 111 bytes in 584 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:00:16.022013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c69baf5-a2fd-4a01-8b6e-d5843e844a44", "name": "network-vif-plugged", "status": "completed", "tag": "ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:16.023652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:16.024374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:16.039784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:16.041479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:16.042608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:16.043995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:16.044660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:16.045107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:16.049129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:16.052178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:16.052831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:16.078836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] Creating event network-vif-plugged:ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6 for instance 4c69baf5-a2fd-4a01-8b6e-d5843e844a44 on nch1-master-1 Aug 27 21:00:16.084579 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a HTTP/1.1 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '287ce978-0c3f-4b10-8fbb-4ec5054ca75a'} Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.086555 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:00:16.090387 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:00:16.090938 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-54836339-d27b-4c36-9ff7-6b298e0e6ab9 req-4a68927c-2152-431b-88c5-6dfab40262db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074889 Aug 27 21:00:16.091021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:16.091021 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41e7db49-e98a-4784-940f-157bec3ebeed tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 404 len: 111 microversion: 2.1 time: 0.077181 Aug 27 21:00:16.091551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1392/2872] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:16.094857 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1481/2873] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:16 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:00:16.101397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5421b6c-894c-4992-94a6-02ac29023d27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '.version_select at 0x7ff84ef32e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:16.103784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:16.104739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:16.121556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:16.123775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:16.125038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:16.126665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:16.128447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:16.129229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:16.137647 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5421b6c-894c-4992-94a6-02ac29023d27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-key-1113703586" status: 202 len: 0 microversion: 2.1 time: 0.041418 Aug 27 21:00:16.150932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1482/2874] 10.222.0.40 () {58 vars in 1209 bytes} [Sat Aug 27 21:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1113703586 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:16.177608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:16.448316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:16.464770 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa35d9d1-3b81-45f0-931c-e42e99aea237 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.374286 Aug 27 21:00:16.465962 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1393/2875] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:16 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:16.535406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873080521", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:16.687487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:17.328089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2130276485", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d2d83d3b-bbf9-48d4-a363-26e720648405"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:17.477099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] validate_networks() for [('d2d83d3b-bbf9-48d4-a363-26e720648405', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:17.856834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:17.857423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:17.858099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:17.858707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:17.859232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:17.876546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:17.877201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:17.877777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:17.886627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:17.887300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:17.887956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:17.936383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:17.945010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:17.963458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:17.968245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:18.042968 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dec4be73-0150-42d1-9318-3e5b6bfc6162 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513485 Aug 27 21:00:18.052225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1483/2876] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:00:18.073715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:18.074358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:18.097362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.099077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.099556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:18.101500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.106835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.107796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:18.809024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:18.821159 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-16eddb43-ee21-4c8e-842b-3179d78f8fb4 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.767481 Aug 27 21:00:18.825210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1484/2877] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:18 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:18.842185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:18.847770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:18.881105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.881743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.887768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:18.889743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.891030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.894171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:18.933242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:18.933930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:18.934427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:18.935480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:18.936157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:18.953437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.958312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.959425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:18.960637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:18.962825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:18.963570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:19.042429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Getting quotas for project e9c439104b8c44e8be264d5a3c4a039d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:19.061299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Getting quotas for user 05d73724d77a41df999698d5127ea9ad and project e9c439104b8c44e8be264d5a3c4a039d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:19.105074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:19.113080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:19.272394 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0de954b-da14-484a-b963-714cc6e88379 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.716177 Aug 27 21:00:19.273369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1394/2878] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:00:19.282954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:19.290882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:19.292679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:19.296546 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06fb2af3-624c-4bd2-87a0-5463948c9692 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.468009 Aug 27 21:00:19.312175 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1485/2879] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:18 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:19.351164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16bac075-04a5-4790-a10c-9cf8a5225ad3", "name": "network-vif-plugged", "status": "completed", "tag": "f9e530d4-37ec-46b5-b001-d184fd0143e9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:19.353349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:19.353859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:19.357343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:19.360578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:19.362276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:19.365889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:19.396005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:19.396699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:19.402450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:19.435998 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] Creating event network-vif-plugged:f9e530d4-37ec-46b5-b001-d184fd0143e9 for instance 16bac075-04a5-4790-a10c-9cf8a5225ad3 on nch1-master-1 Aug 27 21:00:19.460942 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c5a44f5f-feb4-460e-8705-bcea7bdbbe00 req-5a612aa2-276e-44e1-8850-f9aed8cc8286 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144097 Aug 27 21:00:19.462047 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1486/2880] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:19.480463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa3ef930-2a3f-45af-afea-c4624b025a84 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:19.481477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa3ef930-2a3f-45af-afea-c4624b025a84 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:19.535741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:19.550133 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-191aeb58-116f-413f-8ed5-e19c7a9712af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1204 microversion: 2.1 time: 0.274505 Aug 27 21:00:19.551050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1395/2881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:19 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1204 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:19.627255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa3ef930-2a3f-45af-afea-c4624b025a84 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:19.635204 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa3ef930-2a3f-45af-afea-c4624b025a84 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1217 microversion: 2.1 time: 0.168856 Aug 27 21:00:19.646764 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1487/2882] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:19 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:19.847771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:19.849358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:19.877917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:19.881302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:19.881956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:19.883104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:19.883896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:19.884573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:20.132761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba53ea81-065b-435a-86ff-d94cb18d4018 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84f04e1f0>, body: {"keypair": {"name": "tempest-keypair-2145010321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnDnIzsriHh7SkJUcEQkAyLpg6unuthN5XaR2xvjR4VbDEoYTimOhiMZCZPTRAAOjFxNo4iVZ0GwiXTOa6XGChR0MlWOIuuRL3dyooCzM7KYy/Hx5fnazGlFfXM4pQ/5Q=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:20.147888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:20.158574 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de8afc06-b7b6-434a-ad52-4abb24899676 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.317162 Aug 27 21:00:20.178707 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1396/2883] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:19 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:20.190078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ba53ea81-065b-435a-86ff-d94cb18d4018 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:20.196293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ba53ea81-065b-435a-86ff-d94cb18d4018 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:20.259625 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba53ea81-065b-435a-86ff-d94cb18d4018 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.366274 Aug 27 21:00:20.260289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1488/2884] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:20.273936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90a9bc12-c678-41f3-8cad-c6b6c1c19138 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84efce430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:20.318378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:20.319138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:20.338823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:20.339286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:20.339984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:20.340934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:20.341913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:20.342679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:20.343600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90a9bc12-c678-41f3-8cad-c6b6c1c19138 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-2145010321" status: 200 len: 498 microversion: 2.1 time: 0.070223 Aug 27 21:00:20.345504 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1397/2885] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 21:00:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2145010321 => generated 498 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:20.384523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-722b55c2-6ade-4c47-ac78-fc5ec0869ced tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84f137820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:20.468336 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-722b55c2-6ade-4c47-ac78-fc5ec0869ced tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145010321" status: 202 len: 0 microversion: 2.1 time: 0.103808 Aug 27 21:00:20.469209 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1398/2886] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145010321 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:00:20.495666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20a5311e-b4be-4ee3-807b-eff19df9866a tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84f079160>, body: {"keypair": {"name": "tempest-keypair-1193235551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGB+B5MY5DphpIdBI9Ma5JUq1VBz3yh/hiGS4fUFMqnAW+o/SW+eDoJh36h/F1+ymm3pByJJxyDlFEleKnPD9MIj/8q0hzOozYCZRm8XAzTbOagcypdZKt+liwpYaxIgvQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:20.584736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-20a5311e-b4be-4ee3-807b-eff19df9866a tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:20.640473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-20a5311e-b4be-4ee3-807b-eff19df9866a tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:20.760656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20a5311e-b4be-4ee3-807b-eff19df9866a tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277272 Aug 27 21:00:20.770474 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1399/2887] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:20.791639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:20.792613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:20.833564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:20.834783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:20.835562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:20.836406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:20.836983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:20.837383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:20.966967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:20.980572 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-43660865-b997-41e8-a47c-89823f5a5736 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1266 microversion: 2.1 time: 0.208859 Aug 27 21:00:21.007000 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1400/2888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:20 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:21.025151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.029987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:21.053941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:21.054453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:21.054898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:21.055653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:21.062839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:21.063519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:21.134515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:21.152160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e20afa6c-d817-4914-b6fc-d5a059cf9d19 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.838042 Aug 27 21:00:21.152771 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1489/2889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:20 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:21.172918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aada0447-765c-4177-b274-8b9e9604eed8 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84eeb4dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.240646 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aada0447-765c-4177-b274-8b9e9604eed8 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193235551" status: 202 len: 0 microversion: 2.1 time: 0.075251 Aug 27 21:00:21.244050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1490/2890] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193235551 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:21.278383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.279061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:21.293163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:21.298943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:21.302552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:21.303196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:21.304189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:21.306791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:21.308479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:21.309620 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee6b5c22-8fcb-4977-8e21-3d7d0f2b6bfd tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1213 microversion: 2.1 time: 0.299822 Aug 27 21:00:21.311027 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1401/2891] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:21 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1213 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:21.333112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f45fb9a6-9a8f-4e30-aa9d-86c033659b9b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84e738f70>, body: {"keypair": {"name": "tempest-keypair-2132026711", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:21.361001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f45fb9a6-9a8f-4e30-aa9d-86c033659b9b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:21.370940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f45fb9a6-9a8f-4e30-aa9d-86c033659b9b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:21.417742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f45fb9a6-9a8f-4e30-aa9d-86c033659b9b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.100579 Aug 27 21:00:21.431123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1402/2892] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:21 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:21.445251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea94769c-e098-4787-851f-d61d201452bc tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84e7f39d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.498076 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea94769c-e098-4787-851f-d61d201452bc tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132026711" status: 202 len: 0 microversion: 2.1 time: 0.060335 Aug 27 21:00:21.499407 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1403/2893] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132026711 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:21.512321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55270e9d-62b2-48dd-afb5-c14eb77a7634 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84e78eaf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1740726066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOLU70/cVTDdUYz1WQCR+5Obls6sc2DdZJFFPaVLV4fC1cZAtrBL9dRU4jcQfXO9CHx43QYaY5jN5NIil4119MQt9/21mirG9oV4z/PB5kVeiZlA1nILI9ac0T9Q6Ob4w=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:21.536491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-55270e9d-62b2-48dd-afb5-c14eb77a7634 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:21.544638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-55270e9d-62b2-48dd-afb5-c14eb77a7634 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:21.579766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55270e9d-62b2-48dd-afb5-c14eb77a7634 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.072246 Aug 27 21:00:21.581707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:21.591527 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a64235e0-6a38-49cf-aa18-ae5b6feb93ae tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1320 microversion: 2.1 time: 0.345630 Aug 27 21:00:21.594668 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1491/2894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:21 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:21.596912 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1404/2895] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:00:21.604634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6316134a-28e3-4318-a7a9-12b0968aad21 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84e793f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-716202168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaIKZB8pZyG/hVLPd86MOmLInCpN/qvaxWAKH7l8MSoJmgYPP+HW0LLLp/HNP7QKmS1fj5mOIEAiEwI/Yusc9zZNxFquH0Zbuq5tFAOk8TPcNOp0H5iaFV0AZVSv8+SMw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:21.634665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6316134a-28e3-4318-a7a9-12b0968aad21 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:21.641418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6316134a-28e3-4318-a7a9-12b0968aad21 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:21.664515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:21.682682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6316134a-28e3-4318-a7a9-12b0968aad21 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.084486 Aug 27 21:00:21.684373 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1405/2896] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:21.697963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44d5b092-2f23-433e-97bb-924c29f78902 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Action: 'create', calling method: .version_select at 0x7ff84eda08b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2087399343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeip+M23H2b3Y8zHZ5+BkJktaWoUm8SsjpYM/ifGQy0gbGcsGyIP2Sb3zR6832m0PQ3SiLXcZdUwTFiEkiLdOFJg0FoFq/zZozwH55SifQ76FU4uOxedpYpF07O/mcmoA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:21.719137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-44d5b092-2f23-433e-97bb-924c29f78902 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:21.725481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-44d5b092-2f23-433e-97bb-924c29f78902 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Getting quotas for user 8a539b9033f446f1aac6195170b67b47 and project 8bfd11f300b5475e94214a52d0c8852b. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:21.776885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44d5b092-2f23-433e-97bb-924c29f78902 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.080418 Aug 27 21:00:21.791757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-736abf34-334f-4e11-a21f-935500567103 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84e7f3280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.798242 ncdv-master-1 devstack@n-api.service[140433]: WARNING oslo_db.sqlalchemy.utils [None req-736abf34-334f-4e11-a21f-935500567103 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 21:00:21.808113 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1492/2897] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:21.817815 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-736abf34-334f-4e11-a21f-935500567103 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.032000 Aug 27 21:00:21.821522 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1406/2898] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:00:21 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:21.833176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c68ecca-1b89-4339-9110-2b4651552331 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84eeb4dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.899673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c68ecca-1b89-4339-9110-2b4651552331 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2087399343" status: 202 len: 0 microversion: 2.1 time: 0.073510 Aug 27 21:00:21.905091 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1493/2899] 10.222.0.40 () {58 vars in 1278 bytes} [Sat Aug 27 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2087399343 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:21.910355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ecb6277-695c-4ca8-80a2-94ddfc211d11 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84f096670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:21.964917 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ecb6277-695c-4ca8-80a2-94ddfc211d11 tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-716202168" status: 202 len: 0 microversion: 2.1 time: 0.059144 Aug 27 21:00:21.965515 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1407/2900] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-716202168 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:00:21.977178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a77886a8-9b50-4233-96ee-04f622ef3f5b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] Calling method '.version_select at 0x7ff84ec5a8b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:22.007745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:22.008539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:22.020579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.021070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.025472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.029365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.029845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.030459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.035093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a77886a8-9b50-4233-96ee-04f622ef3f5b tempest-KeyPairsV2TestJSON-978080079 tempest-KeyPairsV2TestJSON-978080079-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1740726066" status: 202 len: 0 microversion: 2.1 time: 0.062912 Aug 27 21:00:22.038324 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1494/2901] 10.222.0.40 () {58 vars in 1278 bytes} [Sat Aug 27 21:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1740726066 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:22.177631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:22.178424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:22.184811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:22.193240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.195056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.196515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.198068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.199314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a269850-3e05-4272-89a2-c94f873da8b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1266 microversion: 2.1 time: 0.196885 Aug 27 21:00:22.199781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.200620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.202203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1408/2902] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:22 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:22.332538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:22.333661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:22.354093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.354602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.357125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.359103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.360140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.360486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.676165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:22.685431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-333bebc0-a099-4867-bf4e-84320544f882 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1277 microversion: 2.1 time: 0.357462 Aug 27 21:00:22.700927 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1409/2903] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:22 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:22.706094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:22.708823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:22.716482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.717117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.717343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.718979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:22.718979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:22.718979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:22.898484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:22.917355 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54dbdfeb-eb00-44fa-b364-12c7ba761dc4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1521 microversion: 2.1 time: 0.743936 Aug 27 21:00:22.920968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1495/2904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:22 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1521 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:23.057626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:23.067759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f17ff36f-3b0e-4e4e-8fbd-b202528624e7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 200 len: 1508 microversion: 2.1 time: 0.365464 Aug 27 21:00:23.070038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1410/2905] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:22 2022] GET /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:23.092585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:23.093659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 4c69baf5-a2fd-4a01-8b6e-d5843e844a44] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:23.102210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.102933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.103652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.104655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.105533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.106060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.223252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:23.224610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:23.235591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.236614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.237291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.238582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.239263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.239985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.592083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:23.606467 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3066007c-2416-4053-a0cd-e38ad8e94c4f tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/4c69baf5-a2fd-4a01-8b6e-d5843e844a44" status: 200 len: 1508 microversion: 2.1 time: 0.518568 Aug 27 21:00:23.616567 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1496/2906] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:23 2022] GET /compute/v2.1/servers/4c69baf5-a2fd-4a01-8b6e-d5843e844a44 => generated 1508 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:23.635962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:23.640001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 4c69baf5-a2fd-4a01-8b6e-d5843e844a44] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:23.655787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.656320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.660195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.662870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.663499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.663948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.739643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 4c69baf5-a2fd-4a01-8b6e-d5843e844a44] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:23.804291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:23.815498 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a31aed2f-a1b4-45ad-adfd-994b660d14c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.599015 Aug 27 21:00:23.816289 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1411/2907] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:23 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:23.836403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:23.837165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:23.842124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:23.854981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.858540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-505fa6b4-3ba5-403b-b8b0-3844b09982eb tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c69baf5-a2fd-4a01-8b6e-d5843e844a44" status: 204 len: 0 microversion: 2.1 time: 0.230612 Aug 27 21:00:23.858739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.859264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.859835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.860356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.863840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1497/2908] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:23 2022] DELETE /compute/v2.1/servers/4c69baf5-a2fd-4a01-8b6e-d5843e844a44 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:23.864018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.878342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:23.879035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:23.901661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.903026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.905124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.905912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:23.906372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:23.909254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:23.957678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 16bac075-04a5-4790-a10c-9cf8a5225ad3] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:24.009706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:24.018432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbf18bcf-d66d-4d7f-b09d-8f501c4ee19f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1275 microversion: 2.1 time: 0.185983 Aug 27 21:00:24.019784 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1412/2909] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:23 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:24.041646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:24.044417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:24.059759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:24.063055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:24.064132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:24.065084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:24.066646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:24.067960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:24.103099 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4d81a862-74e7-409a-a4a8-f6e7ef8549f7 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3" status: 204 len: 0 microversion: 2.1 time: 0.237054 Aug 27 21:00:24.115231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1498/2910] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:23 2022] DELETE /compute/v2.1/servers/16bac075-04a5-4790-a10c-9cf8a5225ad3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:24.308453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1729357968", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b7be105a-9ed2-4ae5-82e2-5284d901aff4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:24.433888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] validate_networks() for [('b7be105a-9ed2-4ae5-82e2-5284d901aff4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:25.118725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:25.132192 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75b31be6-2e39-482f-8a25-2527ce96c665 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1498 microversion: 2.1 time: 1.110724 Aug 27 21:00:25.133447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1413/2911] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:24 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1498 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:25.154849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:25.160221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:25.188033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.189213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.189641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.190574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.191900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.195222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.574744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:25.594081 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f506195-4fed-4ca6-9374-e72319fa3229 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.459058 Aug 27 21:00:25.599241 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1414/2912] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:25 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:25.614531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:25.617529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:25.630550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.633538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.634277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.636032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.637131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.638259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.846333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:25.846848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:25.849485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:25.850644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:25.851247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:25.865543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.866032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.867027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.868783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:25.872938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:25.873558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:25.939407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Getting quotas for project d74eff4731ba40669a6e1fea39edb442. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:25.949882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:25.953195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Getting quotas for user 011f2af1a813465bb4541f2d0af04e17 and project d74eff4731ba40669a6e1fea39edb442. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:25.961179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3ead829-052a-4e9d-94d1-a1ceb12ec011 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.359992 Aug 27 21:00:25.962057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1415/2913] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:25 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:25.978537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d145188-a594-45b4-8181-8b2f9dbe53f5", "tag": "1ced34d1-18eb-4e71-99e0-83f13bd2fb66"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:25.985584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Going to run 2 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:25.998208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:26.013325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.013791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.014233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.096108 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] Creating event network-changed:1ced34d1-18eb-4e71-99e0-83f13bd2fb66 for instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 on nch2-master-1 Aug 27 21:00:26.098422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=ea790624-d9a0-473c-b5f4-469420bd11f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:26.114996 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7bb0d131-1d7b-41d0-bf07-ff432cd3fc78 req-8640e50b-a7c3-4a09-8f87-e62d951cf6d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148299 Aug 27 21:00:26.116034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1416/2914] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:26.131578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.146236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:26.147452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:26.154879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.157189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.157867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.158905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.159633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.160510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.192047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:26.229006 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48336f3c-b011-4e29-bfec-b82d9cc885e0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.111445 Aug 27 21:00:26.230596 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-279741d0-764a-42f1-b1c1-cefbc4a5d7d1 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.931959 Aug 27 21:00:26.238980 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1499/2915] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 1941 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:00:26.240259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1417/2916] 10.222.0.40 () {58 vars in 1154 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:26.250652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.252188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:26.281536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:26.282972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Searching by: {'deleted': False, 'project_id': 'd74eff4731ba40669a6e1fea39edb442'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:26.298581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.300811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.301269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.308462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.309365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.310342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.312149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.312865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.313840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.362813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:26.425082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5fdf9706-2951-40d8-885a-e43a5b4bb11a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.184461 Aug 27 21:00:26.432743 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1500/2917] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers => generated 1337 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:26.438414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25ff0c6b-ffe4-4cf5-8e53-7cd91f868717 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.439263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-25ff0c6b-ffe4-4cf5-8e53-7cd91f868717 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:26.459940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Going to try to start instance {{(pid=140433) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:00:26.540136 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7bcb839-d118-4ae4-a03c-a881bef122ac tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "POST /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.298180 Aug 27 21:00:26.541129 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1418/2918] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:00:26 2022] POST /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:26.551472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.552432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:26.559738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.560470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.561500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.562460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.563108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.563921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.569060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:26.600033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-25ff0c6b-ffe4-4cf5-8e53-7cd91f868717 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:26.605438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=35 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:26.613476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25ff0c6b-ffe4-4cf5-8e53-7cd91f868717 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1218 microversion: 2.1 time: 0.178673 Aug 27 21:00:26.617191 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1501/2919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:26.623017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.624137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:26.635588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.636337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.637428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.638671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.639893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.640904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:26.885924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:26.910044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:26.923547 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-300a6b90-5be6-40bd-8f17-ffc4ba5f7671 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1507 microversion: 2.1 time: 0.374130 Aug 27 21:00:26.924409 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1419/2920] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:26.953281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-acdb7e2e-6467-457a-a071-debf20c36535 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.300717 Aug 27 21:00:26.954264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1502/2921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:26.988093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:26.988723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:26.997048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:26.997592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:26.997966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.004394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.005204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.005920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.638200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:27.639008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:27.649872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.656245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.656897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.657967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.658587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.659157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.793370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:27.813177 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-439083bc-726f-4e9a-bdb2-dcc0000c7b6e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1222 microversion: 2.1 time: 0.179576 Aug 27 21:00:27.826788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1503/2922] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:27 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:27.903112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:27.919810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c6e2df1-8b5d-418b-80e4-6a9551591777 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.935599 Aug 27 21:00:27.937473 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1420/2923] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:26 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:27.947781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:27.949735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:27.969654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.973781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.974387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.975969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.976466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.976909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.979428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:27.980450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:27.981999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:27.990745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.991481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.991994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:27.992832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:27.993609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:27.994274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:28.413249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:28.429526 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa48f073-3375-408a-a168-cf2723da7ca7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1507 microversion: 2.1 time: 0.486434 Aug 27 21:00:28.447455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1504/2924] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:27 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:28.448984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:28.460812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-420566ba-525c-43a5-8e60-e6c66c6c8f78 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.490277 Aug 27 21:00:28.461431 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1421/2925] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:27 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:28.834528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:28.836455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:28.855660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:28.858578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:28.859373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:28.862459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:28.863240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:28.863948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:28.942841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:28.943716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:28.952092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:28.952933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:28.953070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:28.953898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:28.954213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:28.954661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:29.341952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:29.361612 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ea90425-5582-40c1-ac41-e99433326d70 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1214 microversion: 2.1 time: 0.530959 Aug 27 21:00:29.382185 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1505/2926] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:28 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1214 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:29.393408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16bac075-04a5-4790-a10c-9cf8a5225ad3", "name": "network-vif-deleted", "tag": "f9e530d4-37ec-46b5-b001-d184fd0143e9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:29.424598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:29.425599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:29.426625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:29.455373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] Creating event network-vif-deleted:f9e530d4-37ec-46b5-b001-d184fd0143e9 for instance 16bac075-04a5-4790-a10c-9cf8a5225ad3 on nch1-master-1 Aug 27 21:00:29.470069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-89934427-6d3b-4622-8874-299b639aa616 req-31789bec-2a18-43cb-8581-9be273d4d4d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086229 Aug 27 21:00:29.472628 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1506/2927] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:29.486538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:29.488877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:29.505492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:29.507819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:29.508519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:29.511137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:29.512392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:29.513635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.144266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:30.166018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c8b5a92-148f-4635-8913-99b8cd176151 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 1.227165 Aug 27 21:00:30.168747 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1422/2928] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:28 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:30.192875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:30.202022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:30.220583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:30.221387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:30.221991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.222945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:30.226197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:30.226842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.696901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:30.716775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55196757-1850-4b6b-ba74-5b409a0de7b1 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1507 microversion: 2.1 time: 1.240880 Aug 27 21:00:30.718363 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1507/2929] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:29 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1507 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:30.723696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:30.724592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:30.737851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:30.741306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:30.742009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.742967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:30.745956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:30.746678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.842438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:30.857521 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b61a79e-0865-4149-bb4a-b0361c6a301a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.679574 Aug 27 21:00:30.866134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1423/2930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:30 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:30.871788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c69baf5-a2fd-4a01-8b6e-d5843e844a44", "name": "network-vif-deleted", "tag": "ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:30.891800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:30.892292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:30.892998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:30.913403 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] Creating event network-vif-deleted:ba7601fe-b1ac-44da-b2bd-6a62bf60d6d6 for instance 4c69baf5-a2fd-4a01-8b6e-d5843e844a44 on nch1-master-1 Aug 27 21:00:30.920392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-49214c82-b605-45b7-a8d7-a794d6f1dbce req-9d0de7a0-b374-4691-91f9-553e35bc8748 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058387 Aug 27 21:00:30.921667 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1424/2931] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:30.973857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:30.994073 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71d15dec-e245-4115-95ea-269d3d254f49 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1276 microversion: 2.1 time: 0.269680 Aug 27 21:00:30.997804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1508/2932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:30 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:31.193099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:31.195399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:31.225077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.225592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.226223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:31.227123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.227756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.228493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:31.651732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=38 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:31.666244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:31.681368 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6dc03182-4a45-41c5-a2ec-f8b858b097ac tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.493072 Aug 27 21:00:31.683501 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1425/2933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:31 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:31.747104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:31.747918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:31.770090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.772201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.774684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:31.780543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.782391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.783124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:31.885999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:31.887141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:31.902123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.903172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.904074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:31.908104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:31.910459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:31.911358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:32.397682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:32.413050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3efd725f-0e14-4cd7-9c38-1293c872112b tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1507 microversion: 2.1 time: 0.673447 Aug 27 21:00:32.428811 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1509/2934] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:31 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:32.441599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:32.442231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:32.457785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:32.458219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:32.458660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:32.464400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:32.465134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:32.465507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:32.500898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:32.537008 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b440f449-5d1d-43b4-9091-19b7eb8e879e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.656721 Aug 27 21:00:32.538673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1426/2935] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:31 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:32.660447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:32.703647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:32.704585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:32.717284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:32.723240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:32.723958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:32.724956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:32.725581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:32.726161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:32.733839 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78918e62-8ab7-4981-8e6c-04127af5ceb6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1276 microversion: 2.1 time: 0.302435 Aug 27 21:00:32.736833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1510/2936] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:32 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:33.105098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:33.120481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48e16ef6-93ff-40ed-b2d8-0726a6d69990 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.421918 Aug 27 21:00:33.125208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1427/2937] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:32 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:33.441437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:33.442169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:33.453694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.461093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.462089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.465513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.466490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.467368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.530623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Calling method '.version_select at 0x7ff84eeb4a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:33.559642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.563438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.565435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.568289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.571325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.572502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.595489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=19 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:33.637758 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38a086ec-2418-454c-b983-cda3c22b3c04 tempest-AbsoluteLimitsTestJSON-5142861 tempest-AbsoluteLimitsTestJSON-5142861-project] 10.222.0.40 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.408403 Aug 27 21:00:33.651685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1511/2938] 10.222.0.40 () {58 vars in 1122 bytes} [Sat Aug 27 21:00:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:00:33.687407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:33.689509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:33.757392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.766326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.770978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.772819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.777099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.778931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.885898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:33.906943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5349fbc-d9c1-48f8-8ac9-7f9199869940 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1507 microversion: 2.1 time: 0.469423 Aug 27 21:00:33.908863 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1428/2939] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:33 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:33.919017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29dd1efe-a930-4499-bd77-e104553f5d9d", "tag": "88cb7e67-6da5-418d-81aa-db30301440d6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:33.939251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.940298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:33.940938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:33.965978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] Creating event network-changed:88cb7e67-6da5-418d-81aa-db30301440d6 for instance 29dd1efe-a930-4499-bd77-e104553f5d9d on nch2-master-1 Aug 27 21:00:33.976584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-98698249-b899-43e3-9575-39dfcba79c4a req-458d0020-7ef3-4b6d-9ed4-4f5fb75e7964 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064235 Aug 27 21:00:33.977937 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1429/2940] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:33.984937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:33.985926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:33.997371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:33.998601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.000503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.002610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.003431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.004245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.158997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:34.166731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:34.171024 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fab0c82-fbfa-44b7-8384-960c5226b34b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.519914 Aug 27 21:00:34.176796 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1512/2941] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:33 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:34.183984 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fcf0e890-f4fe-4fbe-804d-b41d4fd78f40 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1276 microversion: 2.1 time: 0.202179 Aug 27 21:00:34.187719 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1430/2942] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:33 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:34.194098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d145188-a594-45b4-8181-8b2f9dbe53f5", "name": "network-vif-plugged", "status": "completed", "tag": "1ced34d1-18eb-4e71-99e0-83f13bd2fb66"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:34.198913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:34.203290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:34.220969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.221225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.222170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.222699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.225547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.226868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.228728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.230243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.232447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.244800 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] Creating event network-vif-plugged:1ced34d1-18eb-4e71-99e0-83f13bd2fb66 for instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 on nch2-master-1 Aug 27 21:00:34.255168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b2505289-92c5-4f9e-9d62-c6b1cb739f09 req-ef01923e-f615-411a-8a71-04a274921c63 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077083 Aug 27 21:00:34.258170 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1513/2943] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:34.898921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:34.921615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f8831b87-2dba-4b64-9015-76e52632162f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.731723 Aug 27 21:00:34.923481 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1431/2944] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:34 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:34.932906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:34.934370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:34.946086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.946865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.948106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:34.948987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:34.949655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:34.951277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.201916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:35.203540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:35.214853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.215384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.215829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.216927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.217415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.217935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.869484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:35.878173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:35.887226 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b2a3ebd-e8ec-4ccf-9dd7-6ae77ea627d5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1308 microversion: 2.1 time: 0.689374 Aug 27 21:00:35.900842 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-148ed309-71a7-4b28-85d6-34d311e5f964 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1511 microversion: 2.1 time: 0.967137 Aug 27 21:00:35.901572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1432/2945] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:35 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:35.906659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:35.907689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:35.909314 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1514/2946] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:34 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1511 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:35.919244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:35.924539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.925793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.926596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.927604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:35.928090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.servers [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Removing options 'limit' from query {{(pid=140434) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 21:00:35.928361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.928907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:35.929461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.930078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.930370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.930581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.931032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.931794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.932252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.933241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.934701 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-87ff8297-81b6-410d-8779-8b8804839d05 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020120 Aug 27 21:00:35.938714 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1515/2947] 10.222.0.40 () {58 vars in 1140 bytes} [Sat Aug 27 21:00:35 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:00:35.946115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:35.946825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:35.957458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.958201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.959124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:35.959940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:35.960679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:35.961284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:36.174066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:36.338450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:36.348871 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d35d1e54-9826-4bfe-8fe0-75f69ced0db6 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.446069 Aug 27 21:00:36.357468 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1433/2948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:35 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:36.374475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:36.375405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:36.384690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:36.385621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:36.386244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:36.399392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:36.400343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:36.400984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:36.475745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:36.503720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85a808b2-685f-4c29-825c-871cd92e8eda tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.563088 Aug 27 21:00:36.522881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1516/2949] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:35 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:36.743111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:36.752219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a59ed389-333f-4dda-b8dc-160aeb609d66 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1511 microversion: 2.1 time: 0.393210 Aug 27 21:00:36.756956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1434/2950] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:36 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1511 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:36.782483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:36.783788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:36.805433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:36.813114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:36.813629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:36.814406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:36.818056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:36.820197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:36.823043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b79d962a-727a-4ebe-a814-03142b77bf96 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84edb5160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-898324894", "description": "tempest-description-231840941"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:37.178216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:37.186932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-630e91ec-d057-4c9d-8177-f8d16937729a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1513 microversion: 2.1 time: 0.409736 Aug 27 21:00:37.187551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1435/2951] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:36 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:37.192152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:37.192766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:37.223063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:37.223611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:37.224056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:37.228726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:37.229858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:37.231731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:37.426925 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b79d962a-727a-4ebe-a814-03142b77bf96 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.902358 Aug 27 21:00:37.428305 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1517/2952] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:37.434347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:37.434958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:37.449539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:37.450326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:37.450977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:37.452391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:37.453537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:37.454117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:37.940988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:37.944217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:37.950374 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2f6b2d5-d62b-4d62-9706-171fab85e13c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1512 microversion: 2.1 time: 0.520959 Aug 27 21:00:37.953483 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e4bb9a6-036d-4623-9c79-c73991db0d26 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1489 microversion: 2.1 time: 0.764588 Aug 27 21:00:37.954851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1436/2953] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:37 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1489 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:37.959803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:37.960595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:37.970289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1518/2954] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:37 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:38.000300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed18984a-ee3e-4ad2-9caa-54f4d84c82a3 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84ec09c10>, body: {"security_group_rule": {"parent_group_id": "016ae956-b724-4988-a4f7-454c924ff1aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:38.005262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:38.005776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:38.009942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:38.016423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:38.021785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:38.022472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:38.092542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:38.524968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:38.546333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc7f8a62-69dd-400c-8875-5b0834fbf477 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.589959 Aug 27 21:00:38.559177 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1437/2955] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:37 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:38.564854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:38.568027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:38.581457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:38.583974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:38.584592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:38.585511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:38.589854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:38.590306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:38.998956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:39.009514 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4ba8396-a94c-4caa-81f2-83034800e12a tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.448811 Aug 27 21:00:39.011014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1438/2956] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:38 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:39.017547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:39.024351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:39.025762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:39.086871 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed18984a-ee3e-4ad2-9caa-54f4d84c82a3 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.115190 Aug 27 21:00:39.087674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1519/2957] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:39.095668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea790624-d9a0-473c-b5f4-469420bd11f3", "tag": "992bbe4f-6a51-4102-9f6e-fd98c0858bb3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:39.113204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:39.113686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:39.114120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:39.137912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] Creating event network-changed:992bbe4f-6a51-4102-9f6e-fd98c0858bb3 for instance ea790624-d9a0-473c-b5f4-469420bd11f3 on nch2-master-1 Aug 27 21:00:39.143366 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2493d00e-311a-4a83-a6ad-3ce46e802986 req-538633b6-943e-4ea9-894c-4aedb3720156 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Aug 27 21:00:39.144876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1520/2958] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:39.151701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873080521", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:39.246774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:39.411575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:39.412398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:39.413049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:39.415779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:39.416576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:39.418085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:39.586407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:39.700901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf4e47d2-f194-4a68-8b4c-cfb0a62e25bd tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.688342 Aug 27 21:00:39.703086 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1439/2959] 10.222.0.40 () {58 vars in 1154 bytes} [Sat Aug 27 21:00:39 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:39.719331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d88a685-3827-4e1b-9c8d-4d7932e2a8c7 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f239280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1642224136", "description": "tempest-description-272555938"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:40.379990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d88a685-3827-4e1b-9c8d-4d7932e2a8c7 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.674995 Aug 27 21:00:40.407721 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1440/2960] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:40.416546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:40.417537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:40.424615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.425356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.425856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:40.428173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.428974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.430999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:40.497465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:40.498693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:40.499444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:40.500075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:40.500716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:40.512369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.513319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.514069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:40.515083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.515805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.516472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:40.538655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:40.545292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:40.560626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:40.564145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:40.621207 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-141c6c62-2372-48aa-b558-2479ea9c5da7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474738 Aug 27 21:00:40.622549 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1521/2961] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:00:40.627857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:40.629342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:40.638002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.639673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.640365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:40.641627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:40.642841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:40.643826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.293207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:41.332880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a34e758-8a9e-4db4-afd4-63e1a0163000 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.921773 Aug 27 21:00:41.333637 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1441/2962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:40 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:41.349698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:41.350943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:41.364805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.365308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.365754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.366475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.369281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.370019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.412874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:41.431914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f73095c-07e9-4106-8819-e471b818462a tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1511 microversion: 2.1 time: 0.797414 Aug 27 21:00:41.432871 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1522/2963] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:40 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1511 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:41.447548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70eac7ee-26ef-4ec5-aa44-8422df23820f tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84eeb4550>, body: {"security_group_rule": {"parent_group_id": "fe735e5f-ce50-4b9a-aba5-cce89fad3e43", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:41.666094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:41.680462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa93159f-50ac-48d5-9f17-cc93d35c03fb tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.340812 Aug 27 21:00:41.681089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1442/2964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:41 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:41.692679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:41.696543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:41.704957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.705701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.706290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.707182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.708249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.708843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.812344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:41.823143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7cf5bed2-d642-47f6-8cc9-f89ad5ea56c6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1204 microversion: 2.1 time: 0.140878 Aug 27 21:00:41.823769 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1443/2965] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:41 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1204 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:41.841896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5202d226-3010-4e17-8306-2a4b22da23a6", "tag": "b6f14d89-66c1-48f5-8057-c0aaa64b0f0f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:41.847909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70eac7ee-26ef-4ec5-aa44-8422df23820f tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.413478 Aug 27 21:00:41.850565 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1523/2966] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:41 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:41.866514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.867158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.867872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.868593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:41.871280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:41.882302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.884233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.884398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] Creating event network-changed:b6f14d89-66c1-48f5-8057-c0aaa64b0f0f for instance 5202d226-3010-4e17-8306-2a4b22da23a6 on nch2-master-1 Aug 27 21:00:41.886162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.887285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:41.887984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:41.888719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:41.889949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ce6a4b3f-aa41-491c-b089-98ce359d4318 req-1b089053-4d6d-477c-99bd-5b3fffda99eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061379 Aug 27 21:00:41.890921 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1444/2967] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:42.047997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4608a7b-f9f9-46b7-8147-11cd4ca8e364 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Action: 'create', calling method: .version_select at 0x7ff84f373ee0>, body: {"keypair": {"name": "tempest-keypair-80923648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTfrmf8HdwKcvyXKRbrzv6Y6x+zxTeqisjj624a9wI4Axs/wUTtTnh6CGsFff5Qb3JLGv0H3nBrSZDJ5jN442DINsjCxfJ5T1hAn3e0/KKc7GwvFTGlHz5jw//Ix/0/HA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:42.067582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b4608a7b-f9f9-46b7-8147-11cd4ca8e364 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for project 7599dfd7db2647bf8f986bffd781b87d. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:42.076000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b4608a7b-f9f9-46b7-8147-11cd4ca8e364 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for user 9d18c23a6da54d88b00e6f7855ea82c1 and project 7599dfd7db2647bf8f986bffd781b87d. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:42.082253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:42.099618 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-803b2730-5fea-4402-b348-9423c5b7f767 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1513 microversion: 2.1 time: 0.241272 Aug 27 21:00:42.101789 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1524/2968] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:41 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:42.106979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8712a802-bb2c-4aba-bc1c-fb0502205b20 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84eea4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1486899125", "description": "tempest-description-1146767383"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:42.155755 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4608a7b-f9f9-46b7-8147-11cd4ca8e364 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.263268 Aug 27 21:00:42.161969 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1445/2969] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:41 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:42.161969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:42.162292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:42.180210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.180713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.181149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.181856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.188056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.188428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.633718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:42.653193 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e36ab1de-61a3-4549-85b6-3f4c239ad5d3 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1512 microversion: 2.1 time: 0.495175 Aug 27 21:00:42.655903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1446/2970] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:42 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:42.675047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:42.675641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:42.681313 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8712a802-bb2c-4aba-bc1c-fb0502205b20 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.578147 Aug 27 21:00:42.682187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1525/2971] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:42 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:42.693619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.695204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:42.696544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.697076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.697835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.698457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.698887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.713322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:42.715909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:42.725801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.726381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.726977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.727840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.728420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.728953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:42.765765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:42.833214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:42.843208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:42.843733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:42.844397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.085316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:43.113768 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-533ad1fc-4be5-4ca4-91d1-8615ba9bf751 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.454518 Aug 27 21:00:43.115690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1447/2972] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:42 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:43.138414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ef441ed-4613-4385-8b36-1c9046518459 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f2c6040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1307587615", "description": "tempest-description-835813558"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:43.155498 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0a46dac-8ac9-4972-a9dd-a8226c45ad3d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.471992 Aug 27 21:00:43.156416 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1526/2973] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:00:42 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:43.163012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:43.168792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:43.177741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.178241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.180990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.182982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.183477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.189672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.531114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:43.545449 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0a62f6c-13e0-4ef8-b9c4-f61ee3f7502e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.387533 Aug 27 21:00:43.559434 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1527/2974] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:43 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:43.573411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:43.574544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:43.583540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.584303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.585358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.586416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.587403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.588059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.612733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:43.722534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ef441ed-4613-4385-8b36-1c9046518459 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.588888 Aug 27 21:00:43.733433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:43.734771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1448/2975] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:43.745408 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d038644-f425-490a-8eb9-ebf52316a90f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1266 microversion: 2.1 time: 0.183871 Aug 27 21:00:43.756137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dd1efe-a930-4499-bd77-e104553f5d9d", "name": "network-vif-plugged", "status": "completed", "tag": "88cb7e67-6da5-418d-81aa-db30301440d6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:43.765438 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1528/2976] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:43 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:43.771848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:43.782655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.785159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.786267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:43.789559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:43.798878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.820011 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] Creating event network-vif-plugged:88cb7e67-6da5-418d-81aa-db30301440d6 for instance 29dd1efe-a930-4499-bd77-e104553f5d9d on nch2-master-1 Aug 27 21:00:43.828400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7aa8e56b-8459-4ff3-9b40-81e8d320115e req-e5f2ee48-00e7-477c-8e41-ece121b376f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092213 Aug 27 21:00:43.830459 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1449/2977] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:43.840584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2deb5b0-2b6e-4cec-832e-9ff4cb91c515 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f145d30>, body: {"security_group_rule": {"parent_group_id": "8ec7094f-7c46-49f3-a709-4d9844e5fab3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "78cf883d-95ee-48fb-8ba6-7b1674df62c6"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:43.980521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.981364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.981540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:43.982453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:43.983423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:43.983948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:44.200959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:44.345359 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9233ce9-7567-4f16-975f-a0ee50cc6d0e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.578367 Aug 27 21:00:44.357513 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1529/2978] 10.222.0.40 () {58 vars in 1150 bytes} [Sat Aug 27 21:00:43 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:44.383763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:44.384279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:44.400004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:44.404737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:44.405299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:44.406056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:44.406801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:44.407274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:44.410575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.028952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:45.048433 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25a5c5fd-5bd6-4150-9130-1466ae855f61 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.688788 Aug 27 21:00:45.049278 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1530/2979] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:44 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:45.074808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:45.082316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:45.083317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:45.089788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.096934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.097674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.099196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.099895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.100505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.145561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2deb5b0-2b6e-4cec-832e-9ff4cb91c515 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.311265 Aug 27 21:00:45.146153 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1450/2980] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:43 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:45.150854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:45.151618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:45.170038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.170694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.171146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.175749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.176901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.177404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.369349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:45.501087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0137c13-3b4e-407d-b2cd-b93f4dde1168 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.433879 Aug 27 21:00:45.507115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:45.508034 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1531/2981] 10.222.0.40 () {58 vars in 1212 bytes} [Sat Aug 27 21:00:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:45.519040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:45.519782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:45.523358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e280451-c6ed-4341-859b-f6c8fb378a83 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 0.376117 Aug 27 21:00:45.529370 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1451/2982] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:45 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:45.536447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.539038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.539640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:45.542175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:45.542775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:45.547168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a1c514e-befc-4c43-9c74-ff039264b10f tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f145820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-372986548", "description": "tempest-description-508710851"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:45.548175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.262271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a1c514e-befc-4c43-9c74-ff039264b10f tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.731130 Aug 27 21:00:46.263765 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1452/2983] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:45 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:46.265169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:46.274658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:46.278918 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5d508d1-019f-4663-a55f-e389ad59c4b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.769382 Aug 27 21:00:46.293562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1532/2984] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:45 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:46.293697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:46.293697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:46.299600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:46.300504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:46.305812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.306840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.307717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.316562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.316697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.319726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.320310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.320733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.322073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.323388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.324010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.324577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.489083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:46.671466 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8fb64b9-73e8-4c8b-a882-0884041c20c0 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.406132 Aug 27 21:00:46.672645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1453/2985] 10.222.0.40 () {58 vars in 1196 bytes} [Sat Aug 27 21:00:46 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:46.678176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-185248f3-3ef2-4c49-93eb-9ccab24ab609 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f16ad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2115858575", "description": "tempest-description-1854419192"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:46.794695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:46.805089 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-213b6eee-e604-4f0f-93f7-30d0c6372d67 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.520474 Aug 27 21:00:46.811661 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1533/2986] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:46 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:46.821454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:46.822990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:46.840256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.847712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.848407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:46.849164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:46.849801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:46.850362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:47.833117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:47.846795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7435b73-4ead-4eef-b66d-2a3c11767101 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1317 microversion: 2.1 time: 1.028856 Aug 27 21:00:47.847929 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1534/2987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:46 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:47.857286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:47.866366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:47.866989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': '-462743419', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:47.879906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:47.880607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:47.881191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:47.882062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:47.882664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:47.883250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:47.948787 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-185248f3-3ef2-4c49-93eb-9ccab24ab609 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.274809 Aug 27 21:00:47.949547 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1454/2988] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:46 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:47.963469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc244e6-b697-415e-b85f-754f4fffbe62", "tag": "8489d4b7-225e-41d9-9439-994670fe1bbd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:47.971490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:47.977287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:47.978097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:47.979075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:47.993558 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] Creating event network-changed:8489d4b7-225e-41d9-9439-994670fe1bbd for instance 6cc244e6-b697-415e-b85f-754f4fffbe62 on nch1-master-1 Aug 27 21:00:48.001427 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3a8e2681-92c3-408a-a9cf-239600548244 req-d78cc952-32f2-40c6-9816-541bb71964ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041519 Aug 27 21:00:48.002386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1455/2989] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:48.009331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:48.010050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:48.016373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:48.016567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.017065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.017764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.018961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.019764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.020360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.084112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2de09920-c61b-400c-b914-5af743decab7 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-462743419" status: 200 len: 345 microversion: 2.1 time: 0.235032 Aug 27 21:00:48.092576 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1535/2990] 10.222.0.40 () {58 vars in 1156 bytes} [Sat Aug 27 21:00:47 2022] GET /compute/v2.1/servers?name=-462743419 => generated 345 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:48.092576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:48.093416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:48.099764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.100260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.100702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.101408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.101871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.102291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.361460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:48.365892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:48.372748 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd185b14-1170-4734-8478-2c33243b9d26 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.286493 Aug 27 21:00:48.374213 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1536/2991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:48 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:48.375727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f11ea877-e84f-4d5a-a1a8-2e60ee19b900 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.371880 Aug 27 21:00:48.376376 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1456/2992] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:48 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:48.381420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:48.386548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:48.393672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:48.394493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab773e74-1dfd-4347-84c4-2e1731282ba7 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84ec73b80>, body: {"security_group_rule": {"parent_group_id": "a88de667-01d5-413a-86e1-b3ef67cf8f72", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f41825d8-6daf-4a06-9855-ce855a1b4bfc"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:48.408045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.409200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.410520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.411871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.412435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.412871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.503053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:48.565145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d2a98e92-946e-46b0-93e5-9d502238c97d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.187484 Aug 27 21:00:48.566021 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1457/2993] 10.222.0.40 () {58 vars in 1154 bytes} [Sat Aug 27 21:00:48 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:48.578268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:48.583674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:48.584552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-46274341', 'deleted': False, 'project_id': 'b22f74c2c47b434b8783c8579636f04e'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:00:48.590769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.591705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.592515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.593855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.594499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.595033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.694365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:00:48.810009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c315db0f-26dd-4969-b897-cfe604bbaf8f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-46274341" status: 200 len: 345 microversion: 2.1 time: 0.235362 Aug 27 21:00:48.812355 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1458/2994] 10.222.0.40 () {58 vars in 1226 bytes} [Sat Aug 27 21:00:48 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-46274341 => generated 345 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:00:48.831566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:48.832397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:48.842721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.843426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.843939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.844761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:48.845532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:48.846028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:48.893146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:48.928728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:49.007175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59ecebb9-396c-497d-ad2b-c1d94cc3c502 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 204 len: 0 microversion: 2.1 time: 0.183382 Aug 27 21:00:49.012369 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1459/2995] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:48 2022] DELETE /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:49.023031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.023996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:49.031999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.032688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.033236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.034099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.034609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.035142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.122074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab773e74-1dfd-4347-84c4-2e1731282ba7 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.746203 Aug 27 21:00:49.123840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1537/2996] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:48 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:49.130650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.132159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:49.144073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.144695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.145252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.146204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.146895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.148302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.403048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:49.416156 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3b2dde4-c5ee-452f-ba75-20a89398d574 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1506 microversion: 2.1 time: 0.402250 Aug 27 21:00:49.417091 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1460/2997] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:49 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:49.426761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202d226-3010-4e17-8306-2a4b22da23a6", "name": "network-vif-plugged", "status": "completed", "tag": "b6f14d89-66c1-48f5-8057-c0aaa64b0f0f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:49.449709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.450449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.451028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.472807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] Creating event network-vif-plugged:b6f14d89-66c1-48f5-8057-c0aaa64b0f0f for instance 5202d226-3010-4e17-8306-2a4b22da23a6 on nch2-master-1 Aug 27 21:00:49.473446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:49.479943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-641eda0a-f9e2-496f-b681-02824d3f9af8 req-ec4249e7-7eaf-4088-b796-d8575b9847be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058806 Aug 27 21:00:49.480839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1461/2998] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:49.487968 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27001b0c-edeb-4b42-9747-6da271e7792e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1518 microversion: 2.1 time: 0.362411 Aug 27 21:00:49.490320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca30584b-7cfa-4e67-915e-79886da0a58b tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f373310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.490802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1538/2999] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:49 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:49.508814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.509466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:49.537147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.540209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.540991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.542314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.544055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.544717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.841452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:49.852829 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d637f836-c5ea-4806-86b5-42bcdd7d6cbc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.360704 Aug 27 21:00:49.860347 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1539/3000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:49 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:49.890170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.891239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:49.899172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.899721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.900164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.901176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.902166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.902619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.920612 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca30584b-7cfa-4e67-915e-79886da0a58b tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f41825d8-6daf-4a06-9855-ce855a1b4bfc" status: 202 len: 0 microversion: 2.1 time: 0.438163 Aug 27 21:00:49.924771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1462/3001] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:49 2022] DELETE /compute/v2.1/os-security-groups/f41825d8-6daf-4a06-9855-ce855a1b4bfc => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:49.930541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:49.933403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:49.960213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.961160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.968377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:49.969343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:49.969909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:49.971065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.011014 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1001c901-f3b7-46e2-a583-0488a78d5714 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips" status: 200 len: 109 microversion: 2.1 time: 0.084564 Aug 27 21:00:50.019093 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1463/3002] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:00:49 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips => generated 109 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:50.024139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63d76932-7a3f-45bf-b2f5-b05a939daa39 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f5c4430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:50.105663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:50.106977 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63d76932-7a3f-45bf-b2f5-b05a939daa39 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/a88de667-01d5-413a-86e1-b3ef67cf8f72" status: 200 len: 246 microversion: 2.1 time: 0.086608 Aug 27 21:00:50.111184 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1464/3003] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:00:50 2022] GET /compute/v2.1/os-security-groups/a88de667-01d5-413a-86e1-b3ef67cf8f72 => generated 246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:50.117250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e23edd88-9c61-482e-abb2-989aca5dd0b9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.240905 Aug 27 21:00:50.118463 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1540/3004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:49 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:50.124458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:50.125038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:50.141315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.143588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.144279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.145597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.146560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.147297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.194257 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e99fc4fa-1956-4bc9-b5bf-d9829773357b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips" status: 200 len: 109 microversion: 2.1 time: 0.074457 Aug 27 21:00:50.196937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1541/3005] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:00:50 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips => generated 109 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:50.208564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-addf457f-6c43-4079-a2ad-f652c2701c80 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff857db9430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-905294042", "description": "tempest-description-982588171"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:50.216813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-018678a0-6407-456f-bdf3-ae621a1bc27b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Action: 'create', calling method: .version_select at 0x7ff84e793b80>, body: {"keypair": {"name": "tempest-keypair-1599208938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxXLhtuu0d8JJ1VHFJXJiOPn7Uez9YQ8gstDGOfX/QHXJHrAuVP6rgR+8nll2IDednfGirT7rQTpaXRdGWViSfSHPDKgb3PbQQ25X3IpRJ2Qntyp18IRfaxVLymWWP6mQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:50.235100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-018678a0-6407-456f-bdf3-ae621a1bc27b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for project c3482773a4054d0486ec671b7899e681. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:50.242697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-018678a0-6407-456f-bdf3-ae621a1bc27b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for user e1059213ffb04e778d7f9e2fd1ff2474 and project c3482773a4054d0486ec671b7899e681. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:50.282139 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-018678a0-6407-456f-bdf3-ae621a1bc27b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169313 Aug 27 21:00:50.289159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1465/3006] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:00:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:50.301039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:50.303762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:50.319231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.319970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.320420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.321267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.321805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.324501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.382284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d871b77-af32-49aa-979c-2f8f637f951e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips/tempest-ServerAddressesTestJSON-1395124838-network" status: 200 len: 94 microversion: 2.1 time: 0.091827 Aug 27 21:00:50.390949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1466/3007] 10.222.0.40 () {58 vars in 1401 bytes} [Sat Aug 27 21:00:50 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d/ips/tempest-ServerAddressesTestJSON-1395124838-network => generated 94 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:00:50.400263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:50.401427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:50.415833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.417654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.418084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.419257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.419386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.419762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.490804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:50.560754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-addf457f-6c43-4079-a2ad-f652c2701c80 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.364014 Aug 27 21:00:50.568833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1542/3008] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:00:50 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:50.574136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:50.574781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:50.583701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.585889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.586383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.587113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:50.587603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:50.588126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:50.671724 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-57583fdc-29bc-44ad-a46b-3bb554d0437b tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "DELETE /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 204 len: 0 microversion: 2.1 time: 0.276483 Aug 27 21:00:50.672645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1467/3009] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:50 2022] DELETE /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:50.685603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b71cdba-348c-4b43-aacc-feafd342cdd1 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84e793790>, body: {"security_group_rule": {"parent_group_id": "a0e00c72-878d-42c0-a411-25f45c89149d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:50.897273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:50.913320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a5c05f7-40e0-4a1b-bcec-1fe5c8b8ac99 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1518 microversion: 2.1 time: 0.350271 Aug 27 21:00:50.914937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1543/3010] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:50 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1518 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:50.932932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1127395836", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "49e0aeca-9f8b-472b-b8e2-7cbc0f7458e6"}], "security_groups": [{"name": "tempest-securitygroup--1814639718"}], "key_name": "tempest-keypair-80923648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:51.125718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] validate_networks() for [('49e0aeca-9f8b-472b-b8e2-7cbc0f7458e6', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:51.235825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b71cdba-348c-4b43-aacc-feafd342cdd1 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.557774 Aug 27 21:00:51.237231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1468/3011] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:51.242007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:51.243011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:51.252665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.253608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.254290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.255245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.255985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.256650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.494709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:51.511816 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6c9c150-64a5-44c8-be8c-92cf5fc8bf16 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1512 microversion: 2.1 time: 0.273193 Aug 27 21:00:51.513788 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1469/3012] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:51 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:51.520710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:51.521862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:51.536279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.536820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.537286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.538015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.538479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.538903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.778565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:51.788397 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d3423eb-9df9-4f3d-a717-3983f271724a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.272603 Aug 27 21:00:51.805301 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1470/3013] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:51 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:51.812590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:51.816613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:51.827071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.827961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.829103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.830284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.830849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.832294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.863739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for project 7599dfd7db2647bf8f986bffd781b87d. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:51.869162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for user 9d18c23a6da54d88b00e6f7855ea82c1 and project 7599dfd7db2647bf8f986bffd781b87d. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:51.883134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:51.883650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:51.884288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:51.884695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:51.885285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:51.893990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.894684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.895275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.896315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:51.896914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:51.897484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:51.919619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for project 7599dfd7db2647bf8f986bffd781b87d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:51.925208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Getting quotas for user 9d18c23a6da54d88b00e6f7855ea82c1 and project 7599dfd7db2647bf8f986bffd781b87d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:52.014214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:52.025271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91fac8ea-43d4-491f-994b-195491343886 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.218104 Aug 27 21:00:52.026186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1471/3014] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:51 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:52.031380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b96597e3-4def-4b11-bd04-33f117f806db tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Action: 'create', calling method: .version_select at 0x7ff84f373310>, body: {"security_group_rule": {"parent_group_id": "a0e00c72-878d-42c0-a411-25f45c89149d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:52.034494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:52.036755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee',volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:52.312443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a82b3d4c-63ca-4123-a9df-7979761c3d2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.396058 Aug 27 21:00:52.314472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1544/3015] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:50 2022] POST /compute/v2.1/servers => generated 407 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:00:52.325560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea790624-d9a0-473c-b5f4-469420bd11f3", "name": "network-vif-plugged", "status": "completed", "tag": "992bbe4f-6a51-4102-9f6e-fd98c0858bb3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:52.339152 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b96597e3-4def-4b11-bd04-33f117f806db tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.311849 Aug 27 21:00:52.340129 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1472/3016] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:00:52 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:52.345871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:52.346489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:52.351403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:52.352646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:52.353173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:52.354606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:52.355285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:52.355934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:52.356964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:52.364757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:52.365314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:52.376184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] Creating event network-vif-plugged:992bbe4f-6a51-4102-9f6e-fd98c0858bb3 for instance ea790624-d9a0-473c-b5f4-469420bd11f3 on nch2-master-1 Aug 27 21:00:52.381941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2a88599b-7875-4770-9b51-74191e8eebd2 req-66169228-ca54-435f-a494-4f72e4f0d301 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064806 Aug 27 21:00:52.383043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1545/3017] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:52.389901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3ec8aff-6058-45c5-a1bd-d0a0b48ccfad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:52.390916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3ec8aff-6058-45c5-a1bd-d0a0b48ccfad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:52.518236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3ec8aff-6058-45c5-a1bd-d0a0b48ccfad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:52.533759 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3ec8aff-6058-45c5-a1bd-d0a0b48ccfad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1120 microversion: 2.1 time: 0.148900 Aug 27 21:00:52.546685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1546/3018] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:52 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1120 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:52.546685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6080081a-7d89-48e4-9d50-3901d5522702 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff857d9e790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:52.590802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:52.617807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-043404c4-5390-447d-941a-82c6f6f532ef tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1518 microversion: 2.1 time: 0.276255 Aug 27 21:00:52.620193 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1473/3019] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:52 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:52.636607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:52.637238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:52.667231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:52.668303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:52.670309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:52.672770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:52.674120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:52.674732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:52.682843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6080081a-7d89-48e4-9d50-3901d5522702 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/a0e00c72-878d-42c0-a411-25f45c89149d" status: 200 len: 663 microversion: 2.1 time: 0.145983 Aug 27 21:00:52.684147 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1547/3020] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:00:52 2022] GET /compute/v2.1/os-security-groups/a0e00c72-878d-42c0-a411-25f45c89149d => generated 663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:52.710985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fcc3d4a-9ff2-4f66-95cb-0afdc1dafcb9 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff857d3e670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:53.030050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:53.054649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f41e70a4-9a1d-48f0-a80d-bfad77c98e76 tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1512 microversion: 2.1 time: 0.422243 Aug 27 21:00:53.055389 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1474/3021] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:52 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:53.073700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1960077961", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7ccce93e-c8b6-4d76-8a9c-e4c2cafd04e3"}], "security_groups": [{"name": "tempest-securitygroup--535366892"}], "key_name": "tempest-keypair-1599208938", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:53.196054 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fcc3d4a-9ff2-4f66-95cb-0afdc1dafcb9 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/eb8fa168-d58c-4411-b366-3ca15fbd0621" status: 202 len: 0 microversion: 2.1 time: 0.502664 Aug 27 21:00:53.197217 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1548/3022] 10.222.0.40 () {58 vars in 1287 bytes} [Sat Aug 27 21:00:52 2022] DELETE /compute/v2.1/os-security-group-rules/eb8fa168-d58c-4411-b366-3ca15fbd0621 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:53.209032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:53.210932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:53.237935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:53.243631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:53.256309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:53.257237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:53.261501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:53.268687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:53.292333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] validate_networks() for [('7ccce93e-c8b6-4d76-8a9c-e4c2cafd04e3', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:00:53.700884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:53.713052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e7415f4-d1b1-4c1e-a1e2-7c67d46ed236 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1318 microversion: 2.1 time: 0.514246 Aug 27 21:00:53.713902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1549/3023] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:53 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:53.720872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:53.721976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:53.731739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:53.732883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:53.733831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:53.746569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:53.749689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:53.751857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.297631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:54.301357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:54.327039 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-11b41c04-b164-43eb-95f4-c7ab05b4f3bf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.611725 Aug 27 21:00:54.328761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1550/3024] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:53 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:54.343837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8eeaaead-a8f0-4c8d-8787-b6e75aa46c2e tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff857d3e160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:54.527239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for project c3482773a4054d0486ec671b7899e681. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:54.541161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for user e1059213ffb04e778d7f9e2fd1ff2474 and project c3482773a4054d0486ec671b7899e681. Resources: dict_keys(['metadata_items']) {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:54.579196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:00:54.580086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:00:54.580575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:00:54.580982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:00:54.581397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:00:54.605343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.606955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.608170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.610802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.611592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.615986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.685068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for project c3482773a4054d0486ec671b7899e681. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:00:54.697154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Getting quotas for user e1059213ffb04e778d7f9e2fd1ff2474 and project c3482773a4054d0486ec671b7899e681. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:00:54.711788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:00:54.714616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:00:54.777027 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-95d159fe-1862-4caf-88bf-0f1fe764e07b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.719233 Aug 27 21:00:54.783824 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1475/3025] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:00:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:00:54.788817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:54.789454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:54.797440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.797913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.798347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.801245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8eeaaead-a8f0-4c8d-8787-b6e75aa46c2e tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a0e00c72-878d-42c0-a411-25f45c89149d" status: 202 len: 0 microversion: 2.1 time: 0.470593 Aug 27 21:00:54.802516 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1551/3026] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:54 2022] DELETE /compute/v2.1/os-security-groups/a0e00c72-878d-42c0-a411-25f45c89149d => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:54.808726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:54.809612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:54.811403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.813379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.815755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.821510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.832819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.833497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.835550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.851218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.851920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.931948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:54.932815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:54.933486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:54.934377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lazy-loading 'fault' on Instance uuid c85d9bb0-7b3e-4069-a18d-10a072260bd5 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:00:55.030895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.048115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.056642 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9d933a3-fbc3-4aef-a16f-e9dd34d39fb2 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1236 microversion: 2.1 time: 0.271592 Aug 27 21:00:55.059967 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-812f1828-dd6b-4d55-b3a7-e963a873922d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1311 microversion: 2.1 time: 0.255962 Aug 27 21:00:55.073931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1476/3027] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:54 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1236 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.075597 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1552/3028] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:54 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.083297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85d9bb0-7b3e-4069-a18d-10a072260bd5", "name": "network-vif-deleted", "tag": "120749e1-e698-49dc-ae24-06be800b81e2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:55.085197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.085940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:55.099971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.100570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.102813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.103692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.105343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.106190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.109337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.110412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.113314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.199015 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] Creating event network-vif-deleted:120749e1-e698-49dc-ae24-06be800b81e2 for instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 on nch2-master-1 Aug 27 21:00:55.217845 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-41b3f595-8349-427c-9d89-cba8f1fafa36 req-5edae621-823a-499c-850b-8b085ffc3310 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140626 Aug 27 21:00:55.227807 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1553/3029] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:55.243137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.256376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:55.266931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.267817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.268721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.270616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.271292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.271949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.343547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.355275 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b75a5630-faee-4c0c-bedb-013902ef028f tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1470 microversion: 2.1 time: 0.280120 Aug 27 21:00:55.359520 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1477/3030] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:55 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.364505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ad1fb9d-a9fa-47e2-9216-22d78e831303 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.365336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ad1fb9d-a9fa-47e2-9216-22d78e831303 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:55.462467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ad1fb9d-a9fa-47e2-9216-22d78e831303 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.470974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ad1fb9d-a9fa-47e2-9216-22d78e831303 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1270 microversion: 2.1 time: 0.110113 Aug 27 21:00:55.477364 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1478/3031] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:55 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.495793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f6ade50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.538049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:00:55.539671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Neutron security group f41825d8-6daf-4a06-9855-ce855a1b4bfc not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:00:55.540400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] HTTP exception thrown: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.540400 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Request method failure captured: Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/f41825d8-6daf-4a06-9855-ce855a1b4bfc HTTP/1.1 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoX0a1UKljr_2sHni2uqyz3oiWS-R6rTKnGYadQVZupPQKRl7fTT-Kvu32DsSqnCPudTAVBBk_Nbpc8peMzocT-hWLUPj6Hb2CdAz9dbZs09e45cLaLan3lHpQPl6DdEVsnH-vwdb47Yk1ojY5UYV3cNFsNZD27FLxn4aFaJGQLXoIo Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4d663060a20e4254a26f234e52487941 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2008758024 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d663060a20e4254a26f234e52487941"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4d663060a20e4254a26f234e52487941"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4d663060a20e4254a26f234e52487941", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4d663060a20e4254a26f234e52487941"}]}] Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2008758024 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4d663060a20e4254a26f234e52487941 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2008758024 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupRulesTestJSON-2008758024-project Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 934ba02a4e284335b8fbdc1c7cd154da Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2008758024-project Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f41825d8-6daf-4a06-9855-ce855a1b4bfc'} Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:00:55.542623 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] Aug 27 21:00:55.546499 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:55.551316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Returning 404 to user: Security group f41825d8-6daf-4a06-9855-ce855a1b4bfc does not exist Aug 27 21:00:55.551316 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-38e903be-b443-49f2-bbd8-9270f14f88b2'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:55.555932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f936c88-78a5-4eab-907d-7461e64c9a9d tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f41825d8-6daf-4a06-9855-ce855a1b4bfc" status: 404 len: 194 microversion: 2.1 time: 0.064202 Aug 27 21:00:55.556099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.557149 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1479/3032] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:55 2022] DELETE /compute/v2.1/os-security-groups/f41825d8-6daf-4a06-9855-ce855a1b4bfc => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:00:55.569678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.571104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:55.584646 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92380f8f-0b4e-4841-bc75-4e1f9b74a234 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 200 len: 1506 microversion: 2.1 time: 0.355395 Aug 27 21:00:55.587424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1554/3033] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:55 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.594491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-694ac43e-3198-4cd9-b8a3-0b8b206e4971 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f04eee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.601437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.602003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.602522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.604266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.605111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.605879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.888664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:55.899006 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0762b871-57b5-4da1-b2d2-f9e6dbdccc4a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.340294 Aug 27 21:00:55.911419 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1480/3034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:55 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:55.927942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:55.931003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:55.947111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.948946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.950174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:55.953146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:55.953845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:55.954460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.265700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:56.281077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf37cbb8-4698-435e-b7c9-535c87e1f310 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1507 microversion: 2.1 time: 0.367537 Aug 27 21:00:56.295594 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1481/3035] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:55 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:56.318670 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-694ac43e-3198-4cd9-b8a3-0b8b206e4971 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/a88de667-01d5-413a-86e1-b3ef67cf8f72" status: 202 len: 0 microversion: 2.1 time: 0.729894 Aug 27 21:00:56.319815 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1555/3036] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:55 2022] DELETE /compute/v2.1/os-security-groups/a88de667-01d5-413a-86e1-b3ef67cf8f72 => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:56.324760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.325659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:56.329612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.330485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:56.338149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.340628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.342391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.344708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.345396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.345673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.346319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.346906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.347526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.350207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.350833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.351448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.419212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.420127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.420726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.421513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lazy-loading 'fault' on Instance uuid c85d9bb0-7b3e-4069-a18d-10a072260bd5 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:00:56.424846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:56.521992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:56.535142 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d37c319e-dda6-4531-8114-0c54e101c777 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 200 len: 1311 microversion: 2.1 time: 0.236299 Aug 27 21:00:56.535929 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1482/3037] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:56 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:56.542042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc244e6-b697-415e-b85f-754f4fffbe62", "name": "network-vif-plugged", "status": "completed", "tag": "8489d4b7-225e-41d9-9439-994670fe1bbd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:56.578900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.579421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.579858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.603293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] Creating event network-vif-plugged:8489d4b7-225e-41d9-9439-994670fe1bbd for instance 6cc244e6-b697-415e-b85f-754f4fffbe62 on nch1-master-1 Aug 27 21:00:56.608889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:56.610280 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-53241d62-c808-447e-96d9-96d8c70dfcd0 req-38765c1d-2c9b-4d5f-9a97-8ca1668fe33d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073066 Aug 27 21:00:56.615464 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1483/3038] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:56.621847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.622034 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-133bceaf-ed83-46af-87af-a1aa1f4b9c68 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1304 microversion: 2.1 time: 0.300806 Aug 27 21:00:56.622615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1556/3039] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:56 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:56.623453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:56.629346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8fb81cb1-284e-4495-9d9d-6af2c9d058a3 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff857d9e310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.631145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.631825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.632392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.633583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.634283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.635059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.670916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:56.835831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:00:56.866308 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72e6ce6f-216c-4df7-a035-a28c4307b7d3 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 204 len: 0 microversion: 2.1 time: 0.247946 Aug 27 21:00:56.871778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1484/3040] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:56 2022] DELETE /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:56.891659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.893478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:56.911710 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8fb81cb1-284e-4495-9d9d-6af2c9d058a3 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/78cf883d-95ee-48fb-8ba6-7b1674df62c6" status: 202 len: 0 microversion: 2.1 time: 0.287547 Aug 27 21:00:56.912995 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1557/3041] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:56 2022] DELETE /compute/v2.1/os-security-groups/78cf883d-95ee-48fb-8ba6-7b1674df62c6 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:56.919686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:56.920549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:56.924937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.925821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.926439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.928119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.928939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.929862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.937471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.938064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.938740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:56.942301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:56.942436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:56.943526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.013165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.013775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.014262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.014725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lazy-loading 'fault' on Instance uuid 29dd1efe-a930-4499-bd77-e104553f5d9d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:00:57.138359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:57.147390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff3b58f4-c384-4835-94ca-678c31e1f2e6 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1322 microversion: 2.1 time: 0.232886 Aug 27 21:00:57.156351 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1558/3042] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:56 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:57.163121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.164835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:57.180524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.183694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.184283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.185351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.186661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.189436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.211010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d73724d77a41df999698d5127ea9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9c439104b8c44e8be264d5a3c4a039d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:57.226118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58449cfa-a76a-4ff1-8d72-fdb7b169cd8d tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 200 len: 1307 microversion: 2.1 time: 0.350413 Aug 27 21:00:57.227165 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1485/3043] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:56 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:57.242786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-694211cf-65a1-45d4-a319-83c3398af79e tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f20df70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.248184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:57.375881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41ad5bda-6bc8-4d22-8306-ac0f837ea445 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 204 len: 0 microversion: 2.1 time: 0.218069 Aug 27 21:00:57.376889 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1559/3044] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:57 2022] DELETE /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:57.383236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.383717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:57.389981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.390475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.390915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.391650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.392107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.392535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.601133 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-694211cf-65a1-45d4-a319-83c3398af79e tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/8ec7094f-7c46-49f3-a709-4d9844e5fab3" status: 202 len: 0 microversion: 2.1 time: 0.373091 Aug 27 21:00:57.601731 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1486/3045] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:57 2022] DELETE /compute/v2.1/os-security-groups/8ec7094f-7c46-49f3-a709-4d9844e5fab3 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:57.606727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dd1efe-a930-4499-bd77-e104553f5d9d", "name": "network-vif-deleted", "tag": "88cb7e67-6da5-418d-81aa-db30301440d6"}, {"name": "network-changed", "server_uuid": "c6f446c2-c681-4387-8925-b15bc3d26f83", "tag": "fa539831-830c-41fe-861b-bbacb36c3949"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:00:57.610362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:57.626224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.626717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.628006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.631091 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a5d2585c-3908-4433-95fb-b6e56fa2018a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.252671 Aug 27 21:00:57.631848 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1560/3046] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:57 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:57.638219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.639059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:57.646987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.647612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.648143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.648712 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Creating event network-vif-deleted:88cb7e67-6da5-418d-81aa-db30301440d6 for instance 29dd1efe-a930-4499-bd77-e104553f5d9d on nch2-master-1 Aug 27 21:00:57.649056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.649212 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] Creating event network-changed:fa539831-830c-41fe-861b-bbacb36c3949 for instance c6f446c2-c681-4387-8925-b15bc3d26f83 on nch1-master-1 Aug 27 21:00:57.649754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.650323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.658329 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b837453c-3725-4fa3-8473-853f452aad14 req-fdf58003-22b1-4a1f-a9cf-6f69ad98451b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055386 Aug 27 21:00:57.658909 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1487/3047] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:00:57.667913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.668615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: c85d9bb0-7b3e-4069-a18d-10a072260bd5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:57.675611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.676101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.676547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.677314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.677697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.678121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.692379 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] HTTP exception thrown: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Request method failure captured: Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 HTTP/1.1 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoWzwJke7Y9jvZ_Aub_IGK62iPQbf5kaW62nMPCgId5apVvu_aq1WPo5ZMu_SEy77wPWCRuRGaasss9xolApzkAzBh042RNu5EvW7nqK_5luYnSjqDUWAClyChzc-sypDOrM7Hbtk7asKdaHn_fVTmrzWHgIk_YCjTN3NkQT0PyfX-U Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b22f74c2c47b434b8783c8579636f04e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}] Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 00f7b7e727ee43158239b911a436d656 Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'c85d9bb0-7b3e-4069-a18d-10a072260bd5'} Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:57.694072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Returning 404 to user: Instance c85d9bb0-7b3e-4069-a18d-10a072260bd5 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba95b972-ca5f-4445-b687-55b278a486a9 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 27 21:00:57.698546 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1488/3048] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:57 2022] GET /compute/v2.1/servers/c85d9bb0-7b3e-4069-a18d-10a072260bd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:00:57.701048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3bc0774f-7241-4cc5-9a75-ad8bd673d406 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff84f54d790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.834900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:57.843893 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd4a5aa1-c020-4d28-a3f3-86d962713b37 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1513 microversion: 2.1 time: 0.210608 Aug 27 21:00:57.844762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1561/3049] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:57 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:57.862465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:57.863071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:57.869554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.870080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.870640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:57.871353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:57.871790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:57.872408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.047669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:58.051312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3bc0774f-7241-4cc5-9a75-ad8bd673d406 tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fe735e5f-ce50-4b9a-aba5-cce89fad3e43" status: 202 len: 0 microversion: 2.1 time: 0.353778 Aug 27 21:00:58.055219 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1489/3050] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:57 2022] DELETE /compute/v2.1/os-security-groups/fe735e5f-ce50-4b9a-aba5-cce89fad3e43 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:58.056271 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db55bf70-2d0a-4986-b2de-64d4c94da14e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.197566 Aug 27 21:00:58.056856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1562/3051] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:57 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:58.060187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.060741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.061758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ec8727a-8492-4a2e-a81b-714df2c21fcc tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] Calling method '.version_select at 0x7ff857dcb700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.075879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.076816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.078344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.079510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.080126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.080885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.134281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:00:58.219935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b75889a2-6be1-4df9-8ce9-a65dab996b85 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 204 len: 0 microversion: 2.1 time: 0.163165 Aug 27 21:00:58.224310 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1490/3052] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:00:58 2022] DELETE /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:00:58.226092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.226802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.233035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.233529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.233966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.234663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.235459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.235593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.277327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ec8727a-8492-4a2e-a81b-714df2c21fcc tempest-SecurityGroupRulesTestJSON-2008758024 tempest-SecurityGroupRulesTestJSON-2008758024-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/016ae956-b724-4988-a4f7-454c924ff1aa" status: 202 len: 0 microversion: 2.1 time: 0.219229 Aug 27 21:00:58.277927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1563/3053] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:00:58 2022] DELETE /compute/v2.1/os-security-groups/016ae956-b724-4988-a4f7-454c924ff1aa => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:00:58.282602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.283222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.289956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.290570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.291018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.291947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.292413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.292842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.316657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:58.328656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a041b1b3-6f7e-42ad-bb51-5ad50535108b tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1328 microversion: 2.1 time: 0.106722 Aug 27 21:00:58.341876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1491/3054] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:58 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:58.351739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.351994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] [instance: 29dd1efe-a930-4499-bd77-e104553f5d9d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.361444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.361946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.362392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.363138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.363606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.364054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.379599 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] HTTP exception thrown: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Request method failure captured: Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d HTTP/1.1 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXfTAGe7-WHX9kDxAmW8JXmySooYV1dzwRgXOXauQNoc7zlzsTOTLaWT9fXdEVEx5wgptFx0PARZHVwFIsZ_Z60VijFotDxGPza_uX56RNVP71cAA4zb8FMcozQKccvTpkmu0N-ZpYJPCkh-W0P3qVjcdigNe3yUUW0WPxku1tjFvY Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e9c439104b8c44e8be264d5a3c4a039d Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerAddressesTestJSON-842874207 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9c439104b8c44e8be264d5a3c4a039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e9c439104b8c44e8be264d5a3c4a039d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e9c439104b8c44e8be264d5a3c4a039d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e9c439104b8c44e8be264d5a3c4a039d"}]}] Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerAddressesTestJSON-842874207 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e9c439104b8c44e8be264d5a3c4a039d Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerAddressesTestJSON-842874207 Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerAddressesTestJSON-842874207-project Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 05d73724d77a41df999698d5127ea9ad Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerAddressesTestJSON-842874207-project Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '29dd1efe-a930-4499-bd77-e104553f5d9d'} Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:00:58.381314 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] Returning 404 to user: Instance 29dd1efe-a930-4499-bd77-e104553f5d9d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:00:58.386429 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b16e7264-2ea9-4d97-8013-d2d3d74b330e tempest-ServerAddressesTestJSON-842874207 tempest-ServerAddressesTestJSON-842874207-project] 10.222.0.40 "GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d" status: 404 len: 111 microversion: 2.1 time: 0.039666 Aug 27 21:00:58.388073 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1492/3055] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:58 2022] GET /compute/v2.1/servers/29dd1efe-a930-4499-bd77-e104553f5d9d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:00:58.540652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:58.548690 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73f840d0-228f-4e4a-907c-0f6895f31b5e tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1519 microversion: 2.1 time: 0.269786 Aug 27 21:00:58.549297 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1564/3056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:58 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:58.652558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.653343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.661605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.662291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.662836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.663682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.664377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.664825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.809605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:58.818943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-231ef722-0cb9-4cc8-8699-d0c55e1cda1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1308 microversion: 2.1 time: 0.170282 Aug 27 21:00:58.819661 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1493/3057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:58 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:00:58.865275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:58.865985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:58.872299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.872818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.873372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:58.874034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:58.874492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:58.874952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.010110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:59.018823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-380a62a7-47e9-4ff4-b927-3cbb8fd0d9bc tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1513 microversion: 2.1 time: 0.157583 Aug 27 21:00:59.019490 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1565/3058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:58 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:59.078681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:59.079672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:59.086020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.086550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.086972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.087690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.088145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.088573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.230347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:59.239333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6eec5edd-5da6-437a-a3e1-6442143860bb tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.165353 Aug 27 21:00:59.239984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1494/3059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:59 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:59.351682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:59.352301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:59.359221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.359758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.360204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.360914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.361371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.361790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.430911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:59.439907 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0704527-fe82-4bed-b8c6-4698d41936e3 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1328 microversion: 2.1 time: 0.092097 Aug 27 21:00:59.440622 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1566/3060] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:59 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:59.570144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:59.570768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:59.577698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.578204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.578653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.579384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.579860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.580297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.753016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:59.764133 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9dcebcb-7d80-4dd4-8516-da834bf0731f tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1519 microversion: 2.1 time: 0.197942 Aug 27 21:00:59.781026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1495/3061] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:59 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:00:59.839556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:00:59.840270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:00:59.847790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.848289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.848737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.849434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:00:59.849894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:00:59.850315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:00:59.987813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:00:59.995896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f82fbde5-cca7-4a9a-9be9-21cfa66e967c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1490 microversion: 2.1 time: 0.160126 Aug 27 21:00:59.996714 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1567/3062] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:00:59 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1490 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.016961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.017661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.024138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.024741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.025253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.025961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.026460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.026892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.040253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.041188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.047762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.048403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.048839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.049593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.050042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.050460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.244952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.252730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.260998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ed70aef-a503-4680-b6b6-f4e47bc17cd1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1489 microversion: 2.1 time: 0.248204 Aug 27 21:01:00.262089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1496/3063] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1489 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.267676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.268222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.273078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-878a3277-60f0-4c97-a3a8-21c2752f732e tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1513 microversion: 2.1 time: 0.237047 Aug 27 21:01:00.274226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.274689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.275122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.275979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.276579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.277005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.291177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1568/3064] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:00.296685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.297285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.316961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.317359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.318397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.318524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.318985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.319432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.512586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.520732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.521359 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47e30a59-8540-49d0-840b-b7a9430be700 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.258062 Aug 27 21:01:00.526360 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1497/3065] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.534155 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-858fe0e2-0833-40f3-b9ad-ee46ed1aa0ae tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1490 microversion: 2.1 time: 0.241193 Aug 27 21:01:00.535072 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1569/3066] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1490 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.538126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.540464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.552199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.552730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.553180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.554098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.555100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.555904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.562508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.563022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.572356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.572850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.573287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.573993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.574441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.574859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.598442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:00.614031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:01:00.706039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:00.726215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7bd0bdb-aef3-4282-a858-ea4dc247486b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 204 len: 0 microversion: 2.1 time: 0.174724 Aug 27 21:01:00.727354 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1570/3067] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:00 2022] DELETE /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:01:00.734063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.743881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.744226 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e6f785d-9a01-4ed3-bcf4-2ba6e4205118 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.216471 Aug 27 21:01:00.744787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.748819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1498/3068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.752974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.753627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.754233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.755247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.755882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.756316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.788754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:00.789466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:00.798980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.799920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.800438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.801425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:00.801987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:00.802544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:00.942463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.952467 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9db9597e-a837-429b-8b3d-8a82fe83d2ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1496 microversion: 2.1 time: 0.213131 Aug 27 21:01:00.964223 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1571/3069] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1496 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:00.988673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:00.997168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75a8e6c6-4920-4cb8-a09f-e5989217ce84 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1519 microversion: 2.1 time: 0.212436 Aug 27 21:01:00.998134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1499/3070] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:00 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:01.299907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:01.300545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:01.307069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.307598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.310078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.310078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.310078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.310078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.427099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:01.442177 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c6cca7a-81b4-4d6c-80bd-94f2411016b0 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1471 microversion: 2.1 time: 0.146144 Aug 27 21:01:01.443441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1572/3071] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:01 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:01.543664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:01.545073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:01.551009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea790624-d9a0-473c-b5f4-469420bd11f3", "name": "network-vif-deleted", "tag": "992bbe4f-6a51-4102-9f6e-fd98c0858bb3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:01.553267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.554601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.569235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.569362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.569945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.570686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.571738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.572725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.573033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.590342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:01.593720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] Creating event network-vif-deleted:992bbe4f-6a51-4102-9f6e-fd98c0858bb3 for instance ea790624-d9a0-473c-b5f4-469420bd11f3 on nch2-master-1 Aug 27 21:01:01.600315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9f2775b8-af04-481b-98d4-65e4887de68e req-0f721a78-aa36-4588-a351-99be682a3b31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052810 Aug 27 21:01:01.602044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1573/3072] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:01.759963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:01.767609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:01.768642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:01.773652 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34cff0e3-6398-48b0-859a-fc73a799fb37 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.235051 Aug 27 21:01:01.774489 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1500/3073] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:01 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:01.786341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.787094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.788359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.789287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.789907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.790670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.911428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=13 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:01.976715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:01.977406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:01.989541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.990534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:01.991177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:01.996984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:01.998384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.001245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.079600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:02.092815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b2abbce-777d-4efd-8247-071be5c765bd tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.326660 Aug 27 21:01:02.097754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1574/3074] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:01 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:02.106697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:02.107424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:02.129437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.130634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.140216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.141234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.141969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.142558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.265561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:02.273996 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5280ba8b-4b1a-4664-bf31-3f5acb689188 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1496 microversion: 2.1 time: 0.301757 Aug 27 21:01:02.287758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1501/3075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:01 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1496 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:02.314832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:02.323653 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c9623ec-8e5e-484e-8ec6-ca2be3c82355 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1519 microversion: 2.1 time: 0.224396 Aug 27 21:01:02.324341 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1575/3076] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:02 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:02.464071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:02.464949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:02.472447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.473208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.473832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.474717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.475446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.476031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.513888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.514440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.514908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.515574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lazy-loading 'fault' on Instance uuid ea790624-d9a0-473c-b5f4-469420bd11f3 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:02.565697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '011f2af1a813465bb4541f2d0af04e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd74eff4731ba40669a6e1fea39edb442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:02.573624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c2712a0-78bf-47f5-ad33-437d90d517f5 tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 200 len: 1308 microversion: 2.1 time: 0.113484 Aug 27 21:01:02.574217 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1502/3077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:02 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:02.795922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:02.796516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:02.810571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=23 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:02.820848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.823193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.824227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:02.825120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:02.825724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:02.826722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.052871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:03.061998 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39f2754a-2cb2-4f44-8eb6-034323246d64 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.271331 Aug 27 21:01:03.076071 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1576/3078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:02 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:03.131235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:03.132116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:03.142227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.142739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.143183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.145252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.145729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.146163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.194290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d458d6ef-270a-43b7-a7c9-b2bf3494d426", "name": "network-vif-deleted", "tag": "576e346c-95ad-48a7-b385-e05c644d10cf"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:03.210581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.212371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.213060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.231238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] Creating event network-vif-deleted:576e346c-95ad-48a7-b385-e05c644d10cf for instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 on nch1-master-1 Aug 27 21:01:03.239005 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f4cd2261-661a-4a93-a0c2-039326c6124d req-d29de2cb-1127-4bfc-b38a-3d04b8297fe7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048270 Aug 27 21:01:03.240735 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1577/3079] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:03.296366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:03.297748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:03.311583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.312475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.313151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.314692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.316018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.316697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.322497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:03.330688 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25407eb2-b5dc-41a8-bb45-c60f3037d5c7 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.215498 Aug 27 21:01:03.331539 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1503/3080] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:03 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:03.348492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:03.349244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:03.356686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.357366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.357898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.358823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.359466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.360050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.437856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:03.446699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2411528-4e2b-4765-98b4-e2726000abfc tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1477 microversion: 2.1 time: 0.104452 Aug 27 21:01:03.447899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1504/3081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:03 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1477 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:03.498997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:03.507876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f87a141-3534-4c00-ab0d-ae29b8f5147f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1496 microversion: 2.1 time: 0.216085 Aug 27 21:01:03.508941 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1578/3082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:03 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1496 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:03.598089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:03.600171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: ea790624-d9a0-473c-b5f4-469420bd11f3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:03.609859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.611021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.611766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.612749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.613430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.614073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.650407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5202d226-3010-4e17-8306-2a4b22da23a6", "name": "network-vif-deleted", "tag": "b6f14d89-66c1-48f5-8057-c0aaa64b0f0f"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:03.667379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.669018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] HTTP exception thrown: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Request method failure captured: Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 HTTP/1.1 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXI8MMN7HhIhynM5gsrzDX_gHNPb3uP5afcJ0kKz1dZMVN0G95dUbOCO2s_6xcyMxCjx8rOEVSjrth9_1_ggYNtz0mLUhBkU23oqTf28p7S2MQoPSS5g7IW0cmMKaAckdzKyCphd0UWwtO687n9kcCXkubJfdRZembbt_3X7etu6Eg Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d74eff4731ba40669a6e1fea39edb442 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d74eff4731ba40669a6e1fea39edb442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d74eff4731ba40669a6e1fea39edb442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d74eff4731ba40669a6e1fea39edb442", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d74eff4731ba40669a6e1fea39edb442"}]}] Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d74eff4731ba40669a6e1fea39edb442 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MultipleCreateTestJSON-1072540686-project Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 011f2af1a813465bb4541f2d0af04e17 Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MultipleCreateTestJSON-1072540686-project Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ea790624-d9a0-473c-b5f4-469420bd11f3'} Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:03.670871 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.675540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Returning 404 to user: Instance ea790624-d9a0-473c-b5f4-469420bd11f3 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:03.676049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.676049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.676592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b58eadd-fced-4581-82c0-84a57d446b3a tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3" status: 404 len: 111 microversion: 2.1 time: 0.082889 Aug 27 21:01:03.677538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1505/3083] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:03 2022] GET /compute/v2.1/servers/ea790624-d9a0-473c-b5f4-469420bd11f3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:03.686449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:03.687364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] [instance: 5202d226-3010-4e17-8306-2a4b22da23a6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:03.694202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.694960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.695770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.696629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:03.697461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:03.697923 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] Creating event network-vif-deleted:b6f14d89-66c1-48f5-8057-c0aaa64b0f0f for instance 5202d226-3010-4e17-8306-2a4b22da23a6 on nch2-master-1 Aug 27 21:01:03.698234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:03.713415 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ab55f423-5dce-45c3-b3b2-366cc27e3006 req-389f6a41-7f15-41f4-bbc9-08422e2799ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066507 Aug 27 21:01:03.717675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1579/3084] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:03.718783 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] HTTP exception thrown: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Request method failure captured: Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 HTTP/1.1 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoXI8MMN7HhIhynM5gsrzDX_gHNPb3uP5afcJ0kKz1dZMVN0G95dUbOCO2s_6xcyMxCjx8rOEVSjrth9_1_ggYNtz0mLUhBkU23oqTf28p7S2MQoPSS5g7IW0cmMKaAckdzKyCphd0UWwtO687n9kcCXkubJfdRZembbt_3X7etu6Eg Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d74eff4731ba40669a6e1fea39edb442 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d74eff4731ba40669a6e1fea39edb442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d74eff4731ba40669a6e1fea39edb442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d74eff4731ba40669a6e1fea39edb442", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d74eff4731ba40669a6e1fea39edb442"}]}] Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d74eff4731ba40669a6e1fea39edb442 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1072540686 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-MultipleCreateTestJSON-1072540686-project Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 011f2af1a813465bb4541f2d0af04e17 Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-MultipleCreateTestJSON-1072540686-project Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5202d226-3010-4e17-8306-2a4b22da23a6'} Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:03.724180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] Returning 404 to user: Instance 5202d226-3010-4e17-8306-2a4b22da23a6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1028ad6d-c29d-4a2f-b018-4c8ed373a5ac tempest-MultipleCreateTestJSON-1072540686 tempest-MultipleCreateTestJSON-1072540686-project] 10.222.0.40 "GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6" status: 404 len: 111 microversion: 2.1 time: 0.044873 Aug 27 21:01:03.728631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1506/3085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:03 2022] GET /compute/v2.1/servers/5202d226-3010-4e17-8306-2a4b22da23a6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:04.084732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:04.085827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:04.096105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.096607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.097117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.097826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.109638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.114884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.353928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:04.355383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:04.367671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.369189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.371643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.373089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.374710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.376009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.601765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:04.610735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20647a53-2a10-4d14-bd88-911b234c77ad tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.531246 Aug 27 21:01:04.612317 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1580/3086] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:04 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:04.621018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:04.621892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:04.628803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.629746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.631012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.631928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.632574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.633156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.656511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:04.678330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.679170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.679857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.680480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lazy-loading 'fault' on Instance uuid d458d6ef-270a-43b7-a7c9-b2bf3494d426 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:04.761020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:04.772071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08e67974-b07a-4b87-9338-394f35f53cf4 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 200 len: 1311 microversion: 2.1 time: 0.156979 Aug 27 21:01:04.783757 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1581/3087] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:04 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:04.801557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:04.803265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:04.803606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:04.814868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.816080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.817147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:04.818272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:04.818390 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63f766f9-853e-4a1c-b88d-24d0e9440437 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.469485 Aug 27 21:01:04.818987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:04.819273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1507/3088] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:04 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:04.820381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.164404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:05.187406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a7e13a97-a8d1-4db3-8693-0b8710c63ebc tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1496 microversion: 2.1 time: 0.398859 Aug 27 21:01:05.193356 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1582/3089] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:04 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1496 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:05.640444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:05.641823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:05.644987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=20 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:05.651040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.651734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.652456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.653300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.654026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.654719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.758549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67", "tag": "9560a5c9-6d21-45fc-9488-7c445cf165c9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:05.794941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.796016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.796618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.824772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] Creating event network-changed:9560a5c9-6d21-45fc-9488-7c445cf165c9 for instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 on nch1-master-1 Aug 27 21:01:05.840302 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ff6fb733-cffe-4579-9b68-ac3ca5041598 req-88292c2d-376b-4417-bc5c-b065b2fdc2c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086796 Aug 27 21:01:05.844186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1583/3090] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:05.852318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc244e6-b697-415e-b85f-754f4fffbe62", "name": "network-vif-deleted", "tag": "8489d4b7-225e-41d9-9439-994670fe1bbd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:05.885083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.885566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.885993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.911064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] Creating event network-vif-deleted:8489d4b7-225e-41d9-9439-994670fe1bbd for instance 6cc244e6-b697-415e-b85f-754f4fffbe62 on nch1-master-1 Aug 27 21:01:05.925311 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d61d7a04-49fe-4145-8ce4-2ebb51272c38 req-b218b6a4-69ee-4d32-bbfc-ca0ca584b310 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078311 Aug 27 21:01:05.926256 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1584/3091] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:05.931610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:05.932318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: d458d6ef-270a-43b7-a7c9-b2bf3494d426] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:05.943393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.944303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.944989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.947243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:05.948325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:05.949106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:05.977219 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] HTTP exception thrown: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Request method failure captured: Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 HTTP/1.1 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoWzwJke7Y9jvZ_Aub_IGK62iPQbf5kaW62nMPCgId5apVvu_aq1WPo5ZMu_SEy77wPWCRuRGaasss9xolApzkAzBh042RNu5EvW7nqK_5luYnSjqDUWAClyChzc-sypDOrM7Hbtk7asKdaHn_fVTmrzWHgIk_YCjTN3NkQT0PyfX-U Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b22f74c2c47b434b8783c8579636f04e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}] Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 00f7b7e727ee43158239b911a436d656 Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd458d6ef-270a-43b7-a7c9-b2bf3494d426'} Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:05.982911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:05.986838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Returning 404 to user: Instance d458d6ef-270a-43b7-a7c9-b2bf3494d426 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:05.987956 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f34f263-adb1-4b58-8ccb-5de5e95f1b6c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426" status: 404 len: 111 microversion: 2.1 time: 0.059331 Aug 27 21:01:05.988570 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1585/3092] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:05 2022] GET /compute/v2.1/servers/d458d6ef-270a-43b7-a7c9-b2bf3494d426 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:05.997351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:05.998105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:06.015264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.016014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.016556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.017361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.017994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.018591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.044960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:06.057343 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b212c99d-c31b-4fd2-8664-52d9779d52c9 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.428717 Aug 27 21:01:06.061148 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1508/3093] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:05 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:06.083332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:06.083332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:06.104064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.105794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.106229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.108713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.110900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.114755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.158955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:01:06.296782 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f0229a16-4792-4937-8f90-25cd883d196d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 204 len: 0 microversion: 2.1 time: 0.232239 Aug 27 21:01:06.297416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1509/3094] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:06 2022] DELETE /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:01:06.303419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:06.304334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:06.308923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:06.318900 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2204c397-9057-467c-8013-72a036bfcb26 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.328568 Aug 27 21:01:06.322005 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1586/3095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:05 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:06.332286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:06.333214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:06.336393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.337107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.337691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.338548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.339148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.339757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.348093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.348609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.349060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.349792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.350292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.350736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.392820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:06.393232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:06.393678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:06.394749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 6cc244e6-b697-415e-b85f-754f4fffbe62 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:06.492472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:06.503253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d48640f-1c16-4933-b9bc-acf2bc4dadcf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1298 microversion: 2.1 time: 0.203895 Aug 27 21:01:06.526164 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1510/3096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:06 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:06.563038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:06.571600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77ad571f-25d2-4c85-804f-30e1ab52900d tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1517 microversion: 2.1 time: 0.246126 Aug 27 21:01:06.572849 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1587/3097] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:06 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:07.092779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:07.094085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:07.108829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.109820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.110716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.111938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.112694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.113775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.343635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:07.344553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:07.359223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.359908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.360447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.361754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.364533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.365125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.385046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:07.397446 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-647ddc6d-6f7b-4f5b-910c-21ee050f9122 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.318866 Aug 27 21:01:07.398706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1511/3098] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:07 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:07.554106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:07.555017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:07.563637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.564540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.565377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.566088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.566704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.567127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.608717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.609576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.610290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.610955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 6cc244e6-b697-415e-b85f-754f4fffbe62 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:07.710737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:07.732214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c6184f0-ade5-465e-8a46-1b458c66047a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1298 microversion: 2.1 time: 0.198673 Aug 27 21:01:07.733744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1512/3099] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:07 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:07.748166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:07.751200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:07.760457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:07.764717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:07.767429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.768045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.773544 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc33fa46-ddb6-4ecd-a97f-f4ebb80eb286 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.435150 Aug 27 21:01:07.774966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.776673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:07.777359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:07.777951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:07.788364 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1588/3100] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:07 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:08.010078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:08.019281 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2e6255a-e29e-4ca5-a030-ba124afabf46 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1517 microversion: 2.1 time: 0.283993 Aug 27 21:01:08.020406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1513/3101] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:07 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1517 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:08.424772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:08.426124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:08.436333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.437373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.438027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.438814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.439478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.440060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.688247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:08.703232 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04f9ee95-2d02-4413-87ac-6c7afb8504f5 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.283444 Aug 27 21:01:08.706355 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1589/3102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:08 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:08.756391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:08.757629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:08.771322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.771870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.772315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.773024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.773487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.773913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.796763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:08.797748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:08.827469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.829070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.831027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.833817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.835955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.836924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.890305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:08.892571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:08.894926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:08.895453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 6cc244e6-b697-415e-b85f-754f4fffbe62 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:08.999749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:09.014052 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19ea17c7-3622-46b4-bca6-f128343676a8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1298 microversion: 2.1 time: 0.259830 Aug 27 21:01:09.014965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1514/3103] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:08 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:09.049545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:09.054543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:09.080174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:09.083734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:09.084990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:09.089036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:09.089580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:09.092451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:09.104208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:09.236382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:09.258091 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66d4286b-f75d-41e0-b94b-e4c303b2547d tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.467624 Aug 27 21:01:09.263806 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1590/3104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:08 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:09.349338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:09.359969 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1fa94826-cb36-4bab-8d68-05404557a4b6 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1517 microversion: 2.1 time: 0.321752 Aug 27 21:01:09.361064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1515/3105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:09 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:09.478098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f446c2-c681-4387-8925-b15bc3d26f83", "name": "network-vif-plugged", "status": "completed", "tag": "fa539831-830c-41fe-861b-bbacb36c3949"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:09.505442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:09.507619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:09.508069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:09.539847 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] Creating event network-vif-plugged:fa539831-830c-41fe-861b-bbacb36c3949 for instance c6f446c2-c681-4387-8925-b15bc3d26f83 on nch1-master-1 Aug 27 21:01:09.549614 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ff3949b9-3ab9-4633-9610-88daf8a27c63 req-1c73a625-4f98-4671-9e16-afbdfb3ec588 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078791 Aug 27 21:01:09.551448 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1591/3106] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:09.734031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:09.734900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:09.744293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:09.745142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:09.746549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:09.748662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:09.754314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:09.756443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:09.942530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:09.956688 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c4f6844-dc99-47a7-b9e7-e7d1d9d5d764 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.232417 Aug 27 21:01:09.958008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1516/3107] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:09 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:10.036509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.037624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:10.067535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.069235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.069847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.070786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.071520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.072110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.170594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.173292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.175160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.176637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid 6cc244e6-b697-415e-b85f-754f4fffbe62 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:10.291015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.292076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:10.330402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.330927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.331442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.332169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.332877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.333306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.369551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:10.382448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f88081e-5f37-4a93-b351-cb8531be5fd6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 200 len: 1298 microversion: 2.1 time: 0.347927 Aug 27 21:01:10.384655 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1592/3108] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 1298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:10.395099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.396017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:10.410102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.413070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.413871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.416129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:10.418213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:10.418824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:10.754859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:10.766558 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-300dec45-df9e-43bf-8b39-25599c8003d0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.480712 Aug 27 21:01:10.769672 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1517/3109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:10.914667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:10.927332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21df4564-fe19-45b4-aa01-05b57b80b799 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1517 microversion: 2.1 time: 0.541386 Aug 27 21:01:10.929801 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1593/3110] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1517 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:10.956753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80f1c6c4-1cf4-40ca-83e1-9f102ad445ef tempest-ExtensionsTest-1317949647 tempest-ExtensionsTest-1317949647-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.958343 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80f1c6c4-1cf4-40ca-83e1-9f102ad445ef tempest-ExtensionsTest-1317949647 tempest-ExtensionsTest-1317949647-project] 10.222.0.40 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.184658 Aug 27 21:01:10.959174 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1518/3111] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:10.970626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c65c5b06-0d58-4ad1-a78a-c989af932865 tempest-ExtensionsTest-1317949647 tempest-ExtensionsTest-1317949647-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.974861 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c65c5b06-0d58-4ad1-a78a-c989af932865 tempest-ExtensionsTest-1317949647 tempest-ExtensionsTest-1317949647-project] 10.222.0.40 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010717 Aug 27 21:01:10.977920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:10.978931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:10.984205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1594/3112] 10.222.0.40 () {58 vars in 1134 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:01:10.990883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.004864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.005568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.006501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.007115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.007802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.309382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:11.320604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4aef1db4-4cdd-4cde-9ea7-ef2d303dfe48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1292 microversion: 2.1 time: 0.346377 Aug 27 21:01:11.324084 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1519/3113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:10 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1292 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:11.405283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:11.406197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:11.413356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.413909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.414286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.414994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.415467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.415894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.472897 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 HTTP/1.1 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '6cc244e6-b697-415e-b85f-754f4fffbe62'} Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:11.475380 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:11.480580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:11.481485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4efb67da-daa0-465f-99e1-4f194e783c95 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 404 len: 111 microversion: 2.1 time: 0.078966 Aug 27 21:01:11.483298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1595/3114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:11 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:11.492008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:11.492524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:11.504340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.504842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.505317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.506023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.506483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.506918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.559144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:01:11.767195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-57fa24ac-1cde-479e-805a-f205d4750d4e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 204 len: 0 microversion: 2.1 time: 0.278677 Aug 27 21:01:11.769167 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1520/3115] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:11 2022] DELETE /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:01:11.791581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:11.798550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:11.805447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:11.812405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:11.819884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.821471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.822004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.824739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.825235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.826144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.832493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:11.834388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.837397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.838754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:11.839814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:11.842597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:11.843314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.290627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:12.304357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:12.314265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c2dfa040-83a7-4456-ab21-ce83eabdea48 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.520772 Aug 27 21:01:12.318643 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b516d2cb-7350-481f-926b-93eb880df26c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1495 microversion: 2.1 time: 0.541931 Aug 27 21:01:12.319487 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1596/3116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:11 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1495 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:12.328386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1521/3117] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:11 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:12.330064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:12.330689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:12.333913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea28d73-15e3-4c7d-8474-380dd29e5a4b", "name": "network-vif-deleted", "tag": "76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:12.345175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.345580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.346193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.348210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.348795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.349244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.350100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.350641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.351074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.359491 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] Creating event network-vif-deleted:76a16e40-79e3-4eb2-a5f6-b7cb3eb0a278 for instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b on nch1-master-1 Aug 27 21:01:12.365392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fbff1555-cab6-4795-9654-036641a86fe5 req-15a7584b-10d5-4db4-8a6b-fe70b38ec57f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035455 Aug 27 21:01:12.366717 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1522/3118] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:12.372433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:12.373452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:12.381200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.381951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.382545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.383483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.385365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.385969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.527216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f7b7e727ee43158239b911a436d656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22f74c2c47b434b8783c8579636f04e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:12.540908 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bd79b10-5fdf-4082-b427-02a75ee77f92 tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 200 len: 1305 microversion: 2.1 time: 0.219873 Aug 27 21:01:12.542793 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1597/3119] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:12 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:12.550365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "313d6b93-94c9-4348-90d5-a3f2155ac7f0"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:12.553971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:12.561949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.563352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.563939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.565167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.565735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.566357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.657915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:12.713549 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a8c1c4e-05f8-4e44-84a9-bae1a226e59f tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1483 microversion: 2.1 time: 0.343418 Aug 27 21:01:12.727258 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1523/3120] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:12 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1483 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:12.756753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:12.757262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:12.773730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.789419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.790140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.791131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:12.793564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:12.795445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:12.928440 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e48aa9a0-050e-4181-b0bc-096f1fa85651 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175768 Aug 27 21:01:12.929062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1524/3121] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:01:12 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:13.200700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "POST /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656209 Aug 27 21:01:13.205052 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1598/3122] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:01:12 2022] POST /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:13.337096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:13.337644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:13.346836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:13.349342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:13.353564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.355491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.357344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.358447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.359703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.363607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.377941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.379063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.379731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.380617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.381225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.382773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.866942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:13.877812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08ff9ae7-fdfb-4cd3-884d-3e8c7d803d0e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1495 microversion: 2.1 time: 0.538814 Aug 27 21:01:13.880118 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1599/3123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:13 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1495 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:13.889650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:13.907944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-338830b1-33d2-4ec8-b9a3-dbe328ee31d1 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.574722 Aug 27 21:01:13.915194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:13.918405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] [instance: 1ea28d73-15e3-4c7d-8474-380dd29e5a4b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:13.926029 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1525/3124] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:13 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:13.935012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.937314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.938989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.942349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:13.943910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:13.945968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:13.977362 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] HTTP exception thrown: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Request method failure captured: Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b HTTP/1.1 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoWzwJke7Y9jvZ_Aub_IGK62iPQbf5kaW62nMPCgId5apVvu_aq1WPo5ZMu_SEy77wPWCRuRGaasss9xolApzkAzBh042RNu5EvW7nqK_5luYnSjqDUWAClyChzc-sypDOrM7Hbtk7asKdaHn_fVTmrzWHgIk_YCjTN3NkQT0PyfX-U Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b22f74c2c47b434b8783c8579636f04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b22f74c2c47b434b8783c8579636f04e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b22f74c2c47b434b8783c8579636f04e"}]}] Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b22f74c2c47b434b8783c8579636f04e Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1217340134 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 00f7b7e727ee43158239b911a436d656 Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListServerFiltersTestJSON-1217340134-project Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1ea28d73-15e3-4c7d-8474-380dd29e5a4b'} Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:13.979070 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. Aug 27 21:01:13.983292 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:13.985648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] Returning 404 to user: Instance 1ea28d73-15e3-4c7d-8474-380dd29e5a4b could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:13.985648 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e77479b-609a-4199-849c-7211cdd5079c tempest-ListServerFiltersTestJSON-1217340134 tempest-ListServerFiltersTestJSON-1217340134-project] 10.222.0.40 "GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b" status: 404 len: 111 microversion: 2.1 time: 0.087897 Aug 27 21:01:13.987542 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1600/3125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:13 2022] GET /compute/v2.1/servers/1ea28d73-15e3-4c7d-8474-380dd29e5a4b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:14.217793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67", "name": "network-vif-plugged", "status": "completed", "tag": "9560a5c9-6d21-45fc-9488-7c445cf165c9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:14.241080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:14.241565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:14.245401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:14.279001 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] Creating event network-vif-plugged:9560a5c9-6d21-45fc-9488-7c445cf165c9 for instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 on nch1-master-1 Aug 27 21:01:14.306523 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-41e3fe04-a9fb-4dba-ba68-4f00acd2b576 req-0ddd532e-f4fd-4f62-a202-fdab0d5e8cbf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091114 Aug 27 21:01:14.308517 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1526/3126] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:14.914453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:14.917037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:14.942644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:14.944146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:14.945762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:14.948261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:14.950301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:14.954386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:15.144117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76983f9a-6e8c-4ea7-b614-33032bea73a7 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] Calling method '.version_select at 0x7ff84f2bc040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.284564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76983f9a-6e8c-4ea7-b614-33032bea73a7 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74/defaults" status: 200 len: 371 microversion: 2.1 time: 0.436041 Aug 27 21:01:15.286925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1601/3127] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:14 2022] GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74/defaults => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:15.313338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.316936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:15.343494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:15.344282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:15.345579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:15.346665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:15.353743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:15.354454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:15.479879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:15.496022 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f5a43e0-bd54-4372-881f-ff329b35dd2c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 200 len: 1453 microversion: 2.1 time: 0.596626 Aug 27 21:01:15.496871 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1527/3128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:14 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 1453 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:15.501945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d145188-a594-45b4-8181-8b2f9dbe53f5", "name": "network-vif-deleted", "tag": "1ced34d1-18eb-4e71-99e0-83f13bd2fb66"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:15.518278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:15.518826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:15.519263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:15.553479 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] Creating event network-vif-deleted:1ced34d1-18eb-4e71-99e0-83f13bd2fb66 for instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 on nch2-master-1 Aug 27 21:01:15.560871 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c2bb0859-2ca3-4733-8bf7-17c8c9131fef req-5a15455e-b6ab-4960-8521-f2df7d068c98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062300 Aug 27 21:01:15.562281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1528/3129] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:15.585608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc320150-bed5-49bb-8d49-39c9ad8717ad tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] Calling method '.version_select at 0x7ff857cb1790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.681179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc320150-bed5-49bb-8d49-39c9ad8717ad tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74" status: 200 len: 371 microversion: 2.1 time: 0.117396 Aug 27 21:01:15.684745 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1529/3130] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 21:01:15 2022] GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:15.697790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1185e02a-f97c-4de7-a5a7-7a70a7754064 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] Calling method '.version_select at 0x7ff84f6ade50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.789570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1185e02a-f97c-4de7-a5a7-7a70a7754064 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74/defaults" status: 200 len: 371 microversion: 2.1 time: 0.096133 Aug 27 21:01:15.799160 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1530/3131] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:15 2022] GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74/defaults => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:15.803469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:15.805045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4d407a3-7f30-4dc3-ab12-17538929b419 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] Calling method '.version_select at 0x7ff857cdf670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.815144 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47dc78d0-3617-480c-830d-c7c450ef6592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1395 microversion: 2.1 time: 0.525846 Aug 27 21:01:15.821562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1602/3132] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:15 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1395 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:15.880554 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4d407a3-7f30-4dc3-ab12-17538929b419 tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74" status: 200 len: 371 microversion: 2.1 time: 0.079075 Aug 27 21:01:15.881785 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1531/3133] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 21:01:15 2022] GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:15.893361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2f54b15-6f92-450b-8346-4d5c5a86891d tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] Calling method '.version_select at 0x7ff84f92a790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:15.986413 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2f54b15-6f92-450b-8346-4d5c5a86891d tempest-QuotasTestJSON-740968418 tempest-QuotasTestJSON-740968418-project] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74?user_id=c1f2b3574d9c4c40bc2d179dc6fa8b2b" status: 200 len: 371 microversion: 2.1 time: 0.096880 Aug 27 21:01:15.987977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1603/3134] 10.222.0.40 () {58 vars in 1323 bytes} [Sat Aug 27 21:01:15 2022] GET /compute/v2.1/os-quota-sets/d319217c0f1f4351a6003b3c9d16bd74?user_id=c1f2b3574d9c4c40bc2d179dc6fa8b2b => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:16.343014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:16.343883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:16.362513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f446c2-c681-4387-8925-b15bc3d26f83", "tag": "fa539831-830c-41fe-861b-bbacb36c3949"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:16.373312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.373909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.374380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.375105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.379672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.380354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.383825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.384329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.385010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.421894 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] Creating event network-changed:fa539831-830c-41fe-861b-bbacb36c3949 for instance c6f446c2-c681-4387-8925-b15bc3d26f83 on nch1-master-1 Aug 27 21:01:16.437186 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-eadebac8-bb71-44fc-8ec8-5a282b779c74 req-d7c33f2f-096b-4c16-a34d-7078b70657b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082144 Aug 27 21:01:16.440334 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1604/3135] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:16.523189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:16.524024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:16.544071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.546559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.548056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.550291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.552232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.553748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.606435 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 HTTP/1.1 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5d145188-a594-45b4-8181-8b2f9dbe53f5'} Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:16.608643 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:16.614005 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d9ec0ce-9b6e-48f4-b873-f0a24d4e447e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 404 len: 111 microversion: 2.1 time: 0.095296 Aug 27 21:01:16.614984 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1605/3136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:16 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:16.813834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:16.832044 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee423d55-0e84-4ef8-84bb-1393869b007c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1483 microversion: 2.1 time: 0.494431 Aug 27 21:01:16.832759 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1532/3137] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:16 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1483 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:16.854329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:16.858004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:16.866994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.867893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.868379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.869182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:16.871516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:16.873879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:16.918558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1878985597", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:17.001083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:01:17.283220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:17.320582 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a7990d8-dc00-44ee-8aa2-1873924612b0 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1575 microversion: 2.1 time: 0.470005 Aug 27 21:01:17.325997 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1606/3138] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:16 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1575 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:17.349973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:17.350712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:17.359397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:17.360168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:17.360814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:17.362233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:17.363004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:17.364193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:17.540196 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7258848f-7f45-4d25-9e8c-26f88fd4f592 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194235 Aug 27 21:01:17.541399 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1607/3139] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:01:17 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:18.105030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:18.107727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:18.117531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.118496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.119145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.128755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.129467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.130285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.171593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-787c1d83-6197-44bc-a865-08f814e79f7b tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070412 Aug 27 21:01:18.172819 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1608/3140] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:01:18 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:18.184901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:18.186545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:18.201148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.202085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.202733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.204077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.211198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.215432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.311761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:01:18.312240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:01:18.312648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:01:18.313058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:01:18.313459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:01:18.338172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.338994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.339658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.340551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:18.341742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:18.342481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:18.366487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:01:18.380553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lazy-loading 'services' on Instance uuid 020754e8-22da-42fd-9277-05b26763be99 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:18.383857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:01:18.414197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:01:18.419573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:01:18.531714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:18.541227 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29b21646-9265-44a1-86e2-017c6eb14117 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625953 Aug 27 21:01:18.544628 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1533/3141] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:01:18.557400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:18.558467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:18.573024 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments/313d6b93-94c9-4348-90d5-a3f2155ac7f0" status: 202 len: 0 microversion: 2.1 time: 0.387534 Aug 27 21:01:18.575794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1609/3142] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:01:18 2022] DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments/313d6b93-94c9-4348-90d5-a3f2155ac7f0 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:18.759628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:18.811747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1209 microversion: 2.1 time: 0.260052 Aug 27 21:01:18.814585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1534/3143] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:18 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1209 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:19.116142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.117245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001678 Aug 27 21:01:19.117582 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1610/3144] 10.222.0.40 () {56 vars in 886 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 21:01:19.126155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.127643 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001908 Aug 27 21:01:19.128518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1535/3145] 10.222.0.40 () {54 vars in 1035 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 27 21:01:19.135991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.137367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001883 Aug 27 21:01:19.138057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1611/3146] 10.222.0.40 () {54 vars in 1041 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:19.147965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.149306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02eb6915-450e-46c7-95d7-24e56c4cc927 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001728 Aug 27 21:01:19.150070 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1536/3147] 10.222.0.40 () {56 vars in 886 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 21:01:19.817530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.820056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:19.834255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:19.835114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:19.861101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:19.861608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:19.862052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:19.863564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:19.864070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:19.864514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:19.875808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:19.876327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:19.876928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:19.877506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:19.877951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:19.881304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:19.977145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a642631-2bc4-4422-8669-fd1eeec251a1 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165572 Aug 27 21:01:19.978821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1612/3148] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:01:20.073177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:20.104781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:20.108642 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d397824e-3471-4d2d-bcae-69b5ea6eb2b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1205 microversion: 2.1 time: 0.276725 Aug 27 21:01:20.109952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:20.110931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1537/3149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:19 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1205 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:20.131800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.132313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.132761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.133491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.135800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.136271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.215267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2dad56d6-0f80-46e3-9652-f5f3c5b8e5b6 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112568 Aug 27 21:01:20.238458 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1613/3150] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:01:20 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:01:20.348500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:20.349804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:20.361955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.363271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.364498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.365558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.366480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.367088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.424404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:01:20.550969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:20.634547 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9649cbcf-743d-42e4-8bf5-ed8e3b8494ff tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 204 len: 0 microversion: 2.1 time: 0.303890 Aug 27 21:01:20.638523 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1538/3151] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:20 2022] DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:01:20.645957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:20.648660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:20.667955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.668853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.669731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.671795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.674559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.676434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.682632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:20.683462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:20.694540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.695195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.695773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:20.696596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:20.697308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:20.697829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:21.022627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:21.033898 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7f5da82-81f7-4494-9e9e-0d81f78f653c tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1575 microversion: 2.1 time: 0.355942 Aug 27 21:01:21.038472 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1539/3152] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:20 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1575 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:21.063201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67", "tag": "9560a5c9-6d21-45fc-9488-7c445cf165c9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:21.074694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:21.078439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:21.079071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:21.112577 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] Creating event network-changed:9560a5c9-6d21-45fc-9488-7c445cf165c9 for instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 on nch1-master-1 Aug 27 21:01:21.126175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ee298984-15ad-4d38-9196-c2373250908f req-e46e765b-554e-4c44-9553-9612992a7624 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067360 Aug 27 21:01:21.130869 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1540/3153] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:21.149535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:21.150554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:21.165334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:21.168079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:21.171228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:21.174832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:21.175564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:21.176899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:21.224411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:21.255878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9313713d-41c4-4a3a-bc4b-a2620b796b1f tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1681 microversion: 2.1 time: 0.612739 Aug 27 21:01:21.256514 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1614/3154] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:20 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1681 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:21.383554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:21.417315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7736af7-89cc-471d-999d-2ecab9661f49 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1269 microversion: 2.1 time: 0.284707 Aug 27 21:01:21.422071 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1541/3155] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:21 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1269 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:22.282247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:22.283470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:22.295855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:22.296606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:22.301526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:22.316037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:22.319471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:22.320289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:22.444421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:22.445226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:22.477226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:22.477869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:22.479842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:22.485941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:22.488469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:22.494357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:22.795874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:22.815478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-478c45a1-3aa4-45eb-bbf6-f5965701a6c7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1267 microversion: 2.1 time: 0.375043 Aug 27 21:01:22.817353 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1542/3156] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:22 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1267 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:22.940945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:22.954439 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1421a7a2-c277-4cb3-ab4f-30ad0598599a tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1681 microversion: 2.1 time: 0.677679 Aug 27 21:01:22.975868 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1615/3157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:22 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1681 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:23.854632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:23.856386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:23.899427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:23.899912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:23.904486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:23.906708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:23.909355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:23.910155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:23.981080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:23.981888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:24.000744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:24.004450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:24.004945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:24.006655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:24.007147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:24.011307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:24.372421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:24.388037 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-437cff3a-60cc-4f12-ae87-8fa8eb453f0d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1267 microversion: 2.1 time: 0.547503 Aug 27 21:01:24.389454 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1543/3158] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:23 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1267 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:24.768980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:24.779417 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-970d2f0f-a0cc-4680-a349-5b6c2ee4c38e tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1681 microversion: 2.1 time: 0.802125 Aug 27 21:01:24.785006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1616/3159] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:23 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1681 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:25.412148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:25.412830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:25.416882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:25.436996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:25.453672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:25.454255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:25.463686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:25.464254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:25.464708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:25.667928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:25.682812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b66c8015-cd4f-44fe-919c-f5f6fcd9b5f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1267 microversion: 2.1 time: 0.274415 Aug 27 21:01:25.685032 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1617/3160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:25 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:25.719678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41496616-4bf7-4b61-99cc-2106b2a0d9e7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff84ea731f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-538969", "description": "tempest-description-1675368701"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:25.809535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:25.811597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:25.846533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:25.848428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:25.849566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:25.851798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:25.853774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:25.855251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:25.979732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:26.036800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:26.055113 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cad1891c-463a-4708-999d-2458be94f9a2 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1614 microversion: 2.1 time: 0.252700 Aug 27 21:01:26.056012 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1618/3161] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:25 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1614 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:26.197340 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41496616-4bf7-4b61-99cc-2106b2a0d9e7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.992651 Aug 27 21:01:26.197951 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1544/3162] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:25 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:26.212051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-35847fe5-8379-47d7-baa4-a102e6e4dfd5 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff857d755e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1353071225", "description": "tempest-description-968701993"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:26.707308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:26.712972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:26.725335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:26.726318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:26.739187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:26.740336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:26.740927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:26.741638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:26.889761 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-35847fe5-8379-47d7-baa4-a102e6e4dfd5 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.681253 Aug 27 21:01:26.890709 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1619/3163] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:27.020408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:27.029727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdcb0116-4878-4bcc-9d7a-3bdd6c95830a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1267 microversion: 2.1 time: 0.326926 Aug 27 21:01:27.030325 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1545/3164] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:26 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:27.039818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1172828263", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "ef99ed56-9fe5-42ad-990e-5df54322eb77"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:27.079659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:27.082917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:27.101205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:27.103059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:27.104302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:27.107750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:27.109208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:27.109809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:27.133192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] validate_networks() for [('ef99ed56-9fe5-42ad-990e-5df54322eb77', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:01:27.636645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:27.660147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fbd44fc5-59ea-489e-8572-69cf2e3bf712 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1614 microversion: 2.1 time: 0.584578 Aug 27 21:01:27.662348 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1546/3165] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:27 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1614 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:28.050328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:28.053071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:28.072793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:28.073298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:28.075890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:28.078151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:28.079796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:28.081245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:28.353610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:28.586749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:28.608061 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-85074e52-f67a-48aa-877f-b3b36390fde7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 0.558441 Aug 27 21:01:28.626566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1547/3166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:28 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:28.687590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:28.688269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:28.701939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:28.702764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:28.705317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:28.706861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:28.710369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:28.711217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:28.807328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:28.858375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:28.870130 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b87684b6-31c0-4dca-83be-56615b284c2d tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1614 microversion: 2.1 time: 0.187320 Aug 27 21:01:28.883382 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1548/3167] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:28 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1614 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:28.907159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020754e8-22da-42fd-9277-05b26763be99", "name": "network-vif-deleted", "tag": "7a5a0ced-d3a6-4e61-8d14-b966c69b11dd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:28.931435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:28.933291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:28.933783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:28.966950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] Creating event network-vif-deleted:7a5a0ced-d3a6-4e61-8d14-b966c69b11dd for instance 020754e8-22da-42fd-9277-05b26763be99 on nch2-master-1 Aug 27 21:01:28.985983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-96c6e2be-9e8c-4aa5-bce6-3e6fc5cfca47 req-3b6e8880-6c58-4df6-9836-95ebedeee4e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080987 Aug 27 21:01:28.987164 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1549/3168] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:29.151360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:01:29.151869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:01:29.152286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:01:29.152698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:01:29.153477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:01:29.181530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.182284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.182881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:29.189855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.190635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.191246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:29.248310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Getting quotas for project 9a881a5e1e774e1d818d8e465596dd33. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:01:29.269665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Getting quotas for user 0c5c9cf888ac429b819659f076bcfc1e and project 9a881a5e1e774e1d818d8e465596dd33. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:01:29.306209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:01:29.310064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:01:29.397466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1af50c3-36ad-475d-bdde-f125f555cd46 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368836 Aug 27 21:01:29.398264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1620/3169] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:01:29.413459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-22b6e3da-2769-4f07-837a-0c03d99afd23 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:29.414337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-22b6e3da-2769-4f07-837a-0c03d99afd23 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:29.632785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:29.633626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:29.651293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.651835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.652296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:29.653019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.653622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.654092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:29.849015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-22b6e3da-2769-4f07-837a-0c03d99afd23 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:29.861622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-22b6e3da-2769-4f07-837a-0c03d99afd23 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1216 microversion: 2.1 time: 0.456213 Aug 27 21:01:29.875615 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1550/3170] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:29 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1216 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:29.895083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:29.896035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:29.916178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.918690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.919746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:29.924780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:29.926525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:29.928928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:30.004232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:30.005471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:30.006172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:30.006949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lazy-loading 'fault' on Instance uuid 020754e8-22da-42fd-9277-05b26763be99 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:01:30.088937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:30.098411 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e9b5c6f-44d9-41c3-abd5-88de7aa9e881 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 0.470417 Aug 27 21:01:30.099017 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1621/3171] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:29 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:30.404787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69894e287f1d457dacc403bf68c314af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '296e209e3b624bb9a75b2c8fad0b8b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:30.416885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f50f26f4-d9ee-46a5-98a8-c1bb09167553 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 200 len: 1331 microversion: 2.1 time: 0.523786 Aug 27 21:01:30.420626 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1551/3172] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:29 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 1331 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:30.890433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:30.890975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:30.911939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:30.912473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:30.921840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:30.922681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:30.923177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:30.932284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.125236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b86cf4-c6ec-45f8-a707-47da83378c71", "tag": "36c77817-3dd0-4dc3-b12d-3c2366c9eac7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:31.147689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:31.164160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:31.166209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.199047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] Creating event network-changed:36c77817-3dd0-4dc3-b12d-3c2366c9eac7 for instance 21b86cf4-c6ec-45f8-a707-47da83378c71 on nch2-master-1 Aug 27 21:01:31.214218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-eff9305f-b9ec-447f-b9fa-1a22f56c3f19 req-e86e4271-7e9a-4b1e-b4f5-e028becf835e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109728 Aug 27 21:01:31.215297 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1552/3173] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:31.244083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:31.245425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:31.268614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:31.269116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:31.271243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.273035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:31.273511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:31.273946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.481873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:31.496207 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84dd91c2-757d-4d77-8990-e4f23668f015 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1212 microversion: 2.1 time: 0.606798 Aug 27 21:01:31.502376 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1622/3174] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:30 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1212 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:31.526235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:31.528220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:31.546926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:31.549472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:31.549955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.554666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:31.555155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:31.555662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:31.600090 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] HTTP exception thrown: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Request method failure captured: Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 HTTP/1.1 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVuSuTHk9mbX2xNqMzEFAHUbZ227K-zd1ZqII5JIGovlCeCo2aIzMGCMJ2VNISz_UuzWN5OiJlnDr7AMER_2fWyFhBZR8x2jOP8gwCCW2W1FjgAQ6dmjLRQ24yIlad6u_NAnzC3S1i7anHLub0mWd2o-2_k6hzH8epiTqV7QJR46UM Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_296e209e3b624bb9a75b2c8fad0b8b5b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}] Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 69894e287f1d457dacc403bf68c314af Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '020754e8-22da-42fd-9277-05b26763be99'} Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:31.607743 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:31.615313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:31.618647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Returning 404 to user: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:31.621581 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f116e5bb-5a88-4f52-af26-f83f5b31b2d7 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 404 len: 111 microversion: 2.1 time: 0.118035 Aug 27 21:01:31.623439 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1623/3175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:31 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:31.640271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9057112c-58b5-4a93-a05e-00de7405da56 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '.version_select at 0x7ff84f92a940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:31.691258 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9057112c-58b5-4a93-a05e-00de7405da56 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573040286" status: 202 len: 0 microversion: 2.1 time: 0.061125 Aug 27 21:01:31.694338 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1624/3176] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573040286 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:32.347686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:32.356293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a30b11d-9b0f-42b9-99fe-28b552449fba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 1.137954 Aug 27 21:01:32.367213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1553/3177] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:31 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:32.527030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:32.528560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:32.552415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:32.555679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:32.556485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:32.557489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:32.561212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:32.562198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:33.071162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:33.087443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38e3c03a-27fb-464f-91d1-924938c95319 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1274 microversion: 2.1 time: 0.561651 Aug 27 21:01:33.088097 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1625/3178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:32 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1274 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:33.392699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:33.392699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:33.421844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:33.422551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:33.423966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:33.424711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:33.425177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:33.425653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:34.112812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:34.113377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:34.134719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:34.138649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:34.139374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:34.141254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:34.142998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:34.145673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:34.159732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:34.175840 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e153454-5dc9-4aa3-9793-e8d6eb139a67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 0.791655 Aug 27 21:01:34.182247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1554/3179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:33 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:35.107947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:35.122929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1631a46b-c63f-460e-a3be-115af367049d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 1.012231 Aug 27 21:01:35.135370 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1626/3180] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:34 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:35.205316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:35.206467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:35.219172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:35.220994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:35.221777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:35.222766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:35.223476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:35.224911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:35.673344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:35.688409 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6695478f-bb11-461f-ba8a-06ddfb2e0d67 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 0.488052 Aug 27 21:01:35.708285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1555/3181] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:35 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:36.151284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:36.152965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:36.183902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:36.187377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:36.188142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:36.189087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:36.189740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:36.190325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:36.660891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:36.720283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:36.720913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:36.729578 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8fa57281-6abd-4670-ac99-67f9c03ba5b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 0.565649 Aug 27 21:01:36.733088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1627/3182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:36 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:36.751598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:36.752130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:36.756335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:36.757573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:36.765228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:36.766098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:37.051520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74a5f19-5525-4999-a5f1-0e65fe2b60bb", "tag": "09410308-a05e-4960-a963-81689cf5f6b8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:37.080546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:37.086045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:37.086467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:37.117757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] Creating event network-changed:09410308-a05e-4960-a963-81689cf5f6b8 for instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb on nch1-master-1 Aug 27 21:01:37.143209 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7630121a-2ec1-406d-a642-a91192f6a9b5 req-66414286-19f2-478a-b5c9-0162ef51a11d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100317 Aug 27 21:01:37.148210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1628/3183] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:37.759628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:37.760350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:37.780234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:37.780752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:37.781387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:37.787543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:37.787543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:37.787543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:38.354141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:38.377734 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f4bc849-f56e-4d7e-b28e-8fe187e6b074 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 1.671072 Aug 27 21:01:38.378807 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1556/3184] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:36 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:38.446485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:38.472834 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c73e28b-62cf-4e42-bb7a-c200ff992996 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 0.720711 Aug 27 21:01:38.474235 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1629/3185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:37 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:38.701092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:38.703839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:38.713864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:38.715079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:38.716566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:38.717658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:38.719094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:38.719759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:38.746196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] HTTP exception thrown: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Request method failure captured: Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 HTTP/1.1 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVuSuTHk9mbX2xNqMzEFAHUbZ227K-zd1ZqII5JIGovlCeCo2aIzMGCMJ2VNISz_UuzWN5OiJlnDr7AMER_2fWyFhBZR8x2jOP8gwCCW2W1FjgAQ6dmjLRQ24yIlad6u_NAnzC3S1i7anHLub0mWd2o-2_k6hzH8epiTqV7QJR46UM Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_296e209e3b624bb9a75b2c8fad0b8b5b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}] Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 69894e287f1d457dacc403bf68c314af Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '020754e8-22da-42fd-9277-05b26763be99'} Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:38.749598 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.756181 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.759445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Returning 404 to user: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:38.760551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d32f842-692c-4d20-a488-d5ec7a7ea736 tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 404 len: 111 microversion: 2.1 time: 0.069579 Aug 27 21:01:38.761843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1557/3186] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:38 2022] DELETE /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:38.770922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:38.771621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] [instance: 020754e8-22da-42fd-9277-05b26763be99] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:38.821493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:38.825239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:38.825239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:38.833124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:38.839562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:38.842842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:38.914941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] HTTP exception thrown: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Request method failure captured: Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 HTTP/1.1 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVuSuTHk9mbX2xNqMzEFAHUbZ227K-zd1ZqII5JIGovlCeCo2aIzMGCMJ2VNISz_UuzWN5OiJlnDr7AMER_2fWyFhBZR8x2jOP8gwCCW2W1FjgAQ6dmjLRQ24yIlad6u_NAnzC3S1i7anHLub0mWd2o-2_k6hzH8epiTqV7QJR46UM Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/296e209e3b624bb9a75b2c8fad0b8b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_296e209e3b624bb9a75b2c8fad0b8b5b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/296e209e3b624bb9a75b2c8fad0b8b5b"}]}] Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 296e209e3b624bb9a75b2c8fad0b8b5b Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-349361316 Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 69894e287f1d457dacc403bf68c314af Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-349361316-project Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '020754e8-22da-42fd-9277-05b26763be99'} Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:38.917827 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. Aug 27 21:01:38.927031 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:38.940921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] Returning 404 to user: Instance 020754e8-22da-42fd-9277-05b26763be99 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:38.943981 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a28669bb-0524-4722-83a9-6d20110b425c tempest-AttachSCSIVolumeTestJSON-349361316 tempest-AttachSCSIVolumeTestJSON-349361316-project] 10.222.0.40 "GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99" status: 404 len: 111 microversion: 2.1 time: 0.175041 Aug 27 21:01:38.945095 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1630/3187] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:38 2022] GET /compute/v2.1/servers/020754e8-22da-42fd-9277-05b26763be99 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:39.402648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:39.403581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:39.417015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:39.421281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:39.426015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:39.427852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:39.429003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:39.431407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:39.431985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:39.432623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:39.662395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1674434275", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "00eec52d-7154-48f1-9293-6a6380434481"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:39.744546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] validate_networks() for [('00eec52d-7154-48f1-9293-6a6380434481', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:01:39.855163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:40.032302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:40.045466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-167e7056-5275-4edb-b2cb-f8a4484ab3b3 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 0.647392 Aug 27 21:01:40.065762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1631/3188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:39 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:40.071289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:40.072325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:40.080115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:40.080607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:40.081045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:40.081749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:40.082211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:40.082904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:40.956973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:40.973210 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-11aa068e-be9f-4953-8165-79a758156c62 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 0.905811 Aug 27 21:01:40.990052 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1632/3189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:40 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:40.999806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b86cf4-c6ec-45f8-a707-47da83378c71", "name": "network-vif-plugged", "status": "completed", "tag": "36c77817-3dd0-4dc3-b12d-3c2366c9eac7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:41.011368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:41.012125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:41.012830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:41.019436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:41.028762 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] Creating event network-vif-plugged:36c77817-3dd0-4dc3-b12d-3c2366c9eac7 for instance 21b86cf4-c6ec-45f8-a707-47da83378c71 on nch2-master-1 Aug 27 21:01:41.036516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3b11b9b7-f371-4910-977f-8b77e1d7c4ba req-ae9e183f-1f93-4caa-8310-aa80eb7c868b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043944 Aug 27 21:01:41.038198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1633/3190] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:41.169126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1024290367", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:41.356617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] validate_networks() for [('5e259cba-53a7-4f32-bd43-84b4cddf0044', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:01:41.741186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:01:41.741701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:01:41.742070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:01:41.742732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:01:41.743227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:01:41.750214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:41.771202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:41.772086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:41.772530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:41.775804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:41.777000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:41.779259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:41.843104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Getting quotas for project b4abb45086384f358cc2af6eb4fcabcd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:01:41.861556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Getting quotas for user da647a9ce7fd44759e559814732f8dc4 and project b4abb45086384f358cc2af6eb4fcabcd. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:01:41.877478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:01:41.880453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:01:41.964930 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c1ccaf57-eb84-4f62-aed6-0f1466fc9eb1 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821807 Aug 27 21:01:41.968229 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1558/3191] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:01:41.980274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:41.985710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:42.007680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:42.009558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:42.010213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:42.013158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:42.013860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:42.014645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.126527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:43.142421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d046d9c5-93f8-441e-b03a-1fe9e7d6bacb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1309 microversion: 2.1 time: 1.172665 Aug 27 21:01:43.147670 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1559/3192] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:41 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1309 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:43.150020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:01:43.150623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:01:43.151281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:01:43.151803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:01:43.152435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:01:43.156561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:43.161750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:43.177477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.180710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.181200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.184186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.185114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.185565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.198600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.203393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.205521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.206655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.208073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.208591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.251479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:43.278575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Getting quotas for project b3612cb2a9d14e00a40bbae087ddc9ca. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:01:43.286909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Getting quotas for user 1c7dd55f8d624d9596d8278719ed3422 and project b3612cb2a9d14e00a40bbae087ddc9ca. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:01:43.336995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:01:43.340131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:01:43.347512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:43.361719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8ecc9d7-ab41-401d-baa4-e57dec7862a7 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1221 microversion: 2.1 time: 0.210700 Aug 27 21:01:43.364007 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1560/3193] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:43 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:43.377073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:43.377817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:43.387309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.390008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.391827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.393840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:43.394990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:43.395491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:43.413895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-da7a2cd2-fe79-47e9-a29a-fe661081d4b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373986 Aug 27 21:01:43.415617 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1634/3194] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:01:43.444044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bbb1a69-e51e-49b7-951b-32c38a48239a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:43.445031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3bbb1a69-e51e-49b7-951b-32c38a48239a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:43.641258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3bbb1a69-e51e-49b7-951b-32c38a48239a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:43.669134 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3bbb1a69-e51e-49b7-951b-32c38a48239a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1224 microversion: 2.1 time: 0.240129 Aug 27 21:01:43.670147 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1635/3195] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:43 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1224 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:43.943779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:43.957617 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-867b410d-fb2b-4a5b-bcf4-ee2917bb3034 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 0.592371 Aug 27 21:01:43.965075 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1561/3196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:43 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:44.081285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74a5f19-5525-4999-a5f1-0e65fe2b60bb", "name": "network-vif-plugged", "status": "completed", "tag": "09410308-a05e-4960-a963-81689cf5f6b8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:44.111053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.111747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.112780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.131794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] Creating event network-vif-plugged:09410308-a05e-4960-a963-81689cf5f6b8 for instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb on nch1-master-1 Aug 27 21:01:44.139443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f70eb466-f058-49d8-ba1b-86843d253f1c req-21268aa5-3015-47a9-a8f5-7b9fa88ae7ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061383 Aug 27 21:01:44.140434 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1636/3197] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:44.166488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:44.169520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:44.184945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.189920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.190758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.194436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.195108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.197695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.388504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:44.389256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:44.420777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.428149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.430390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.437924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.439632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.442057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.851063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:44.857611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:44.880187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-80f7a7a0-890f-48ea-a05e-06ed615d1ec6 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1283 microversion: 2.1 time: 0.494809 Aug 27 21:01:44.881316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1637/3198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:44 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1283 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:44.888332 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba260e1f-f2f9-45bd-b0e2-efe1e82ce3b5 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1490 microversion: 2.1 time: 0.716692 Aug 27 21:01:44.891302 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1562/3199] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:44 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1490 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:44.902017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:44.907046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:44.915402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:44.919978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:44.924995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.927753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.928214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.928832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.928963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.929970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.930634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.931483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:44.932110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.932704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:44.937083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:44.937696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.109410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-efa8486d-1cec-46f2-8eab-9b3d52fc19a0 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "PUT /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1085 microversion: 2.1 time: 0.197293 Aug 27 21:01:45.114311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1638/3200] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:01:44 2022] PUT /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1085 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:45.131917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:45.133042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:45.145879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.152865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.155202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.162606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:45.165667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.166473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.167638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.175220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbd69016-07ba-498f-845c-b9afa27179ae tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1220 microversion: 2.1 time: 0.278900 Aug 27 21:01:45.175892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1563/3201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:44 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1220 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:45.196697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:45.201985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:45.224641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.225226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.225615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.226428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.226785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.227377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.740919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:45.760926 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-371885f7-0e81-4e95-a1d7-a03cf24cde44 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1316 microversion: 2.1 time: 0.643616 Aug 27 21:01:45.773103 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1639/3202] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:45 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:45.899672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:45.915378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:45.916354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:45.943386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f57b09e-c8ab-4091-8d42-5f1e682858ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1511 microversion: 2.1 time: 0.766327 Aug 27 21:01:45.953392 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1564/3203] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:45 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:45.955157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.956061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.956737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.957673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:45.958461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:45.959105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:45.981049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:45.981938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:46.004116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:46.006378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:46.010779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:46.012558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:46.013649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:46.016455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.003419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:47.015732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-553af0f0-7a5b-41f3-91ed-d8e1a7c42d35 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 1.112940 Aug 27 21:01:47.017624 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1640/3204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:45 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:47.024676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:47.025603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:47.034327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.035172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.035803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.036906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.038508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.038508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.054539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:47.068696 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4c8790e-fb5c-4bde-a611-d7f32d2985b8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1511 microversion: 2.1 time: 1.093668 Aug 27 21:01:47.080473 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1565/3205] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:45 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1511 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:47.091355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:47.092279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:47.103888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.104642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.105270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.106444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.107081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.107704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.189184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:47.202414 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0afe2f67-19ba-435f-86c0-8a9e6f03c850 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1282 microversion: 2.1 time: 0.181982 Aug 27 21:01:47.205287 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1641/3206] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:47 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:47.219243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:47.221366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:47.231301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.235781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.236220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.236968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.237433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.237868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.298817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:01:47.448431 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f8d4bc2-b8bf-4eec-a314-d59c9f5f4325 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 204 len: 0 microversion: 2.1 time: 0.239771 Aug 27 21:01:47.455643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1642/3207] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:01:47 2022] DELETE /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:01:47.474740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60390dea-3121-4319-bbe0-5e766e9b93ee", "tag": "ca6d2afa-49c4-4f49-9c87-16286eaee9cd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:47.494150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.494668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.495092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.521584 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] Creating event network-changed:ca6d2afa-49c4-4f49-9c87-16286eaee9cd for instance 60390dea-3121-4319-bbe0-5e766e9b93ee on nch2-master-1 Aug 27 21:01:47.533206 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-70fe64bd-7b92-417f-aedf-964e2de3613f req-d63d8323-64d0-4357-ad07-e71731a4812b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070412 Aug 27 21:01:47.534177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1643/3208] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:47.539654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:47.540363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:47.549992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.550642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.551121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.551923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.552375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.552904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.724287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:47.736560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34a6ba90-7992-431b-8fae-a5d2fba2a7ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1505 microversion: 2.1 time: 0.654811 Aug 27 21:01:47.777787 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1566/3209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:47 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:47.783156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-538969"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:47.783770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:47.803417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.806793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.809308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.810379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:47.811304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:47.817168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:47.903901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:47.915266 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41aea935-a2fc-4cc7-9ae7-2650ca32da32 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1517 microversion: 2.1 time: 0.379407 Aug 27 21:01:47.916769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1644/3210] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:47 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:48.046506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:48.047580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:48.061893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:48.062758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:48.063592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:48.064862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:48.065373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:48.065983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:48.093015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.network.security_group_api [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Adding security group 70fad35f-00f1-48f3-9f96-3612d560342a to port 09410308-a05e-4960-a963-81689cf5f6b8 Aug 27 21:01:48.528334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:48.542745 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e2509b5-3d3c-4562-bd8d-b418b3980c4a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.508581 Aug 27 21:01:48.545692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1645/3211] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:48 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:48.564769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:48.566132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:48.582497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:48.585285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:48.585911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:48.588147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:48.590438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:48.593713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.061596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:49.078623 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3cd084f6-fdd2-45b3-818a-7527ebcaef21 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.528729 Aug 27 21:01:49.079832 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1646/3212] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:48 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:49.086483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:49.088471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:49.105022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.105462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.105976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.107064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.107893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.108554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.182814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7bca6ead-1181-4aa6-9a93-e0d1d533d287 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/action" status: 202 len: 0 microversion: 2.1 time: 1.403516 Aug 27 21:01:49.188611 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1567/3213] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:01:47 2022] POST /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/action => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:49.207376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1353071225"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:49.210380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:49.236178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.237184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.238918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.244506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.249635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.250761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.375449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:49.386201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62a6f31a-8488-4066-a7ef-386d50cddd00 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1517 microversion: 2.1 time: 0.304299 Aug 27 21:01:49.402055 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1647/3214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:49 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1517 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:49.406837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74a5f19-5525-4999-a5f1-0e65fe2b60bb", "tag": "09410308-a05e-4960-a963-81689cf5f6b8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:49.435078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.438690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.441278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.454656 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] Creating event network-changed:09410308-a05e-4960-a963-81689cf5f6b8 for instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb on nch1-master-1 Aug 27 21:01:49.462164 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6408a24f-d4d7-4530-9c0a-5be4bedaf2a3 req-a721d6a4-51e6-4eaa-8005-14197ce989ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069553 Aug 27 21:01:49.463073 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1648/3215] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:49.569805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:49.570563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:49.582648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:49.585524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.586668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.587117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.588027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:49.588487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:49.588912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:49.595643 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.network.security_group_api [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Adding security group 3220f54d-f64b-4d83-a820-68cd46b4369f to port 09410308-a05e-4960-a963-81689cf5f6b8 Aug 27 21:01:50.067310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:50.075517 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1f42c2e-4b63-4d6d-8ca5-f09eab1e6fab tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.512993 Aug 27 21:01:50.084928 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1649/3216] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:49 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:50.103650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:50.104276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:50.114795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.115298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.115774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.116565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.117081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.122172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.489442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:50.509712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28a8d014-5e1b-4d8d-bbbd-e666c0466b49 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.409746 Aug 27 21:01:50.511935 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1650/3217] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:50 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:50.519111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:50.520542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:50.548649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.549857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.552403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.553499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.554407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.555521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.594255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88252ec2-1ead-4887-8c98-c333499ff746 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/action" status: 202 len: 0 microversion: 2.1 time: 1.399310 Aug 27 21:01:50.603160 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1568/3218] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:01:49 2022] POST /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/action => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:50.632516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18086e2b-0ff7-49fe-b241-8361d827e8c9", "tag": "5a83f09a-05ed-464a-9ecb-7206335a80ae"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:50.664453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.666675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.667988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.690924 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] Creating event network-changed:5a83f09a-05ed-464a-9ecb-7206335a80ae for instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 on nch1-master-1 Aug 27 21:01:50.699251 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8562e2d5-36c9-47f0-af9f-96432a14be07 req-8d132f8f-7120-4c7e-9dda-524014c059aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092726 Aug 27 21:01:50.700915 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1569/3219] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:50.713455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:50.714473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:50.723813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.724672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.725488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:50.727378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:50.728101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:50.729762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.254968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:51.259875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:51.268577 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d672005e-671b-4d37-bdd5-b43884c27ac2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1517 microversion: 2.1 time: 0.755185 Aug 27 21:01:51.275307 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1651/3220] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:50 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1517 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:51.297567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:51.298559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:51.313466 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-233225c4-46ad-492b-89bb-0c95720d98bb tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.611150 Aug 27 21:01:51.314656 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1570/3221] 10.222.0.40 () {58 vars in 1293 bytes} [Sat Aug 27 21:01:50 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb/os-security-groups => generated 1154 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:51.330869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-af052f26-3ef8-4f63-8e70-2b12cfcf1a42 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff857cb1e50>, body: {"security_group": {"name": " tempest-securitygroup -943430239 ", "description": "tempest-description-290778866"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:51.335964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:51.337077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:51.337687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.338705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:51.339490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:51.340142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.708378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:51.718571 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70caff36-9a88-4720-ad12-e205eced9540 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.428851 Aug 27 21:01:51.719704 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1652/3222] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:51 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:51.724474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74a5f19-5525-4999-a5f1-0e65fe2b60bb", "tag": "09410308-a05e-4960-a963-81689cf5f6b8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:51.736583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:51.737087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:51.737518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.749747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] Creating event network-changed:09410308-a05e-4960-a963-81689cf5f6b8 for instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb on nch1-master-1 Aug 27 21:01:51.755373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2b0c21d2-a257-4f3e-bd87-a3f6818f8317 req-99e21fcd-cfee-492c-8a61-9ae7b1fbe1a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Aug 27 21:01:51.756028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1653/3223] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:51.761835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:51.762884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:51.773471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:51.774205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:51.774641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.775425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:51.777096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:51.777831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:51.810555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:51.820886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-af052f26-3ef8-4f63-8e70-2b12cfcf1a42 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.495083 Aug 27 21:01:51.822441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1571/3224] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:51 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:51.835703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06d81c09-5575-4e94-94ac-c805fffbf458 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1c9940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:51.872025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:52.276312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06d81c09-5575-4e94-94ac-c805fffbf458 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1" status: 200 len: 222 microversion: 2.1 time: 0.444873 Aug 27 21:01:52.277008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1572/3225] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:51 2022] GET /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 => generated 222 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:52.291185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4e9b07b6-6ddb-4d14-9cb8-509f1d25b97c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1dfa60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:52.410229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:52.420377 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70fe6bab-399b-4dc3-b246-29cac9f5a624 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.662953 Aug 27 21:01:52.421709 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1654/3226] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:51 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:52.431269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:52.432513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:52.442078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:52.442848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:52.443298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:52.444082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:52.444538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:52.445250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:52.567269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:52.577427 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbbce87a-d709-45ed-924b-f22c233d455f tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 200 len: 1475 microversion: 2.1 time: 0.154099 Aug 27 21:01:52.578734 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1655/3227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:52 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 1475 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:52.737035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b86cf4-c6ec-45f8-a707-47da83378c71", "name": "network-vif-deleted", "tag": "36c77817-3dd0-4dc3-b12d-3c2366c9eac7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:52.775749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:52.777687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:52.779370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:52.810015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4e9b07b6-6ddb-4d14-9cb8-509f1d25b97c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1" status: 202 len: 0 microversion: 2.1 time: 0.522586 Aug 27 21:01:52.811037 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1573/3228] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:01:52 2022] DELETE /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:52.819701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:52.821209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:52.822821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] Creating event network-vif-deleted:36c77817-3dd0-4dc3-b12d-3c2366c9eac7 for instance 21b86cf4-c6ec-45f8-a707-47da83378c71 on nch2-master-1 Aug 27 21:01:52.850293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:52.851083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:52.853586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:52.855717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:52.857044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:52.858596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:52.876487 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1e50cf61-6c0e-4b3a-a5c0-65c2ba40c2d4 req-f7b31cd9-e24d-4e3d-83d0-676ebe2395c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159141 Aug 27 21:01:52.877120 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1656/3229] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:52.914372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff857dadee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:53.113559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:01:53.114373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group df0e579e-f116-492f-a0e0-7a641e09c6c1 not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:01:53.115886 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.115886 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 HTTP/1.1 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'df0e579e-f116-492f-a0e0-7a641e09c6c1'} Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:01:53.119208 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] Aug 27 21:01:53.126013 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.134426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:01:53.134426 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-23642b29-3579-4af1-997f-570216bf63fe'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:53.136534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4533ada9-ae29-40a6-9f16-a5a0dc47930e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1" status: 404 len: 194 microversion: 2.1 time: 0.235790 Aug 27 21:01:53.138410 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1657/3230] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:52 2022] GET /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 => generated 194 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:53.149949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb62c170-62b7-49c1-82b0-62186ad0146a tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff84e02c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1967645652", "description": "tempest-description-980485452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:53.234944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:53.306385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:53.315240 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6294330-6f9c-44ce-a5df-8c589f31c32a tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.501550 Aug 27 21:01:53.329456 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1574/3231] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:52 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:53.442660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:53.443473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:53.450578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:53.451179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:53.452020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:53.452965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:53.453952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:53.455205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:53.661932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:53.750252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb62c170-62b7-49c1-82b0-62186ad0146a tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.604383 Aug 27 21:01:53.751308 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1658/3232] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:53.765112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:53.784481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:53.813867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:53.814694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:53.830280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:53.834339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:53.836372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:53.837842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:53.877760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 HTTP/1.1 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '21b86cf4-c6ec-45f8-a707-47da83378c71'} Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.882545 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:01:53.886668 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:53.891895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:53.895026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a8cb36c-e686-4c26-970f-c45074569266 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 404 len: 111 microversion: 2.1 time: 0.141401 Aug 27 21:01:53.896516 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1659/3233] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:53 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:53.925164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bddbc817-fb7a-4367-ba6e-fbf33f0e3f93 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff84e01e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1462971679", "description": "tempest-description-24783713"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:54.005830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:54.021108 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a401f72f-8485-4939-a5ee-9eaadc7e9dea tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.577045 Aug 27 21:01:54.022090 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1575/3234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:53 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:54.089460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-528571297", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "b8b26300-a8e8-4d22-bb48-7994c70882fa"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:54.212634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] validate_networks() for [('b8b26300-a8e8-4d22-bb48-7994c70882fa', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:01:54.640350 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bddbc817-fb7a-4367-ba6e-fbf33f0e3f93 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.742150 Aug 27 21:01:54.641564 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1660/3235] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:53 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:54.646760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:54.647455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:54.659988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:54.660814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:54.663389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:54.665451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:54.666077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:54.667508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:55.148339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:55.168261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfaed158-3a5c-4b4d-b870-2873c1131480 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.525507 Aug 27 21:01:55.169201 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1661/3236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:54 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:55.190350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55860889-f368-4e2a-8d96-b6c02fdacf9d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff857d9e670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1432628926", "description": "tempest-description-926136638"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:55.352260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:01:55.352945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:01:55.353498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:01:55.356026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:01:55.357347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:01:55.376631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:55.377808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:55.378501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:55.379554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:55.380273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:55.380864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:55.405383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:01:55.413511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Getting quotas for user 7c6872f5357c43bb8807f0141d9c3f9b and project d5f0f97108e94d9582da49f0e58a0fa6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:01:55.431121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:01:55.434159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:01:55.499142 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd1c8b0a-43db-4b07-ace0-58e99d974a87 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413732 Aug 27 21:01:55.500625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1576/3237] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:01:55.509962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:55.511118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:55.520199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:55.521188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:55.521877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:55.523048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:55.523845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:55.524842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:55.683620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55860889-f368-4e2a-8d96-b6c02fdacf9d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.489148 Aug 27 21:01:55.683620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1662/3238] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:55.683620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62227e57-f8c1-4db5-a878-7b3f6b155214 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:55.683620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62227e57-f8c1-4db5-a878-7b3f6b155214 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:55.938472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:55.958043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62227e57-f8c1-4db5-a878-7b3f6b155214 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:55.966965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-37c090c4-ca81-423e-9f5b-b86c9da5251b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.451692 Aug 27 21:01:55.968293 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1577/3239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:55 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:55.978655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60debe2a-efcd-4044-8f8b-a373e893a127 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84eab10d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:55.989944 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62227e57-f8c1-4db5-a878-7b3f6b155214 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1208 microversion: 2.1 time: 0.313353 Aug 27 21:01:55.992610 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1663/3240] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:55 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1208 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:56.191493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:56.192410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:56.208504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:56.209094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:56.212534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:56.217401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:56.222098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:56.222878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:56.954567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:56.974600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8d761324-b035-4801-9e72-f7c45ea695ec tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.787420 Aug 27 21:01:56.976026 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1664/3241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:56 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:56.983400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60390dea-3121-4319-bbe0-5e766e9b93ee", "name": "network-vif-plugged", "status": "completed", "tag": "ca6d2afa-49c4-4f49-9c87-16286eaee9cd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:57.010152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:57.010269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:57.010853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:57.030400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60debe2a-efcd-4044-8f8b-a373e893a127 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1828 microversion: 2.1 time: 1.058383 Aug 27 21:01:57.040532 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1578/3242] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 21:01:55 2022] GET /compute/v2.1/os-security-groups => generated 1828 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:57.043019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] Creating event network-vif-plugged:ca6d2afa-49c4-4f49-9c87-16286eaee9cd for instance 60390dea-3121-4319-bbe0-5e766e9b93ee on nch2-master-1 Aug 27 21:01:57.048948 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-475c1132-f739-481d-a457-eb45c6817e60 req-560a5999-93fd-42ba-864d-a81aa33cf462 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071557 Aug 27 21:01:57.049957 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1665/3243] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:57.055081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.055930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.056171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:57.056979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:57.065513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:57.066034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:57.066654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:57.067615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:57.068081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:57.068535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:57.084132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:57.084850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:57.085177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:57.086130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:57.087422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:57.087757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:57.162175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:57.172697 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db30b45d-3a26-490f-97ee-ba59e3f8b7c1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1260 microversion: 2.1 time: 0.121168 Aug 27 21:01:57.173639 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1666/3244] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:57 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1260 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:57.180965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ffe4013-2666-4411-9908-c9291a44e91e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84dfd39d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.420545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:57.441150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-33fdec34-8836-4d40-8b52-f11d70b96ab8 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.399534 Aug 27 21:01:57.447433 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1579/3245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:57 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:57.586989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ffe4013-2666-4411-9908-c9291a44e91e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06" status: 202 len: 0 microversion: 2.1 time: 0.410549 Aug 27 21:01:57.587899 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1667/3246] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:01:57 2022] DELETE /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:57.597484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff857cdf040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.678403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:01:57.681060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:01:57.681920 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.681920 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06 HTTP/1.1 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '354b53c3-8b90-430c-a17a-33cfc34f3d06'} Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:01:57.684737 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] Aug 27 21:01:57.689943 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:01:57.696844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:01:57.696844 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cbb55927-fdea-4527-a963-b67ba437a415'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:57.696844 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-130145c2-af32-44a3-8ba6-8bb37ec527c2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06" status: 404 len: 194 microversion: 2.1 time: 0.103663 Aug 27 21:01:57.697824 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1580/3247] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:57 2022] GET /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:01:57.708026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82f37f13-ffe4-47e1-bf58-670c0b5ba5b2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84dfd33a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.998764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:57.999687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:58.000406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82f37f13-ffe4-47e1-bf58-670c0b5ba5b2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e" status: 202 len: 0 microversion: 2.1 time: 0.297410 Aug 27 21:01:58.001010 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1668/3248] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:01:57 2022] DELETE /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:58.011799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e01e940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.013870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.018652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.019473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.020473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.021176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.021833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.058595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:01:58.060878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 8786da3d-bf42-482b-bbaa-708b280d6c0e not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:01:58.062885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.062885 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e HTTP/1.1 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '8786da3d-bf42-482b-bbaa-708b280d6c0e'} Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:01:58.066725 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] Aug 27 21:01:58.074301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.078614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:01:58.078614 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-e844d4a7-ac83-4411-816a-1dc5a6ba3bcd'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:58.079965 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27961464-ed2f-48a1-98ca-83c2410651f6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e" status: 404 len: 194 microversion: 2.1 time: 0.074189 Aug 27 21:01:58.083379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1669/3249] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:58 2022] GET /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:01:58.094630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-992143eb-255d-47c7-98d3-8f199cd013ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e01ed30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.343461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:58.356245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1c21254-5577-448d-a0fb-5779e5885995 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1325 microversion: 2.1 time: 0.361777 Aug 27 21:01:58.370774 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1581/3250] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:57 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:01:58.377250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.378332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:58.387857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.388871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.389543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.390520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.391488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.392130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.487682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:58.499667 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-662d99a5-b1ae-4321-8164-99ff97804b2d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1266 microversion: 2.1 time: 0.127057 Aug 27 21:01:58.505352 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1582/3251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:58 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:58.516126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.517102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:58.528778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.529039 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-992143eb-255d-47c7-98d3-8f199cd013ec tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf" status: 202 len: 0 microversion: 2.1 time: 0.442279 Aug 27 21:01:58.530105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.530241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1670/3252] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:01:58 2022] DELETE /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:01:58.531221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.532335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:58.533171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:58.534173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:58.538843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e53cb80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.652030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:01:58.653279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:01:58.654119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.654119 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf HTTP/1.1 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '53f4eb13-2ce2-43e3-b6a9-ce45d49783cf'} Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:01:58.657709 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] Aug 27 21:01:58.664325 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:01:58.674483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:01:58.674483 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-ebc30989-6932-4539-b97b-6fa9f870b9d0'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:01:58.681345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1ffa68c-5f21-459f-985d-7cb0ffcf2fa3 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf" status: 404 len: 194 microversion: 2.1 time: 0.146953 Aug 27 21:01:58.682080 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1671/3253] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:01:58 2022] GET /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:01:58.693259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6446581f-b738-4a76-a66c-74a6ce957f82 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e02c670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:58.809888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:58.822998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e20d8f81-5484-45e9-a0f4-a5197ba01970 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.313661 Aug 27 21:01:58.830501 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1583/3254] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:58 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:58.996490 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6446581f-b738-4a76-a66c-74a6ce957f82 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.308370 Aug 27 21:01:58.997163 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1672/3255] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 21:01:58 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:59.012831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cbc5dbf-437d-43c8-924f-0a2bea93278b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff857c63670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-500994698", "description": "tempest-description-1084503986"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:59.070218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18086e2b-0ff7-49fe-b241-8361d827e8c9", "name": "network-vif-plugged", "status": "completed", "tag": "5a83f09a-05ed-464a-9ecb-7206335a80ae"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:59.084416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.086279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.087016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.103420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] Creating event network-vif-plugged:5a83f09a-05ed-464a-9ecb-7206335a80ae for instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 on nch1-master-1 Aug 27 21:01:59.123774 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8ad0e980-1c0e-42bf-bec6-43ede493839e req-0919895c-2421-46b0-8a19-d33c548ee278 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058287 Aug 27 21:01:59.125184 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1673/3256] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:01:59.293619 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cbc5dbf-437d-43c8-924f-0a2bea93278b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.284900 Aug 27 21:01:59.300511 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1584/3257] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:59.316728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92c2460f-5c2d-478b-8c23-a8bc61fde837 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff84e53cf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2052465120", "description": "tempest-description-1136860264"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:01:59.384770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:59.387501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:59.397042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.397166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.397676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.398585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.399035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.399720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.403826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:01:59.865297 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92c2460f-5c2d-478b-8c23-a8bc61fde837 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.560349 Aug 27 21:01:59.868294 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1674/3258] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:01:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:01:59.874599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:59.876500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:59.897422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.906304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:01:59.913545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.916084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.917172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.917830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.920367 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36624f0d-0965-4a36-acbd-3796146d23c2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1521 microversion: 2.1 time: 0.539003 Aug 27 21:01:59.921036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.922265 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1585/3259] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:59 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:01:59.936310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:01:59.937208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:01:59.947905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.948853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.949684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:01:59.950871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:01:59.952195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:01:59.952807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.193190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:00.203355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:00.205202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65bc5184-516f-41e5-b4b3-34d9f721766b tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.335489 Aug 27 21:02:00.210951 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1675/3260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:59 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:00.211889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9591dcbc-8c52-430d-a304-d43ca2ad29b1 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1324 microversion: 2.1 time: 0.287165 Aug 27 21:02:00.212824 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1586/3261] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:01:59 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:00.228978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1112271398", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "ef99ed56-9fe5-42ad-990e-5df54322eb77"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:00.236808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:00.237619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:00.245715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.247093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.247749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.249715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.252083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.252789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.296921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] validate_networks() for [('ef99ed56-9fe5-42ad-990e-5df54322eb77', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:02:00.313479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Request method failure captured: Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee/ips/invalid HTTP/1.1 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYyLunV00kfa4GFCyyz4gFVvfAFzaJkkpyShthmudcgg8VzR1rdwD7sYR9xZ66nZE2a_2aUmyAwcYMgQRsIE-qX6RhDFHtBIrcDscs1vfsTmO_Iy5O7TqVk_Umt6xxikEn3hxk8A6fn8d-6KuUcdb8J-QNz_WE9LNRUBjY0zGw363c Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4abb45086384f358cc2af6eb4fcabcd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}] Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: da647a9ce7fd44759e559814732f8dc4 Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance is not a member of specified network Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': '60390dea-3121-4319-bbe0-5e766e9b93ee', 'id': 'invalid'} Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 21:02:00.321359 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.324849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:00.324849 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4191a57d-07ee-46ea-a6b1-27166b48bbda tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.110869 Aug 27 21:02:00.328869 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1676/3262] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:00 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee/ips/invalid => generated 91 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:00.341569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:00.342062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Failed to fetch instance by id 999 {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 21:02:00.346237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Request method failure captured: Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYyLunV00kfa4GFCyyz4gFVvfAFzaJkkpyShthmudcgg8VzR1rdwD7sYR9xZ66nZE2a_2aUmyAwcYMgQRsIE-qX6RhDFHtBIrcDscs1vfsTmO_Iy5O7TqVk_Umt6xxikEn3hxk8A6fn8d-6KuUcdb8J-QNz_WE9LNRUBjY0zGw363c Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4abb45086384f358cc2af6eb4fcabcd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}] Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: da647a9ce7fd44759e559814732f8dc4 Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 999 could not be found. Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': '999'} Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 21:02:00.348094 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:00.353949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:00.354879 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4be6110e-0ca2-4ceb-a609-4ab18571bd75 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.022723 Aug 27 21:02:00.355614 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1677/3263] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 21:02:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:00.366376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:00.367006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:00.376073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.377101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.377750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.379378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.380096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.381622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.421161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:00.568199 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b74d599-def4-461b-9085-11a5000bf603 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "DELETE /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 204 len: 0 microversion: 2.1 time: 0.205479 Aug 27 21:02:00.569989 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1678/3264] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:00 2022] DELETE /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:00.583108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:00.584201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:00.597993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.598943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.600650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.602275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.603201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.605118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.866099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:00.882286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c9c2de2-2f80-4099-9d28-35e7269efd49 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1527 microversion: 2.1 time: 0.307890 Aug 27 21:02:00.883675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1679/3265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:00 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:00.890387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b783eb6d-d028-4826-82fc-24b26bfa2983", "tag": "8fc6b094-a266-415d-b5ca-b5ef78ca7c69"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:00.901081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:02:00.901624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:02:00.902000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:02:00.902470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:02:00.902944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:02:00.907298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.908159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.908992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.918537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.918978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.919692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.921162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:00.922071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:00.923095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:00.960043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] Creating event network-changed:8fc6b094-a266-415d-b5ca-b5ef78ca7c69 for instance b783eb6d-d028-4826-82fc-24b26bfa2983 on nch2-master-1 Aug 27 21:02:00.968520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aed0aa79-5c35-4328-a20e-6d7b9ada118a req-0f32b3ad-8505-4571-b18c-0c4f1243cf12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082150 Aug 27 21:02:00.970213 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1680/3266] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:00.977409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Getting quotas for project 9a881a5e1e774e1d818d8e465596dd33. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:02:00.992067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Getting quotas for user 0c5c9cf888ac429b819659f076bcfc1e and project 9a881a5e1e774e1d818d8e465596dd33. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:02:01.010944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:02:01.014225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:02:01.075241 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-65aeccd4-fcc4-401e-a4dd-aed59cbc58dc tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860916 Aug 27 21:02:01.076305 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1587/3267] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:02:01.089826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-074d482c-85f6-4ec2-986e-2ce61e3be428 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:01.092920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-074d482c-85f6-4ec2-986e-2ce61e3be428 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:01.225282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-074d482c-85f6-4ec2-986e-2ce61e3be428 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:01.237673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:01.240832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:01.248890 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-074d482c-85f6-4ec2-986e-2ce61e3be428 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1216 microversion: 2.1 time: 0.165544 Aug 27 21:02:01.251999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1681/3268] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:01 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1216 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:01.270009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.270771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.271499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.272151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.272649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.273032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.274370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:01.275142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:01.289575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.292623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.293184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.294474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.295046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.296105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.559520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:01.570300 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-378d84a3-7da3-4625-b8fc-5f6e30077d6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.339864 Aug 27 21:02:01.585680 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1588/3269] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:01 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:01.586242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:01.597597 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c4c5447-f6d2-4920-8853-df4ebfbbbfc4 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1521 microversion: 2.1 time: 0.344088 Aug 27 21:02:01.598036 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1682/3270] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:01 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:01.791143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc99d80b-2ddb-41f7-bd81-0bb2394f790e tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1651954407", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc99d80b-2ddb-41f7-bd81-0bb2394f790e tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 243 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1651954407", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1651954407', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5e259cba-53a7-4f32-bd43-84b4cddf0044'}]}}} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:01.808117 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc99d80b-2ddb-41f7-bd81-0bb2394f790e tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc99d80b-2ddb-41f7-bd81-0bb2394f790e tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026551 Aug 27 21:02:01.813121 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1589/3271] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:01 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:02:01.822976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:01.823383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: fc61809a-e201-4fcc-bd0e-6c70daac0e20] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:01.835358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] HTTP exception thrown: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/fc61809a-e201-4fcc-bd0e-6c70daac0e20/metadata HTTP/1.1 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': 'fc61809a-e201-4fcc-bd0e-6c70daac0e20'} Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.843218 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 404 to user: Instance fc61809a-e201-4fcc-bd0e-6c70daac0e20 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22b85945-6882-49b2-9381-f7dda0d1c016 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/fc61809a-e201-4fcc-bd0e-6c70daac0e20/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027031 Aug 27 21:02:01.848010 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1683/3272] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 21:02:01 2022] GET /compute/v2.1/servers/fc61809a-e201-4fcc-bd0e-6c70daac0e20/metadata => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:01.905135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:01.905773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:01.913253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.913733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.914392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.915059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:01.916110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:01.916864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:01.920799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-90f87481-4745-4157-8d56-d3106a9285a3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1989096401", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-90f87481-4745-4157-8d56-d3106a9285a3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 499 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1989096401", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1989096401', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5e259cba-53a7-4f32-bd43-84b4cddf0044'}]}}} Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 21:02:01.928890 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-90f87481-4745-4157-8d56-d3106a9285a3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-90f87481-4745-4157-8d56-d3106a9285a3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017699 Aug 27 21:02:01.932338 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1684/3273] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:01 2022] POST /compute/v2.1/servers => generated 687 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:02:02.012369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ddaa438-b01a-4f59-8136-18fd5b2b4942 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1908888295", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ddaa438-b01a-4f59-8136-18fd5b2b4942 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 500 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1908888295", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1908888295', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5e259cba-53a7-4f32-bd43-84b4cddf0044'}]}}} Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 21:02:02.026779 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.032167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.041281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ddaa438-b01a-4f59-8136-18fd5b2b4942 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:02.043445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ddaa438-b01a-4f59-8136-18fd5b2b4942 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.043667 Aug 27 21:02:02.044227 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1685/3274] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:01 2022] POST /compute/v2.1/servers => generated 689 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:02:02.108507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:02.117358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-094a4f3c-6835-4000-89bc-29da6c2c3c44 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1527 microversion: 2.1 time: 0.216770 Aug 27 21:02:02.118320 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1590/3275] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:01 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1527 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:02.248933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bf2c1a4-7ad9-4bd2-873d-7ff370a09950 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-902417936", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bf2c1a4-7ad9-4bd2-873d-7ff370a09950 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 753 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-902417936", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-902417936', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5e259cba-53a7-4f32-bd43-84b4cddf0044'}]}}} Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:02:02.254680 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:02:02.258242 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:02:02.262148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.262148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.263917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bf2c1a4-7ad9-4bd2-873d-7ff370a09950 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:02.265298 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5bf2c1a4-7ad9-4bd2-873d-7ff370a09950 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021674 Aug 27 21:02:02.266426 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1686/3276] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:02 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 21:02:02.275235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:02.276362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:02.285173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.286179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.287067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.287989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.288892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.289491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.458329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:02.459909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f312fdf-7e4d-4a27-aee0-2f5f7c8fcf50 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-741697421", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f312fdf-7e4d-4a27-aee0-2f5f7c8fcf50 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 1265 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-741697421", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5e259cba-53a7-4f32-bd43-84b4cddf0044"}]}} Aug 27 21:02:02.470211 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-741697421', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5e259cba-53a7-4f32-bd43-84b4cddf0044'}]}}} Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.473125 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:02:02.474502 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:02:02.476609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 21:02:02.476609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.476609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f312fdf-7e4d-4a27-aee0-2f5f7c8fcf50 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:02.476609 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f312fdf-7e4d-4a27-aee0-2f5f7c8fcf50 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021595 Aug 27 21:02:02.476609 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1687/3277] 10.222.0.40 () {60 vars in 1148 bytes} [Sat Aug 27 21:02:02 2022] POST /compute/v2.1/servers => generated 2221 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 21:02:02.480974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7abcdfab-5232-42d4-b0b3-d43aedee72f7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1212 microversion: 2.1 time: 0.210455 Aug 27 21:02:02.481980 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1591/3278] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:02 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1212 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:02.505187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:02.505916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 62cb861a-c865-4bbc-885c-3c54a6dfc227] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:02.515603 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] HTTP exception thrown: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/62cb861a-c865-4bbc-885c-3c54a6dfc227/metadata/test2 HTTP/1.1 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': '62cb861a-c865-4bbc-885c-3c54a6dfc227', 'id': 'test2'} Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:02.517959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:02.523626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:02.523626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:02.523626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. Aug 27 21:02:02.523626 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:02.530040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 404 to user: Instance 62cb861a-c865-4bbc-885c-3c54a6dfc227 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:02.531533 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3ac122b-f001-43a8-9fd0-8290022d2e5b tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/62cb861a-c865-4bbc-885c-3c54a6dfc227/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.051867 Aug 27 21:02:02.532157 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1688/3279] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 21:02:02 2022] GET /compute/v2.1/servers/62cb861a-c865-4bbc-885c-3c54a6dfc227/metadata/test2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:02.546694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:02.547214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:02.554405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.555009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.555474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.556179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.556629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.557046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.593436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:02.594174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:02.607217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:02.609729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.610422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.611110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.613560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.616251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.616858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.730334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:02.740194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c5ce80d-679e-4a98-b533-8b9fb8fccb39 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "DELETE /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 204 len: 0 microversion: 2.1 time: 0.197886 Aug 27 21:02:02.743819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1592/3280] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:02 2022] DELETE /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:02.928265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:02.945641 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f77be647-d85f-459b-994c-67dee7554cda tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.357161 Aug 27 21:02:02.950044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1689/3281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:02 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:02.970107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:02.970886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:02.978892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.979650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.980274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:02.981967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:02.982644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:02.983215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.135098 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-442dce22-db20-4e0e-ab92-4772ba04bd05 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.391899 Aug 27 21:02:03.135910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1593/3282] 10.222.0.40 () {58 vars in 1128 bytes} [Sat Aug 27 21:02:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 21:02:03.145111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.150820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:03.168417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.169378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.169700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.170983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.174223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.174765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.364699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:03.385331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3427df59-09dc-4c04-9df2-f7e789210ec7 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1527 microversion: 2.1 time: 0.420497 Aug 27 21:02:03.388319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:03.388541 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1690/3283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:02 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1527 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:03.397854 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-402b0530-86ae-4f71-ae52-b5e436764629 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1485 microversion: 2.1 time: 0.260112 Aug 27 21:02:03.399720 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1594/3284] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:03 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1485 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:03.405427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6280178-2231-4b55-b1c9-2df1fd3899e4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Calling method '.version_select at 0x7ff857db9670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.453588 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b6280178-2231-4b55-b1c9-2df1fd3899e4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] HTTP exception thrown: Image not found. Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6280178-2231-4b55-b1c9-2df1fd3899e4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Request method failure captured: Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZKMAjeuHUTKFZBYe3tKnEhC77Tt5MHUDiVV6D76d46-LpAyj3Qjyk-saGDi2CyVkaD7qyWgaZgNf_r4g5_8PWMDhZAdutccAtoBQA0Kbxh0aG6Ifuk5Ox8vdi8P8Uz_VJA_d-qM3qlTA98X1Wu37O3znAl62REBdFc3gC4e3DhO6Q Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd1755b64e054c3eae79186fdf5b3d73", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}] Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 052b244aa7b3429a9c221ef13cb49300 Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '-1'} Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.456078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:02:03.460918 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.467025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6280178-2231-4b55-b1c9-2df1fd3899e4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:03.468206 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6280178-2231-4b55-b1c9-2df1fd3899e4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.076246 Aug 27 21:02:03.469032 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1691/3285] 10.222.0.40 () {58 vars in 1134 bytes} [Sat Aug 27 21:02:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:03.481418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17d08a5a-040c-4500-9011-57a8b949789e tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Calling method '.version_select at 0x7ff84efd3700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.502679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60390dea-3121-4319-bbe0-5e766e9b93ee", "name": "network-vif-deleted", "tag": "ca6d2afa-49c4-4f49-9c87-16286eaee9cd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:03.515684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.516327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.516783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.521651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:03.539862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-17d08a5a-040c-4500-9011-57a8b949789e tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] HTTP exception thrown: Image not found. Aug 27 21:02:03.541710 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] Creating event network-vif-deleted:ca6d2afa-49c4-4f49-9c87-16286eaee9cd for instance 60390dea-3121-4319-bbe0-5e766e9b93ee on nch2-master-1 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17d08a5a-040c-4500-9011-57a8b949789e tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Request method failure captured: Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/images/90079de5-9130-4f40-ba9d-c1bee945587j HTTP/1.1 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoZKMAjeuHUTKFZBYe3tKnEhC77Tt5MHUDiVV6D76d46-LpAyj3Qjyk-saGDi2CyVkaD7qyWgaZgNf_r4g5_8PWMDhZAdutccAtoBQA0Kbxh0aG6Ifuk5Ox8vdi8P8Uz_VJA_d-qM3qlTA98X1Wu37O3znAl62REBdFc3gC4e3DhO6Q Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd1755b64e054c3eae79186fdf5b3d73", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}] Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 052b244aa7b3429a9c221ef13cb49300 Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: exception: Image not found. Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '90079de5-9130-4f40-ba9d-c1bee945587j'} Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 90079de5-9130-4f40-ba9d-c1bee945587j to delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90079de5-9130-4f40-ba9d-c1bee945587j could not be found. Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.541851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17d08a5a-040c-4500-9011-57a8b949789e tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Returning 404 to user: Image not found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17d08a5a-040c-4500-9011-57a8b949789e tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/90079de5-9130-4f40-ba9d-c1bee945587j" status: 404 len: 62 microversion: 2.1 time: 0.067417 Aug 27 21:02:03.552794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1595/3286] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:03 2022] DELETE /compute/v2.1/images/90079de5-9130-4f40-ba9d-c1bee945587j => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:03.554733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.562954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-bfa71adf-14a2-4f9a-92d6-6970c6572ab8 req-b6a4367e-fb38-44ce-aea2-ed8ab046d698 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068681 Aug 27 21:02:03.564363 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1692/3287] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:02:03.569592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:03.570774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-124bc14d-1dea-4845-bb1f-e3bf8a11e0fd tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Calling method '.version_select at 0x7ff84dfd3b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.591315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-124bc14d-1dea-4845-bb1f-e3bf8a11e0fd tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] HTTP exception thrown: Image not found. Aug 27 21:02:03.593039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.593576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.594025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-124bc14d-1dea-4845-bb1f-e3bf8a11e0fd tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Request method failure captured: Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/d9ab7596-10b7-432a-8d15-c7257e640efe1 HTTP/1.1 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZKMAjeuHUTKFZBYe3tKnEhC77Tt5MHUDiVV6D76d46-LpAyj3Qjyk-saGDi2CyVkaD7qyWgaZgNf_r4g5_8PWMDhZAdutccAtoBQA0Kbxh0aG6Ifuk5Ox8vdi8P8Uz_VJA_d-qM3qlTA98X1Wu37O3znAl62REBdFc3gC4e3DhO6Q Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd1755b64e054c3eae79186fdf5b3d73", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}] Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 052b244aa7b3429a9c221ef13cb49300 Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd9ab7596-10b7-432a-8d15-c7257e640efe1'} Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d9ab7596-10b7-432a-8d15-c7257e640efe1 to delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d9ab7596-10b7-432a-8d15-c7257e640efe1 could not be found. Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.594587 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:02:03.599203 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.601082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.602271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-124bc14d-1dea-4845-bb1f-e3bf8a11e0fd tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:03.603652 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-124bc14d-1dea-4845-bb1f-e3bf8a11e0fd tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/d9ab7596-10b7-432a-8d15-c7257e640efe1" status: 404 len: 62 microversion: 2.1 time: 0.037592 Aug 27 21:02:03.604137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.604748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.605186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1693/3288] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:03 2022] DELETE /compute/v2.1/images/d9ab7596-10b7-432a-8d15-c7257e640efe1 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:03.618391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7bf4805f-9da4-4c33-9e2b-5d68288d59d4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Calling method '.version_select at 0x7ff84e01e9d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.650889 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7bf4805f-9da4-4c33-9e2b-5d68288d59d4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] HTTP exception thrown: Image not found. Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7bf4805f-9da4-4c33-9e2b-5d68288d59d4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Request method failure captured: Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/tempest-invalid-1999783873 HTTP/1.1 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZKMAjeuHUTKFZBYe3tKnEhC77Tt5MHUDiVV6D76d46-LpAyj3Qjyk-saGDi2CyVkaD7qyWgaZgNf_r4g5_8PWMDhZAdutccAtoBQA0Kbxh0aG6Ifuk5Ox8vdi8P8Uz_VJA_d-qM3qlTA98X1Wu37O3znAl62REBdFc3gC4e3DhO6Q Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd1755b64e054c3eae79186fdf5b3d73", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}] Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 052b244aa7b3429a9c221ef13cb49300 Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'tempest-invalid-1999783873'} Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1999783873 to delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1999783873 could not be found. Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.653145 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:02:03.657769 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.660676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7bf4805f-9da4-4c33-9e2b-5d68288d59d4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:03.661814 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7bf4805f-9da4-4c33-9e2b-5d68288d59d4 tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/tempest-invalid-1999783873" status: 404 len: 62 microversion: 2.1 time: 0.048859 Aug 27 21:02:03.663123 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1694/3289] 10.222.0.40 () {58 vars in 1206 bytes} [Sat Aug 27 21:02:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1999783873 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:02:03.673659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-032d10ca-45f5-4c65-bfa1-0841f298c16f tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Calling method '.version_select at 0x7ff84dfd3550>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.724324 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-032d10ca-45f5-4c65-bfa1-0841f298c16f tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] HTTP exception thrown: Image not found. Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-032d10ca-45f5-4c65-bfa1-0841f298c16f tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Request method failure captured: Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/images/49ec195a-3dca-4a5e-8573-66cd5ef94458 HTTP/1.1 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZKMAjeuHUTKFZBYe3tKnEhC77Tt5MHUDiVV6D76d46-LpAyj3Qjyk-saGDi2CyVkaD7qyWgaZgNf_r4g5_8PWMDhZAdutccAtoBQA0Kbxh0aG6Ifuk5Ox8vdi8P8Uz_VJA_d-qM3qlTA98X1Wu37O3znAl62REBdFc3gC4e3DhO6Q Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fd1755b64e054c3eae79186fdf5b3d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fd1755b64e054c3eae79186fdf5b3d73", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fd1755b64e054c3eae79186fdf5b3d73"}]}] Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: fd1755b64e054c3eae79186fdf5b3d73 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-123470085 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 052b244aa7b3429a9c221ef13cb49300 Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-123470085-project Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: exception: Image not found. Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '49ec195a-3dca-4a5e-8573-66cd5ef94458'} Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 49ec195a-3dca-4a5e-8573-66cd5ef94458 to delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49ec195a-3dca-4a5e-8573-66cd5ef94458 could not be found. Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.726678 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 21:02:03.733117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:03.740049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:03.740258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-032d10ca-45f5-4c65-bfa1-0841f298c16f tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] Returning 404 to user: Image not found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:03.741824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-032d10ca-45f5-4c65-bfa1-0841f298c16f tempest-ImagesDeleteNegativeTestJSON-123470085 tempest-ImagesDeleteNegativeTestJSON-123470085-project] 10.222.0.40 "DELETE /compute/v2.1/images/49ec195a-3dca-4a5e-8573-66cd5ef94458" status: 404 len: 62 microversion: 2.1 time: 0.072873 Aug 27 21:02:03.742649 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1695/3290] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:03 2022] DELETE /compute/v2.1/images/49ec195a-3dca-4a5e-8573-66cd5ef94458 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 21:02:03.748509 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f31355f5-f335-455a-894b-f4ae6d79a654 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1274 microversion: 2.1 time: 0.201902 Aug 27 21:02:03.749593 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1596/3291] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:03 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:03.974068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:03.974848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:03.986302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.986842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.989013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:03.989771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:03.990314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:03.992213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.161830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:04.174340 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dcf059f9-9e4f-4f8c-b61d-7c0a9fb4e029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.205306 Aug 27 21:02:04.175907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1696/3292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:03 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:04.411610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:04.412231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:04.426298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:04.427074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:04.433776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.434393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.443963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.444877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.445308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.445744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.446893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.447525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.448410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.450192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.450933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.453356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.496482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.497249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.497921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.498567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lazy-loading 'fault' on Instance uuid 60390dea-3121-4319-bbe0-5e766e9b93ee {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:04.555170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:04.569675 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8be0450a-683e-40f3-a246-70f0824238ce tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1315 microversion: 2.1 time: 0.145365 Aug 27 21:02:04.570753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1697/3293] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:04 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:04.737261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:04.747085 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6445bffe-4c60-4235-b9be-51c3e4ebe95a tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1527 microversion: 2.1 time: 0.339866 Aug 27 21:02:04.754458 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1597/3294] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:04 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1527 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:04.773197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:04.774288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:04.785310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.785881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.786351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:04.787371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:04.788544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:04.789556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.034901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:05.045250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff71f61c-e98d-4841-a139-8713fd34500e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.278628 Aug 27 21:02:05.046429 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1698/3295] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:04 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:05.200881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:05.201699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:05.210391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.211471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.213307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.216500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.218112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.218756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.464655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:05.474463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86d41ceb-c3bd-40b5-affa-b6b4b34e915d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.278148 Aug 27 21:02:05.495879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1598/3296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:05 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:05.585620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18086e2b-0ff7-49fe-b241-8361d827e8c9", "name": "network-vif-deleted", "tag": "5a83f09a-05ed-464a-9ecb-7206335a80ae"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:05.599792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.600733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:05.601058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.601382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:05.602165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.616735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.618128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.619037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.620152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.621335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.632539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.638098 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] Creating event network-vif-deleted:5a83f09a-05ed-464a-9ecb-7206335a80ae for instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 on nch1-master-1 Aug 27 21:02:05.644664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c634b6dc-6ea7-42d9-a721-029be62c0f06 req-d8d2f6c5-cc43-4d50-b558-55c4a5ae4c09 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062607 Aug 27 21:02:05.646295 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1699/3297] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:05.693070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.694205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.694806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.695608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lazy-loading 'fault' on Instance uuid 60390dea-3121-4319-bbe0-5e766e9b93ee {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:05.760549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da647a9ce7fd44759e559814732f8dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4abb45086384f358cc2af6eb4fcabcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:05.770858 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac6999a2-4c1a-4301-a326-87f6a93041a2 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 200 len: 1315 microversion: 2.1 time: 0.182380 Aug 27 21:02:05.773673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1599/3298] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:05 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:05.794991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:05.796723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:05.818877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.819435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.819882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.820613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.821065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.821488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.867728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:05.868296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:05.869113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:05.869739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lazy-loading 'fault' on Instance uuid 18086e2b-0ff7-49fe-b241-8361d827e8c9 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:05.928333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c7dd55f8d624d9596d8278719ed3422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3612cb2a9d14e00a40bbae087ddc9ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:05.938194 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3f22ce4-d8d0-4346-aea2-576403542683 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 200 len: 1314 microversion: 2.1 time: 0.160378 Aug 27 21:02:05.950183 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1700/3299] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:05 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:06.074933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:06.076189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:06.088596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.089722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.092798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.094044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.096043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.096318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.408105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:06.426519 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0df1cf84-3f0e-400a-9376-84510417f2af tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.360981 Aug 27 21:02:06.427581 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1600/3300] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:06 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:06.500668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:06.501732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:06.514902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.515811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.517330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.519190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.520238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.523695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.754872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:06.765460 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27c966fe-65b4-451e-bac8-9dceefc720ef tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.270856 Aug 27 21:02:06.766533 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1701/3301] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:06 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:06.797892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:06.798554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] [instance: 60390dea-3121-4319-bbe0-5e766e9b93ee] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:06.806986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.807725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.808254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.809029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.809856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.810421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.829235 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] HTTP exception thrown: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Request method failure captured: Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee HTTP/1.1 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYyLunV00kfa4GFCyyz4gFVvfAFzaJkkpyShthmudcgg8VzR1rdwD7sYR9xZ66nZE2a_2aUmyAwcYMgQRsIE-qX6RhDFHtBIrcDscs1vfsTmO_Iy5O7TqVk_Umt6xxikEn3hxk8A6fn8d-6KuUcdb8J-QNz_WE9LNRUBjY0zGw363c Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b4abb45086384f358cc2af6eb4fcabcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b4abb45086384f358cc2af6eb4fcabcd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b4abb45086384f358cc2af6eb4fcabcd"}]}] Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b4abb45086384f358cc2af6eb4fcabcd Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-924855898 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: da647a9ce7fd44759e559814732f8dc4 Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-924855898-project Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '60390dea-3121-4319-bbe0-5e766e9b93ee'} Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:06.831037 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] Returning 404 to user: Instance 60390dea-3121-4319-bbe0-5e766e9b93ee could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b01fe65-624a-4e67-b681-b4592f50fc22 tempest-ServerAddressesNegativeTestJSON-924855898 tempest-ServerAddressesNegativeTestJSON-924855898-project] 10.222.0.40 "GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee" status: 404 len: 111 microversion: 2.1 time: 0.041463 Aug 27 21:02:06.837060 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1601/3302] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:06 2022] GET /compute/v2.1/servers/60390dea-3121-4319-bbe0-5e766e9b93ee => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:06.965810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:06.967256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] [instance: 18086e2b-0ff7-49fe-b241-8361d827e8c9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:06.979074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.981489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.981686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:06.983289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:06.993504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:06.994023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:07.015401 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] HTTP exception thrown: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Request method failure captured: Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 HTTP/1.1 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoY0eif1AiLtyzgZFL8zUvuqwAZGLJAaxq1Cj8uxd2VuARhzskJhhyjfb-x_VtEXy1U5xjEkue5GrD71FodXi8ef5CYpVTGnodRoF2_KqTpwqb8uNV9pEpeO5BvPsbl2dT5j7kHpHDxTDp-N1erWomGCv4xOGSoYPSbs4LSPygy6ZvU Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b3612cb2a9d14e00a40bbae087ddc9ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b3612cb2a9d14e00a40bbae087ddc9ca", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b3612cb2a9d14e00a40bbae087ddc9ca"}]}] Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: b3612cb2a9d14e00a40bbae087ddc9ca Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1745169374 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1c7dd55f8d624d9596d8278719ed3422 Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1745169374-project Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '18086e2b-0ff7-49fe-b241-8361d827e8c9'} Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:07.020856 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. Aug 27 21:02:07.026740 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:07.030187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] Returning 404 to user: Instance 18086e2b-0ff7-49fe-b241-8361d827e8c9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:07.031639 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aface5fe-b421-462e-a4c4-224e67b153b3 tempest-ServerMetadataNegativeTestJSON-1745169374 tempest-ServerMetadataNegativeTestJSON-1745169374-project] 10.222.0.40 "GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9" status: 404 len: 111 microversion: 2.1 time: 0.071846 Aug 27 21:02:07.032820 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1702/3303] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:06 2022] GET /compute/v2.1/servers/18086e2b-0ff7-49fe-b241-8361d827e8c9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:07.453578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:07.454640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:07.461688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:07.462482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:07.463152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:07.464151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:07.464827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:07.465769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:07.665535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e502482c-51ce-4a6f-943e-d35285835a51", "tag": "19f1011f-4218-4984-b3ae-e22d097ca0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:07.678325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:07.679327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:07.680197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:07.696940 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] Creating event network-changed:19f1011f-4218-4984-b3ae-e22d097ca0a0 for instance e502482c-51ce-4a6f-943e-d35285835a51 on nch2-master-1 Aug 27 21:02:07.704764 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b8f8e3f1-cb1a-42f7-8b6d-e2ed4821da6d req-7a90508f-bd15-4ce9-9f0a-53752a508760 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043284 Aug 27 21:02:07.706183 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1703/3304] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:02:07.743619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:07.758815 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-74364559-3263-4d71-b8ed-d322ee389a80 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.309670 Aug 27 21:02:07.775803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1602/3305] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:07 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:07.789160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:07.790602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:07.801500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:07.802982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:07.803603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:07.804716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:07.805163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:07.805702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:08.395808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a504e37-49a2-4686-8619-e1156d9a2e20 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1df280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:08.466427 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a504e37-49a2-4686-8619-e1156d9a2e20 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954" status: 200 len: 662 microversion: 2.1 time: 0.075701 Aug 27 21:02:08.471395 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1603/3306] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:08 2022] GET /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954 => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:08.484662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec0d3128-3b39-4a85-b6ef-596bba92584f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857c68ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:08.533153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:08.545291 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b10550d3-a653-466e-b6dd-dc021f2c40bb tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.760724 Aug 27 21:02:08.546379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1704/3307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:07 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:08.557124 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec0d3128-3b39-4a85-b6ef-596bba92584f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954" status: 200 len: 662 microversion: 2.1 time: 0.076077 Aug 27 21:02:08.558445 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1604/3308] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:08 2022] GET /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:02:08.565698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b783eb6d-d028-4826-82fc-24b26bfa2983", "name": "network-vif-plugged", "status": "completed", "tag": "8fc6b094-a266-415d-b5ca-b5ef78ca7c69"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:08.604374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:08.604902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:08.605343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:08.634199 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] Creating event network-vif-plugged:8fc6b094-a266-415d-b5ca-b5ef78ca7c69 for instance b783eb6d-d028-4826-82fc-24b26bfa2983 on nch2-master-1 Aug 27 21:02:08.647371 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6244c3b5-e6b6-4f35-b8bd-eed3e70588b3 req-7a5279f6-36d7-4cce-904b-cadacccfadc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099416 Aug 27 21:02:08.654713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1705/3309] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:08.782996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:08.784132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:08.792572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:08.793126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:08.794514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:08.798963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:08.799702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:08.800147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:09.107442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:09.130417 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6970bdb4-760a-4412-b5da-2bf1ba00617b tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.345478 Aug 27 21:02:09.131334 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1605/3310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:08 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:09.582311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:09.582903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:09.601256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:09.602644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:09.603739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:09.605434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:09.606680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:09.608014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:10.092123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:10.101534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eeb69669-fbdb-4876-8b21-f8b0b36abf43 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.528132 Aug 27 21:02:10.102075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1706/3311] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:09 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:10.152182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:10.153210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:10.168574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:10.169379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:10.170034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:10.170785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:10.171308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:10.171780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:10.223232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:10.651561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:10.666455 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ed3e76d-6f58-4a96-8170-00942aaa0027 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.518061 Aug 27 21:02:10.667584 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1606/3312] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:10 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:10.991942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae054178-05f2-4eef-8040-e034201f90f1 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84dfd3790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:11.077132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae054178-05f2-4eef-8040-e034201f90f1 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f" status: 200 len: 661 microversion: 2.1 time: 0.090940 Aug 27 21:02:11.078400 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1707/3313] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:10 2022] GET /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:11.092183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c80f3e9b-5683-490c-9a94-fdb3c908d92f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857cdf280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:11.098658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:11.100117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:11.124654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:11.125433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:11.141708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:11.142311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:11.142844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:11.143685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:11.144238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:11.144781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:11.150717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c80f3e9b-5683-490c-9a94-fdb3c908d92f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f" status: 200 len: 661 microversion: 2.1 time: 0.062573 Aug 27 21:02:11.151960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1607/3314] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:11 2022] GET /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f => generated 661 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:11.249434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:11.502390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:11.511014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-784c21f8-0d64-4fbc-893f-f820cb81d27c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.392491 Aug 27 21:02:11.512478 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1708/3315] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:11 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:11.691990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:11.692742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:11.708557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:11.709122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:11.710221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:11.710962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:11.711446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:11.714616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:11.983090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:12.016606 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e71ec92e-740a-4afb-b7ea-f06b286bc25d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.322275 Aug 27 21:02:12.032501 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1608/3316] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:11 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:12.533709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:12.534569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:12.546788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:12.547959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:12.548427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:12.549161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:12.549625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:12.550086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:13.040755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:13.041396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:13.050003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:13.066920 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca772122-3906-42cd-b4d2-6256d708de27 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1308 microversion: 2.1 time: 0.537042 Aug 27 21:02:13.073131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:13.076932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1709/3317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:12 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1308 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:13.077324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:13.080447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:13.083196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:13.084099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:13.084735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:13.440539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:13.453283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd4028a9-3d87-4255-87f2-db4188403ae7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.417400 Aug 27 21:02:13.465556 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1609/3318] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:13 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:13.488051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a563d739-99cd-4cc1-a486-ad6c3c4f82be tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84dfd3700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:13.540753 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a563d739-99cd-4cc1-a486-ad6c3c4f82be tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0" status: 200 len: 662 microversion: 2.1 time: 0.056222 Aug 27 21:02:13.542410 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1710/3319] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:13 2022] GET /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:13.557498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f32b211b-206a-42a0-89f3-8f059ce19ba0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1dd310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:13.621758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f32b211b-206a-42a0-89f3-8f059ce19ba0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0" status: 200 len: 662 microversion: 2.1 time: 0.069336 Aug 27 21:02:13.623267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1610/3320] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:13 2022] GET /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0 => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:13.803554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-170691598", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:13.880271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] validate_networks() for None {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:02:14.100900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:14.101882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:14.112615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.114523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.115375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.116531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.117390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.118484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.452192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:02:14.452750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:02:14.453352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:02:14.453854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:02:14.454372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:02:14.464178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.464746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.465483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.466656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.467364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.467843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.472717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:14.486731 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-43807127-096a-4e11-8ab2-5eee38b285e1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1490 microversion: 2.1 time: 0.391702 Aug 27 21:02:14.488588 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1611/3321] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:14 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1490 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:14.495984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Getting quotas for project f7aafa82d7904f0aa64297caa208d731. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:02:14.498177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:14.499065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:14.502889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:14.509330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Getting quotas for user 2bfeec4f9c624115a4500998cd5715d7 and project f7aafa82d7904f0aa64297caa208d731. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:02:14.511297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.512242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.513099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.514565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.516391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.517003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.540064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:02:14.546693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:02:14.638324 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7458ac71-e66b-477b-9fbf-c4074e2ba934 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838395 Aug 27 21:02:14.639729 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1711/3322] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:02:14.649686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-458870096"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:14.654593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:14.664230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.665264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.666336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.667271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.668019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.669397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.832251 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76302952-7fe3-495a-a540-5592c1492f06 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "PUT /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1075 microversion: 2.1 time: 0.191183 Aug 27 21:02:14.833224 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1712/3323] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:02:14 2022] PUT /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1075 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:14.854932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:14.855983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:14.882270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.882990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.883479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.884229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:14.885100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:14.888214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:14.888866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:14.897763 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a572164e-282c-408e-92d0-4150d96c1582 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.407907 Aug 27 21:02:14.898751 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1612/3324] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:14 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:14.909563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-171829979", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:15.018271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:02:15.247791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:15.257451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76b5a966-43e4-4b05-9b2d-2bcf0270baaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1501 microversion: 2.1 time: 0.406651 Aug 27 21:02:15.275422 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1713/3325] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:14 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1501 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:15.283634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e502482c-51ce-4a6f-943e-d35285835a51", "name": "network-vif-plugged", "status": "completed", "tag": "19f1011f-4218-4984-b3ae-e22d097ca0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:15.304005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.304772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.305574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.386365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:02:15.387446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:02:15.388447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:02:15.389046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:02:15.389630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:02:15.407914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.409204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.411206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.412330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.414702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.415484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.477818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Getting quotas for project f7aafa82d7904f0aa64297caa208d731. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:02:15.489539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Getting quotas for user 2bfeec4f9c624115a4500998cd5715d7 and project f7aafa82d7904f0aa64297caa208d731. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:02:15.533934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:02:15.539232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:02:15.663692 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf34f8fd-e23d-49fe-9623-463cdfe6cf02 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760891 Aug 27 21:02:15.664448 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1613/3326] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:02:15.682334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:15.684346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:15.695150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.696279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.696873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.697754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.698906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.699727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.792081 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] Creating event network-vif-plugged:19f1011f-4218-4984-b3ae-e22d097ca0a0 for instance e502482c-51ce-4a6f-943e-d35285835a51 on nch2-master-1 Aug 27 21:02:15.800369 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8ce5e71b-846f-4581-94f2-30160f35bb9c req-11c206fc-57c5-4394-81ac-5b00caec4df7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.521679 Aug 27 21:02:15.801637 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1714/3327] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:15.807773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd539721-a8c4-45fb-84ea-7fed674ae400 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:15.808886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd539721-a8c4-45fb-84ea-7fed674ae400 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:15.936041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bd539721-a8c4-45fb-84ea-7fed674ae400 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:15.948314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd539721-a8c4-45fb-84ea-7fed674ae400 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1217 microversion: 2.1 time: 0.144896 Aug 27 21:02:15.950685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1715/3328] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:15 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:15.962245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:15.963996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:15.980569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.981004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.981441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:15.982153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:15.982608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:15.983028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:16.022573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:16.032585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e58218aa-d844-48dc-a819-b7ff309111fa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1501 microversion: 2.1 time: 0.367001 Aug 27 21:02:16.035477 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1614/3329] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:15 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:16.057964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:16.098748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:16.103072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:16.109185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:16.187518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Going to try to stop instance {{(pid=140433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:02:16.274404 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34b90dee-0867-440d-bbf5-ce279e451392 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "POST /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983/action" status: 202 len: 0 microversion: 2.1 time: 0.221692 Aug 27 21:02:16.275978 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1615/3330] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:16 2022] POST /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:16.285296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:16.286416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:16.304256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:16.306883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:16.309512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:16.310479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:16.313171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:16.313897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:16.407432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:16.421848 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe4e26cc-131f-4477-99b1-219f1e4aa823 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.469802 Aug 27 21:02:16.426431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1716/3331] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:15 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:16.593735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:16.605808 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ec732f8-57c1-44d4-844e-b2867340dc34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.324628 Aug 27 21:02:16.606652 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1616/3332] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:16 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:16.973291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:16.974631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:17.006534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.007819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.010153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.018432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.022232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.024208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.217664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:17.242414 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54d911de-82c6-4341-8390-20aaf93da508 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1269 microversion: 2.1 time: 0.275162 Aug 27 21:02:17.246451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1717/3333] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:16 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:17.448091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:17.448887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:17.459305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.460209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.460880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.462322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.462976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.463656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.636333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:17.637330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:17.669323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.669831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.670280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.671015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:17.671515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:17.671959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:17.683461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:17.870823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:17.879651 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6d42667-ffb2-49bf-a1e6-1a0374559897 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1316 microversion: 2.1 time: 0.436630 Aug 27 21:02:17.880307 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1617/3334] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:17 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:18.272627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:18.278000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:18.284151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:18.291564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6ce8837-be87-4ea6-83eb-7d2360dfb826 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.657824 Aug 27 21:02:18.294208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1718/3335] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:17 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:18.319397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:18.319938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:18.320377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:18.321096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:18.321549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:18.321974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:18.456435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:18.471585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce5c3752-2393-4124-aeef-f5f4e99f8cbf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1275 microversion: 2.1 time: 0.203344 Aug 27 21:02:18.486782 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1618/3336] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:18 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:18.906623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:18.907722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:18.919553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:18.920428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:18.921151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:18.922328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:18.923116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:18.923830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.240023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:19.252106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-286d92c8-bc2f-4782-9d52-29513f7f91b0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1504 microversion: 2.1 time: 0.355733 Aug 27 21:02:19.253441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1719/3337] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:18 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:19.274234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-500994698"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:19.275214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:19.283545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.284209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.285102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.286294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.287283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.288195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.318865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:19.320291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:19.330676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.331185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.331737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.332458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.332954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.336372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.743670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.network.security_group_api [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Adding security group d23cf84a-6a7d-4878-8e96-2398005c9b19 to port 19f1011f-4218-4984-b3ae-e22d097ca0a0 Aug 27 21:02:19.835070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:19.848193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1da32330-261b-42ed-a090-cf781e163921 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.534474 Aug 27 21:02:19.848904 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1720/3338] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:19 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:19.872501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:19.873700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:19.888502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.888502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.888728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:19.889461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:19.895813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:19.896596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:20.746997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:20.759798 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68dfae76-2518-4dc0-8fcf-5b4fef6847ed tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.909399 Aug 27 21:02:20.772181 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1721/3339] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:19 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:20.879775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:20.881725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:20.910669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:20.913125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:20.914947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:20.917393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:20.919094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:20.922934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:21.455060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:21.473025 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e6eef66-86e1-4688-b2a2-3a787e2c59d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.597278 Aug 27 21:02:21.477882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1722/3340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:20 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:21.766433 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b98bf8af-7a7f-4c57-8eb6-eda0ae63f534 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action" status: 202 len: 0 microversion: 2.1 time: 2.496376 Aug 27 21:02:21.774208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1619/3341] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:19 2022] POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action => generated 0 bytes in 2500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:21.778949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e502482c-51ce-4a6f-943e-d35285835a51", "tag": "19f1011f-4218-4984-b3ae-e22d097ca0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:21.787942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e6d00d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:21.837039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:21.844308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:21.845153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:21.885265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] Creating event network-changed:19f1011f-4218-4984-b3ae-e22d097ca0a0 for instance e502482c-51ce-4a6f-943e-d35285835a51 on nch2-master-1 Aug 27 21:02:21.900523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-85735d6a-ebe7-4ae2-bcd4-71ba2735aac9 req-ba84acaa-4c9f-4730-a966-642d5dec03a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129978 Aug 27 21:02:21.901912 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1723/3342] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:21.908333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:21.912060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:21.921238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:21.922566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:21.923279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:21.924377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:21.925047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:21.925913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.148500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use.", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:22.149416 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.149416 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19 HTTP/1.1 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: exception: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'd23cf84a-6a7d-4878-8e96-2398005c9b19'} Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:22.153399 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] Aug 27 21:02:22.158728 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:22.164385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 400 to user: Security Group d23cf84a-6a7d-4878-8e96-2398005c9b19 in use. Aug 27 21:02:22.164385 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-8189da11-6de1-4768-8783-a578b61893e0'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:22.165899 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8faf6193-2e3c-4f21-8756-4a2d83e28402 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19" status: 400 len: 185 microversion: 2.1 time: 0.389297 Aug 27 21:02:22.169952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:22.175241 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1620/3343] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:21 2022] DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19 => generated 185 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:02:22.202091 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d1c011e-6a3b-4985-80c8-72a58ea37d6d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.298581 Aug 27 21:02:22.208775 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1724/3344] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:21 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:22.217518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:22.222091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:22.264982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.267512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.268014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.270841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.271332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.275292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.439298 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-93ddb977-ae22-4e3a-9cea-390ec2fe90aa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action" status: 202 len: 0 microversion: 2.1 time: 0.259148 Aug 27 21:02:22.441036 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1621/3345] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:22 2022] POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:22.460975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:22.465454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:22.500503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:22.501614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:22.505320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.508544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.509099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.513444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.516112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.519103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.520001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.520889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.523156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.525553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.526317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.528314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.886255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:22.895400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1fb6a228-5907-4b8e-abea-92f286ff6aaf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.400731 Aug 27 21:02:22.919721 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1622/3346] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:22 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:22.927248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:22.947519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:22.948003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:22.948432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:22.962516 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] Creating event network-changed:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:02:22.968609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2d5c6722-c439-42c8-99cd-d30da8159f6e req-f4a3cf32-b4fd-4161-9e0a-e32ead53581b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047542 Aug 27 21:02:22.969265 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1623/3347] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:23.076077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:23.094201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66e33042-df97-4d4a-9c6a-bb29ba5aca79 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1574 microversion: 2.1 time: 0.647559 Aug 27 21:02:23.096208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1725/3348] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:22 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1574 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:23.240436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:23.245017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:23.258202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:23.261281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:23.262571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:23.266910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:23.268150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:23.272230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:23.643746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:23.665439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c85a63de-1ae3-4b71-809c-048caac69802 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.434652 Aug 27 21:02:23.681494 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1624/3349] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:23 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:23.923293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:23.925683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:23.940751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:23.942093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:23.942669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:23.943785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:23.944376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:23.945061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:24.123107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:24.124546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:24.134450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:24.135250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:24.137039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:24.139006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:24.140031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:24.141056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:24.247540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:24.388123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:24.400319 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5506ae65-3116-4ed0-b4de-637363d7da9e tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.485928 Aug 27 21:02:24.400930 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1726/3350] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:23 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:24.596741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:24.608704 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d6e8321-6b92-43e2-bb82-f5c786c72158 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1574 microversion: 2.1 time: 0.491220 Aug 27 21:02:24.610169 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1625/3351] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:24 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1574 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:24.692463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:24.693090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:24.695200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:24.705599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:24.706109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:24.706557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:24.707277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:24.707843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:24.708475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.130550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:25.155516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54bcc395-96ee-4a5e-9d91-b6dd97f540e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.466869 Aug 27 21:02:25.156395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1727/3352] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:24 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:25.191600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26f92d3-aec4-4977-a112-8836503fee29", "tag": "e02cb11d-ed68-4f6c-bbb7-80ef86392ad0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:25.217713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:25.219102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:25.219752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.245170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] Creating event network-changed:e02cb11d-ed68-4f6c-bbb7-80ef86392ad0 for instance e26f92d3-aec4-4977-a112-8836503fee29 on nch1-master-1 Aug 27 21:02:25.250959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8801462f-1e75-4874-bfce-633bdda3fb26 req-d52bf93b-540a-4459-a60c-00380dee0722 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063186 Aug 27 21:02:25.252416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1626/3353] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:25.423765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:25.426058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:25.433673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:25.434522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:25.436374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.439447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:25.440190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:25.440852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.630228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:25.631941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:25.637330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:25.642418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:25.664867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:25.665762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:25.666581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.667524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:25.668960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:25.669576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:25.946132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:26.349235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:26.376453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14586a0b-bb64-4892-beab-a5038431d65d tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.955568 Aug 27 21:02:26.377684 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1728/3354] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:25 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:26.385739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:26.387771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:26.390368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:26.404494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90ef7560-296d-4add-bf7b-cc43d5e3f922 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1574 microversion: 2.1 time: 0.775649 Aug 27 21:02:26.408497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:26.411965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1627/3355] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:25 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1574 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:26.412708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:26.413319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:26.414283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:26.415172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:26.415978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:26.949549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:26.960778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e6ef59b-3f4a-4824-a042-b85425b32b37 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.580494 Aug 27 21:02:26.966899 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1729/3356] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:26 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:27.400581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:27.401671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:27.412698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:27.413199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:27.413636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:27.414343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:27.420311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:27.420838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:27.711599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1269261888", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "565c95dd-495c-464f-87ab-8a955f129a3a"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:27.836709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:27.848221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b8829df8-a311-4799-bd08-824e3cfa51d6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.451522 Aug 27 21:02:27.852807 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1730/3357] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:27 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:27.866526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:27.867463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:27.874765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] validate_networks() for [('565c95dd-495c-464f-87ab-8a955f129a3a', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:02:27.883857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:27.883857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:27.884325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:27.888463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:27.889127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:27.889986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:28.704217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:28.712881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d7be1af7-bf46-4420-97ac-f1428d870089 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1572 microversion: 2.1 time: 0.858692 Aug 27 21:02:28.713485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1731/3358] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:27 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1572 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:28.725132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:28.725745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:28.751148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:28.754181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:28.755657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:28.759517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:28.760204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:28.760816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:28.825295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:02:28.825797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:02:28.826530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:02:28.827158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:02:28.828726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:02:28.856695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:28.860044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:28.860784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:28.861799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:28.862520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:28.864039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:28.912810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Getting quotas for project 136abad8ea774a4db9af7e1d0b9f8de4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:02:28.962340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Getting quotas for user e6e48795106941ff8b9c17f8676ae307 and project 136abad8ea774a4db9af7e1d0b9f8de4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:02:29.019211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:02:29.030313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:02:29.099707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:29.109607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b84c2a22-c98b-4624-91bc-6a04d5d5b51f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.394269 Aug 27 21:02:29.124037 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1732/3359] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:28 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:29.132536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2052465120"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:29.143523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:29.150787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:29.152534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:29.153395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:29.154369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:29.155040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:29.155930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:29.156073 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ae4c7bc-597b-4f2b-a003-ef8a8337f516 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917967 Aug 27 21:02:29.158885 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1628/3360] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:02:29.174447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:29.176499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:29.204813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:29.206430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:29.207074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:29.208072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:29.209330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:29.211098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:29.501721 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.network.security_group_api [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Adding security group 70c1412c-7d75-4fab-8a99-17243681c4ec to port 19f1011f-4218-4984-b3ae-e22d097ca0a0 Aug 27 21:02:29.606762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:29.625828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef3764a3-265e-4ba9-ab62-90d504e45a6a tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.465471 Aug 27 21:02:29.626432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1629/3361] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:29 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:29.638297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-548515c0-0e6b-45f7-8865-d6e380f89823 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:29.638932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-548515c0-0e6b-45f7-8865-d6e380f89823 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:29.803551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-548515c0-0e6b-45f7-8865-d6e380f89823 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:29.829833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-548515c0-0e6b-45f7-8865-d6e380f89823 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1216 microversion: 2.1 time: 0.197105 Aug 27 21:02:29.847478 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1630/3362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:29 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1216 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:30.137684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:30.138952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:30.157258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.158124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.159397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.166484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.169454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.170988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.650845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:30.664653 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-733dbded-92c4-4443-ac92-357fd210447f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.532900 Aug 27 21:02:30.667740 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1631/3363] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:30 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:30.685881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:30.693755 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f0d13e2-87aa-4268-ab5f-46fcd60aa185 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action" status: 202 len: 0 microversion: 2.1 time: 1.568227 Aug 27 21:02:30.694875 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1733/3364] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:29 2022] POST /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51/action => generated 0 bytes in 1570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:30.698516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:30.701701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Searching by: {'deleted': False, 'project_id': '7599dfd7db2647bf8f986bffd781b87d'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:02:30.704930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:30.706889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:30.717116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.717457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.719426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.721258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.724072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.724820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.728109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.729007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.729594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.732509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:30.735160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:30.735962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:30.785777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:02:30.849698 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec5dd060-15d3-4b70-9d24-7fd67faec761 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.180005 Aug 27 21:02:30.874492 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1632/3365] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:02:30 2022] GET /compute/v2.1/servers => generated 344 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:30.891468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff857cb1e50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.193122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:31.208516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91b83e6b-2b38-4d6b-acc9-46e5e6a57bfa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.511758 Aug 27 21:02:31.210833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1734/3366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:30 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:31.229273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e502482c-51ce-4a6f-943e-d35285835a51", "tag": "19f1011f-4218-4984-b3ae-e22d097ca0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:31.256068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.257894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.258344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.293125 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] Creating event network-changed:19f1011f-4218-4984-b3ae-e22d097ca0a0 for instance e502482c-51ce-4a6f-943e-d35285835a51 on nch2-master-1 Aug 27 21:02:31.305543 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-da950cd0-6568-4aca-94e8-f725af77348d req-1c2d5e4a-52c5-4f63-8402-a30be26dee39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089175 Aug 27 21:02:31.309160 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1735/3367] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:31.320200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.324998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:31.341827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.347700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use.", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:31.348654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.348654 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec HTTP/1.1 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: exception: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '70c1412c-7d75-4fab-8a99-17243681c4ec'} Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:31.350992 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] Aug 27 21:02:31.356271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:31.359204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.359204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.360484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 400 to user: Security Group 70c1412c-7d75-4fab-8a99-17243681c4ec in use. Aug 27 21:02:31.360484 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c1de39a9-adb8-4fe7-ad67-040c305421f6'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:31.360774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.360774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.360974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df23b21f-8f4e-4e29-8375-5ea4fdee722c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec" status: 400 len: 185 microversion: 2.1 time: 0.477420 Aug 27 21:02:31.361066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.361166 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1633/3368] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:30 2022] DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec => generated 185 bytes in 480 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:02:31.363604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.374631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:31.375796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Searching by: {'deleted': False, 'project_id': '7599dfd7db2647bf8f986bffd781b87d'} {{(pid=140433) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:02:31.379717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:31.383033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.384112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.384753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.385702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.386563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.387395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.400296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:31.482155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.multi_cell_list [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140433) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:02:31.530350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:31.539704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.540233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.540731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.546276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:31.557451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9a96b99-0113-4fc2-9417-36d077068c96 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1268 microversion: 2.1 time: 0.247082 Aug 27 21:02:31.558855 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1736/3369] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:31 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:31.578803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.579921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:31.588642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.590096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.591279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.592317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.594642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.595491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.631134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:31.795319 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef56611c-fa84-4118-a042-b823726d9a41 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.438925 Aug 27 21:02:31.797154 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1634/3370] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:02:31 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:31.802977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.804002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:31.821399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.825235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.825835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.826703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.827916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.842233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.897268 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3788be0a-f87a-4749-960e-ab49a1072529 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 204 len: 0 microversion: 2.1 time: 0.336795 Aug 27 21:02:31.897845 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1737/3371] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:31 2022] DELETE /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:31.906408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b88595f-7252-45c8-8ee8-e2674ab4dd66 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.924429 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b88595f-7252-45c8-8ee8-e2674ab4dd66 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025043 Aug 27 21:02:31.935895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1738/3372] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:02:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:31.942088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:31.943433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:31.952789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.953693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.954534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:31.956182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:31.957284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:31.957934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.176307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:32.200659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7baf64a3-94c0-4b4b-9a4d-4c0320e50c47 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.402014 Aug 27 21:02:32.207012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1635/3373] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:31 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:32.245784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:32.246959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:32.264667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.265449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.266081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.267193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.268019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.268614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.475323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:32.487473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-501631b1-7274-4999-996b-97bc31a148b9 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1647 microversion: 2.1 time: 0.549261 Aug 27 21:02:32.494444 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1739/3374] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:31 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1647 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:32.510134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:32.511358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:32.525185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.527578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.530786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.531741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.532766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.533218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.607921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:32.727998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:32.746619 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdd98505-4647-40e2-acb9-9ed2befaba45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.513067 Aug 27 21:02:32.748058 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1636/3375] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:32 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:32.757916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:32.758892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:32.774676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.775675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.776317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.777566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.778302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.779700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.864516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 204 len: 0 microversion: 2.1 time: 0.367801 Aug 27 21:02:32.865954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1740/3376] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:32 2022] DELETE /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:32.879794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-plugged", "status": "completed", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:32.905231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.905959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.906260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.922559 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] Creating event network-vif-plugged:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:02:32.940960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-556dbf28-6523-474c-8684-b273544dcd01 req-bce711bc-7f49-470b-9d40-4fc193e42b43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069324 Aug 27 21:02:32.941769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1741/3377] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:32.949332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:32.954720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:32.971212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:32.972425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.973178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.974171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.976306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:32.977121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:32.977832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:32.983713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5526aa7d-5877-4183-b989-80bd5cd8f1be tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1276 microversion: 2.1 time: 0.233034 Aug 27 21:02:32.985499 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1637/3378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:32 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:33.186447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:33.195219 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15c4c2c4-2a9d-47b8-853f-3a8211c5da48 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1608 microversion: 2.1 time: 0.251848 Aug 27 21:02:33.196339 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1742/3379] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:32 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1608 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:33.234610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:33.235208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:33.246729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.247572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.248770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.250420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.251124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.251744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.481262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:33.516569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:33.517582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:33.519361 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-666d4703-e04b-4d6a-a7b3-9a909c364cec tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.287640 Aug 27 21:02:33.521733 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1638/3380] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:33 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:33.536376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.538592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.543194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.544006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.544490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.544932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.775008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:33.784395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:33.797576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.798275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.800807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.804184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:33.806841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:33.807934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:33.861642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:33.874549 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b2127a31-abc0-4e1e-a254-396e24675a89 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1647 microversion: 2.1 time: 0.362396 Aug 27 21:02:33.875460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1743/3381] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:33 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1647 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:34.008702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:34.010085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:34.020884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.024017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.030332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.038953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.047389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:34.053445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.054564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.056551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-229a2946-5247-4e65-b9e5-930634ed22a2 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.287198 Aug 27 21:02:34.057141 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1639/3382] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:33 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:34.198049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:34.210796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-405fb9a0-163e-4382-9570-c51076271144 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1274 microversion: 2.1 time: 0.207163 Aug 27 21:02:34.212520 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1744/3383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:34 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:34.219516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:34.220455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:34.229844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.234044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.234766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.238863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.238863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.241362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.542957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:34.543631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:34.559422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.559940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.560397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.567639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.568051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.568503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.619451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:34.630512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-228845c8-49e5-423a-95e8-441d4ecb9399 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1608 microversion: 2.1 time: 0.416919 Aug 27 21:02:34.636061 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1640/3384] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:34 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1608 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:34.826173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:34.837295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fd02d3ac-09fd-4848-9650-8ed2578f2e07 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.298938 Aug 27 21:02:34.852053 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1745/3385] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:34 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:34.882879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2131357875", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:34.896427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:34.897377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:34.907644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.912110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.912581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.920860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:34.921371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:34.921825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:34.978331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] validate_networks() for [('150feae6-2392-40c3-b3a2-d063bbe48630', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:02:35.655076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:35.664863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c406dd95-9fd1-4ad3-b110-e54b98d0afe7 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1647 microversion: 2.1 time: 0.772696 Aug 27 21:02:35.668471 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1746/3386] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:34 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1647 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:35.685659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:35.686639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:35.700551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:35.703890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:35.705298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:35.706407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:35.709856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:35.710507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:36.010214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:36.022569 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37db1824-7266-49b5-b13e-d941b3ad2354 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.352725 Aug 27 21:02:36.023174 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1747/3387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:35 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:36.038407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:36.042148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:36.059615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:36.062746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:36.064312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:36.065547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:36.066022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:36.069854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.056214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:37.086689 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-052ce8a5-ccd3-4e1c-bdb7-30746fc88d84 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1274 microversion: 2.1 time: 1.057131 Aug 27 21:02:37.088121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1748/3388] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:36 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1274 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:37.106991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:37.143147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:37.147286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Searching by: {'deleted': False, 'project_id': 'c3482773a4054d0486ec671b7899e681'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:02:37.168247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.169279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.173785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.175271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.176171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.176997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.227916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:02:37.228447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:02:37.228862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:02:37.230437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:02:37.231521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:02:37.281771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.283763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.287472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.288294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.288763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.289251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.348668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:02:37.374381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Getting quotas for project 13a67dcbc4854d028af4918901310a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:02:37.395082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Getting quotas for user 244e4dc6363746338a78ab702d7a6777 and project 13a67dcbc4854d028af4918901310a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:02:37.430307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:02:37.433322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:02:37.459431 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1938926-fc97-4148-9cf8-4d5be6dc7b20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.366614 Aug 27 21:02:37.460815 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1749/3389] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:02:37 2022] GET /compute/v2.1/servers => generated 334 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:37.470933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:37.472797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:37.477178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:37.483254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.485372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.485952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.486947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.487903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.493332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.578396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdd4459c-b497-4386-acef-bcf1e111641c tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.927074 Aug 27 21:02:37.581454 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1641/3390] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:02:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:02:37.593786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:37.597667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:37.628070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.628773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.629243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.632285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:37.632770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:37.633405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:37.949837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:37.964010 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6db9cc5b-7159-42ff-b658-ea009d8e7431 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.378981 Aug 27 21:02:37.966229 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1642/3391] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:37 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:37.978931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e502482c-51ce-4a6f-943e-d35285835a51", "name": "network-vif-deleted", "tag": "19f1011f-4218-4984-b3ae-e22d097ca0a0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:38.016942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.018103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.018832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.056936 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] Creating event network-vif-deleted:19f1011f-4218-4984-b3ae-e22d097ca0a0 for instance e502482c-51ce-4a6f-943e-d35285835a51 on nch2-master-1 Aug 27 21:02:38.076323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6e9bd627-1447-4d68-987f-834e39c2dcf0 req-54a90a7e-2a5b-4cd2-9262-3faaec156d89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103404 Aug 27 21:02:38.082137 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1643/3392] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:38.096688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f92d3-aec4-4977-a112-8836503fee29", "name": "network-vif-plugged", "status": "completed", "tag": "e02cb11d-ed68-4f6c-bbb7-80ef86392ad0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:38.127821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.129068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.130514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.165577 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] Creating event network-vif-plugged:e02cb11d-ed68-4f6c-bbb7-80ef86392ad0 for instance e26f92d3-aec4-4977-a112-8836503fee29 on nch1-master-1 Aug 27 21:02:38.184007 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f3d579a9-3788-4d22-af29-a044f7f1fc6a req-f35f737c-85fa-439a-a16d-338f599d5ea6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099617 Aug 27 21:02:38.185818 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1644/3393] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:38.200511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:38.204950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:38.222242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.227000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.227839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.230801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.232984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.235584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.328708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.331482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.332224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.333473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lazy-loading 'fault' on Instance uuid e502482c-51ce-4a6f-943e-d35285835a51 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:38.472631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:38.503329 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-270f0ddf-483a-491a-9b8c-2389113b1c21 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 200 len: 1306 microversion: 2.1 time: 0.315832 Aug 27 21:02:38.505518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1645/3394] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:38 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:38.519613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:38.523161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:38.539879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.540626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.542850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.544242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.545342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.546600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.562526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:38.611790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:38.632884 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86505ae6-0986-4b66-9709-a233e9dbefb1 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1608 microversion: 2.1 time: 1.169371 Aug 27 21:02:38.651231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1750/3395] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:37 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1608 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:38.658081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:38.666298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:38.667770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Searching by: {'deleted': False, 'project_id': 'c3482773a4054d0486ec671b7899e681'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:02:38.677849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.679122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.680039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.681577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.682856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.683942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:38.730672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:38.775107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:02:38.932807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:38.955313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:38.956294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:38.956765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.275377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:39.284471 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5782822-e27e-4446-a8f0-50a9c6c7a2af tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.776949 Aug 27 21:02:39.292348 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e586754-14e1-4869-aac2-dc68522cdb20 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.639331 Aug 27 21:02:39.294988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1751/3396] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:02:38 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:39.302284 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1646/3397] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:38 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:39.307779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.309060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:39.315669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.316298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:39.317846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.318661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.320082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.321211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.322034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.322922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.335376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.335900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.336347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.337074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.337534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.339564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.523108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:39.544281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55bb705f-60e4-4c31-b58b-0b7f7b9a6759 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1275 microversion: 2.1 time: 0.246409 Aug 27 21:02:39.547215 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1752/3398] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:39.557440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.560820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:39.577494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.578016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.578468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.579201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.582405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.582867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.630420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:39.642090 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1cf6c3a0-39c6-4f67-a615-ecc03c8acc13 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.338210 Aug 27 21:02:39.643103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1647/3399] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:39.648842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55160e28-02f3-421d-b671-ca1b6c475928 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.658717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55160e28-02f3-421d-b671-ca1b6c475928 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013556 Aug 27 21:02:39.660010 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1648/3400] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:39.665503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f446c2-c681-4387-8925-b15bc3d26f83", "name": "network-vif-deleted", "tag": "fa539831-830c-41fe-861b-bbacb36c3949"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:39.678884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.680466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.681738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.697616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] Creating event network-vif-deleted:fa539831-830c-41fe-861b-bbacb36c3949 for instance c6f446c2-c681-4387-8925-b15bc3d26f83 on nch1-master-1 Aug 27 21:02:39.704374 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a2643909-b19f-44a3-a435-e342a925196f req-868c8720-27eb-4c3d-817f-90f5b383112a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042952 Aug 27 21:02:39.705213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1649/3401] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:39.711242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.712101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:39.722098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.722683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.723440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.724188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.724875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.725967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.767974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 HTTP/1.1 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e502482c-51ce-4a6f-943e-d35285835a51'} Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:39.774300 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:39.780644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:39.784103 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4fcf967b-a95e-4c70-8703-e2d6b5521c49 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 404 len: 111 microversion: 2.1 time: 0.075815 Aug 27 21:02:39.784103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1650/3402] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:39.790182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.790841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:39.824018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.824841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.826282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.845769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:39.846394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:39.847061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:39.915767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:39.932101 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c41d4f76-59fb-4919-bbbf-947f9aa296d7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1317 microversion: 2.1 time: 0.383694 Aug 27 21:02:39.932770 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1753/3403] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:39.937911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c70d6284-b82e-4d0c-a309-2162406070c0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff857dcb310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:39.990360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:40.004214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ebbd305-d83d-4901-aa65-e40b02f7c4a6 tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1251 microversion: 2.1 time: 0.219340 Aug 27 21:02:40.016878 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1651/3404] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:39 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1251 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:40.016878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:40.017865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:40.033597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.034135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.034589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.036657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.037132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.037560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.103080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:40.273557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-863931ae-5da2-4fa3-b5db-9af207c26b4e tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 204 len: 0 microversion: 2.1 time: 0.266767 Aug 27 21:02:40.274429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1652/3405] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:40 2022] DELETE /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:40.283609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b9cc0f-5151-46ae-90d1-e19a177568d1", "tag": "b96703da-ab18-43ad-ad7b-01fc7e8394a4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:40.284221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c70d6284-b82e-4d0c-a309-2162406070c0 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19" status: 202 len: 0 microversion: 2.1 time: 0.349841 Aug 27 21:02:40.284902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1754/3406] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:39 2022] DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:40.291150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f446c2-c681-4387-8925-b15bc3d26f83", "name": "network-vif-unplugged", "status": "completed", "tag": "fa539831-830c-41fe-861b-bbacb36c3949"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:40.321615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.326724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.327558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.331172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.331610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.333195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.359957 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] Creating event network-vif-unplugged:fa539831-830c-41fe-861b-bbacb36c3949 for instance c6f446c2-c681-4387-8925-b15bc3d26f83 on nch1-master-1 Aug 27 21:02:40.361400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] Creating event network-changed:b96703da-ab18-43ad-ad7b-01fc7e8394a4 for instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 on nch2-master-1 Aug 27 21:02:40.370699 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-dc48c18e-a16e-4532-8c82-8ef7566149e1 req-082572c7-1473-4e22-a1e0-9bdf2e77d5f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084409 Aug 27 21:02:40.372284 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1755/3407] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:40.377901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:40.378857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:40.387917 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e489dd5b-1224-4f83-9ca2-7e034bb71d57 req-fac820ea-e228-4d5d-8462-52378cbc76a3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111232 Aug 27 21:02:40.389460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1653/3408] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:40.390203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.390824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.391368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.392204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.392729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.393405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.398131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f3305d2-bc64-48cf-b3c3-a061ead9712e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e143940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:40.786885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:40.800305 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95d8d2fb-494d-4a1f-b8d7-9e55a2d421fb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1700 microversion: 2.1 time: 0.425354 Aug 27 21:02:40.800954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1756/3409] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:40 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1700 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:40.810184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:40.810798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:40.823073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.824207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.824789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.825542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.826006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.826858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.879097 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f3305d2-bc64-48cf-b3c3-a061ead9712e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec" status: 202 len: 0 microversion: 2.1 time: 0.486473 Aug 27 21:02:40.879959 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1654/3410] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:40 2022] DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:40.888755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:40.889770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:40.903690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.904809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.905577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:40.906871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:40.907550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:40.908269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.033347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.050481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62986dfd-6b27-428b-af5f-d3ac612f000d tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1283 microversion: 2.1 time: 0.169039 Aug 27 21:02:41.051791 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1655/3411] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:40 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.071333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:41.072481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:41.083230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.083956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.084388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.085230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.085961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.086485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.087193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.099440 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78ff2b39-6c23-41ab-967d-8ad631fcce6c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1511 microversion: 2.1 time: 0.296448 Aug 27 21:02:41.100340 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1757/3412] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:40 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.119701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6feda381-32a4-4d22-bc89-8629a447022d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'create', calling method: .version_select at 0x7ff84ebe53a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1784481485", "description": "tempest-description-1740205688"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:41.300063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.313409 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc4536d5-cb5f-4793-b73e-617d43c0c97a tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.260041 Aug 27 21:02:41.314026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1656/3413] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.334609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:41.335706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:41.345913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.346818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.347619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.348561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.349236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.349826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.408959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6feda381-32a4-4d22-bc89-8629a447022d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.292197 Aug 27 21:02:41.410121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1758/3414] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:02:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:41.423904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:41.424924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:41.432987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.433771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.434410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.435604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.436224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.436837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.485900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.486649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.487239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.488029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lazy-loading 'fault' on Instance uuid c6f446c2-c681-4387-8925-b15bc3d26f83 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:41.560648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.573327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-df5a8fba-8e15-4e5b-a5ba-f2888ed6860b tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1256 microversion: 2.1 time: 0.161839 Aug 27 21:02:41.574605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1759/3415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1256 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.579463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f39d1118-fc4e-4d92-8470-58578577b5d4 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Action: 'update', calling method: .version_select at 0x7ff84ebe53a0>, body: {"security_group": {"name": "tempest-sg-hth-1770436710", "description": "tempest-description-hth-385040375"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:41.615153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.625874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1aa305f9-502a-49d5-a34c-1138ef50a45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1465 microversion: 2.1 time: 0.310817 Aug 27 21:02:41.640081 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1657/3416] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1465 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.648035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:41.649019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:41.657858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.658355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.658965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.659875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.660493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.661079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.837851 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f39d1118-fc4e-4d92-8470-58578577b5d4 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "PUT /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85" status: 200 len: 217 microversion: 2.1 time: 0.260334 Aug 27 21:02:41.850088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1760/3417] 10.222.0.40 () {60 vars in 1290 bytes} [Sat Aug 27 21:02:41 2022] PUT /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85 => generated 217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:41.859214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:41.860239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:41.869143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.869951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.870495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.872148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:41.872777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:41.873447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:41.945819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:41.954658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d148cdf-574c-452b-a095-d5dedc5a203d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1466 microversion: 2.1 time: 0.310609 Aug 27 21:02:41.956251 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1658/3418] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:41.961166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa83f230-6a51-4a29-bd3e-c4e14fee0327 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1d9700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:42.047713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa83f230-6a51-4a29-bd3e-c4e14fee0327 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85" status: 200 len: 217 microversion: 2.1 time: 0.090047 Aug 27 21:02:42.056297 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1659/3419] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85 => generated 217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:42.056297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-265076302"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:42.062033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:42.071972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.072547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.072991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.074118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.074582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.075017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.106506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:42.118547 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6c49e27-5336-4780-a489-de7c2fab94eb tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1700 microversion: 2.1 time: 0.266656 Aug 27 21:02:42.119142 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1761/3420] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:41 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1700 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:42.125086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-864a4c19-4882-45f4-9612-95dd27f8e630 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e6823a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:42.425185 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ccb8abfc-05d2-4f48-b9bc-5d876967fb75 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "POST /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312/action" status: 202 len: 0 microversion: 2.1 time: 0.375273 Aug 27 21:02:42.428065 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1660/3421] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:42 2022] POST /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 21:02:42.435503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:42.436522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:42.444756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.446460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.447452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.448386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.449093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.449965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.616011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-864a4c19-4882-45f4-9612-95dd27f8e630 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85" status: 202 len: 0 microversion: 2.1 time: 0.495425 Aug 27 21:02:42.616856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1762/3422] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:42 2022] DELETE /compute/v2.1/os-security-groups/1db853a5-d7e8-43b2-9fc5-aaaf55abeb85 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:42.623703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:42.624322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:42.638382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.638894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.640053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.640743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.641284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.641781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.736685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:42.745552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf34da31-221b-4774-babd-14a84af8463b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1281 microversion: 2.1 time: 0.315609 Aug 27 21:02:42.747979 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1661/3423] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:42 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:42.762068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:42.763060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:42.773597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.775916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.777194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:42.779380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:42.780052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:42.781610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.116542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:43.128252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:43.131916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44749b04-020f-4c04-9bbd-d44e146d5ac2 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.373586 Aug 27 21:02:43.133023 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1662/3424] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:42 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.140097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5afdba3-ec2b-47bf-8af4-a1607b9faac3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1d9790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.154019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18d34abe-8bc2-41a4-b906-185ef50e6a45 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1488 microversion: 2.1 time: 0.535950 Aug 27 21:02:43.155281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1763/3425] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:42 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1488 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.163928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.166362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.175454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.176600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.177321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.178281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.179521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.180118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.228508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5afdba3-ec2b-47bf-8af4-a1607b9faac3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.093751 Aug 27 21:02:43.229115 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1663/3426] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.255116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.256978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.271521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.272028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.272761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.273510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.282800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.283680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.293719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.294230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.297647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.298201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lazy-loading 'fault' on Instance uuid c6f446c2-c681-4387-8925-b15bc3d26f83 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:43.315924 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 HTTP/1.1 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e502482c-51ce-4a6f-943e-d35285835a51'} Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:43.317968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a5c69ba-78ee-429f-bdbb-2e5d9a9f16a2 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 404 len: 111 microversion: 2.1 time: 0.081560 Aug 27 21:02:43.321974 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1664/3427] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:43 2022] DELETE /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:43.326767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.327374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.334171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.334721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.335169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.335922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.336386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.336809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.367590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d18c23a6da54d88b00e6f7855ea82c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7599dfd7db2647bf8f986bffd781b87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:43.376182 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03b3cdf6-6be9-4498-8745-74f3dc95827d tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 200 len: 1210 microversion: 2.1 time: 0.219302 Aug 27 21:02:43.376771 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1764/3428] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.391851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1311904974"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:43.394872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.402235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.402735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.403179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.404030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.404484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.405097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.501304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06877364-6881-4d4d-903c-23053a25e1ba tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "PUT /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1062 microversion: 2.1 time: 0.120373 Aug 27 21:02:43.502076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1765/3429] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:02:43 2022] PUT /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1062 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.508460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.510227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: e502482c-51ce-4a6f-943e-d35285835a51] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.521033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.522294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.522905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.523880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.524522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.525234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.557460 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 HTTP/1.1 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'e502482c-51ce-4a6f-943e-d35285835a51'} Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.561767 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. Aug 27 21:02:43.566775 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.568476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Instance e502482c-51ce-4a6f-943e-d35285835a51 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:43.570134 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5c55a015-a09d-4416-8401-9c34e8641ace tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51" status: 404 len: 111 microversion: 2.1 time: 0.066413 Aug 27 21:02:43.571582 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1766/3430] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/servers/e502482c-51ce-4a6f-943e-d35285835a51 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:43.583671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.584504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.598817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.599324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.599946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.600708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.601227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.602485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.638475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:43.649654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-85f89a83-6b02-44b5-888f-2ae0e6ea9261 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1700 microversion: 2.1 time: 0.327267 Aug 27 21:02:43.650663 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1665/3431] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1700 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.655918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1d93a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.725599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:43.726143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 70c1412c-7d75-4fab-8a99-17243681c4ec not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:43.726670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.726670 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec HTTP/1.1 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '70c1412c-7d75-4fab-8a99-17243681c4ec'} Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:43.728553 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] Aug 27 21:02:43.732979 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.738224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 70c1412c-7d75-4fab-8a99-17243681c4ec does not exist Aug 27 21:02:43.738224 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-9e2180de-aa35-49f4-8851-a84ff28f7106'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:43.738825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07e097fa-e28d-451d-93f2-8a6ada97d257 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec" status: 404 len: 194 microversion: 2.1 time: 0.086781 Aug 27 21:02:43.739949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1666/3432] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:43 2022] DELETE /compute/v2.1/os-security-groups/70c1412c-7d75-4fab-8a99-17243681c4ec => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:43.749417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1a2f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.806918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:43.809090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group d23cf84a-6a7d-4878-8e96-2398005c9b19 not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:43.809637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.809637 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19 HTTP/1.1 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'd23cf84a-6a7d-4878-8e96-2398005c9b19'} Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:43.812223 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group d23cf84a-6a7d-4878-8e96-2398005c9b19 does not exist Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-f415f93f-0d5b-4ddf-85d1-34d23a140add'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:43.815968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-908854a0-7c5d-407c-940b-7876009fa49c tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19" status: 404 len: 194 microversion: 2.1 time: 0.070411 Aug 27 21:02:43.821454 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1667/3433] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:43 2022] DELETE /compute/v2.1/os-security-groups/d23cf84a-6a7d-4878-8e96-2398005c9b19 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:02:43.823038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.823988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:43.832692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.833880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.834316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.835361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:43.836005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:43.836475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:43.858996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:43.872007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:43.874978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5cdac7c6-1ab6-4ec9-baab-dff68e04ffe1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1489 microversion: 2.1 time: 0.302066 Aug 27 21:02:43.890475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1767/3434] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1489 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:43.890475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84ec653a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:43.992226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:43.993119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:43.993853 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:43.993853 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf HTTP/1.1 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '53f4eb13-2ce2-43e3-b6a9-ce45d49783cf'} Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:44.004219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] Aug 27 21:02:44.008324 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.013498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 53f4eb13-2ce2-43e3-b6a9-ce45d49783cf does not exist Aug 27 21:02:44.013498 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-38459a3a-2eec-4e85-8141-1599370cbefa'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:44.014792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-017dd8dd-8b81-49cf-8d4d-745e79d7666d tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf" status: 404 len: 194 microversion: 2.1 time: 0.137712 Aug 27 21:02:44.015650 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1768/3435] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:43 2022] DELETE /compute/v2.1/os-security-groups/53f4eb13-2ce2-43e3-b6a9-ce45d49783cf => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:44.021077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.022858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:44.036784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.037606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.038883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.040187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.040659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.041425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.193917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:44.207703 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41e92d74-ba61-4598-b961-d666be2ca9e3 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.388089 Aug 27 21:02:44.209811 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1668/3436] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:43 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:44.227048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e1a2790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.285772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:44.285772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 8786da3d-bf42-482b-bbaa-708b280d6c0e not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:44.285772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.285772 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e HTTP/1.1 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '8786da3d-bf42-482b-bbaa-708b280d6c0e'} Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:44.287429 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 8786da3d-bf42-482b-bbaa-708b280d6c0e does not exist Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-cad8a38e-3fd1-4eee-8f7d-162e3f2d50cf'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9221139c-8f16-435e-9d71-c69c513c885e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e" status: 404 len: 194 microversion: 2.1 time: 0.077156 Aug 27 21:02:44.291747 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1669/3437] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:44 2022] DELETE /compute/v2.1/os-security-groups/8786da3d-bf42-482b-bbaa-708b280d6c0e => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:44.295206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.295301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:44.311620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.312121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.312556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.313276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.320336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.321119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.386578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:44.406764 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0edb2787-b184-4ebe-a927-b53b54bc3139 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1489 microversion: 2.1 time: 0.380373 Aug 27 21:02:44.408006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1769/3438] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:44 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1489 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:44.423004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f1fec49-a09c-4344-94d8-d8ef8e797958 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e682af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.487214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f1fec49-a09c-4344-94d8-d8ef8e797958 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.078085 Aug 27 21:02:44.495197 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1770/3439] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:44 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:44.500668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e6823a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.573695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:44.574626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 not found {{(pid=140434) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:44.575237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.575237 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06 HTTP/1.1 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '354b53c3-8b90-430c-a17a-33cfc34f3d06'} Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:44.577739 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] Aug 27 21:02:44.582349 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.588079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group 354b53c3-8b90-430c-a17a-33cfc34f3d06 does not exist Aug 27 21:02:44.588079 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-2b2641ff-64c4-4bd7-8a3a-ca711bcd742a'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:44.589384 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-45c043ee-36ad-40f7-bfa9-58ff216f78fa tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06" status: 404 len: 194 microversion: 2.1 time: 0.092632 Aug 27 21:02:44.590276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1771/3440] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:44 2022] DELETE /compute/v2.1/os-security-groups/354b53c3-8b90-430c-a17a-33cfc34f3d06 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:44.596913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.599154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] [instance: c6f446c2-c681-4387-8925-b15bc3d26f83] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:44.607174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.610333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.611439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.612234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.612802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.613473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.633244 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] HTTP exception thrown: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Request method failure captured: Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 HTTP/1.1 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoX506y7LRHLJmtrjMWlog3uh3-AhP3x9TArsKgfcEForybQbIXWHQzmoyjS1287eT5GyCQnfKurB0uzeVvdCOEdErcoSPhhm71GA4rx7HmRucNoQNobVNGYnqKWXXoP688Q8SkXevhK3GU9Kn9pp6M0sHIXowtuH2xB8w2E6q2T0h8 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 7599dfd7db2647bf8f986bffd781b87d Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestBootFromVolume-854824990 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7599dfd7db2647bf8f986bffd781b87d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7599dfd7db2647bf8f986bffd781b87d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7599dfd7db2647bf8f986bffd781b87d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7599dfd7db2647bf8f986bffd781b87d"}]}] Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestBootFromVolume-854824990 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 7599dfd7db2647bf8f986bffd781b87d Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestBootFromVolume-854824990 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestBootFromVolume-854824990-project Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9d18c23a6da54d88b00e6f7855ea82c1 Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestBootFromVolume-854824990-project Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'c6f446c2-c681-4387-8925-b15bc3d26f83'} Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.635927 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. Aug 27 21:02:44.640020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.642224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Returning 404 to user: Instance c6f446c2-c681-4387-8925-b15bc3d26f83 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:44.643525 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7c1755f-ae25-4cdf-a519-569c90688a3e tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83" status: 404 len: 111 microversion: 2.1 time: 0.051429 Aug 27 21:02:44.647644 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1772/3441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:44 2022] GET /compute/v2.1/servers/c6f446c2-c681-4387-8925-b15bc3d26f83 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:44.654027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.655028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:44.662894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.663883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.664504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:44.665732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.666890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.667698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.669400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.677430 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-84ad3b7e-654c-4108-84d0-41a6600c2a44 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.384266 Aug 27 21:02:44.687448 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1670/3442] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:44 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:44.687448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84ea738b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.725835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:44.799659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:44.825040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:02:44.825862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Neutron security group df0e579e-f116-492f-a0e0-7a641e09c6c1 not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:02:44.826440 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.826440 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 HTTP/1.1 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'df0e579e-f116-492f-a0e0-7a641e09c6c1'} Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:02:44.828909 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Security group df0e579e-f116-492f-a0e0-7a641e09c6c1 does not exist Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-45b877ae-90e5-479a-a8ef-94cd9e90a4af'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b947cfd8-6c57-484d-ae30-f8a63d0155b1 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1" status: 404 len: 194 microversion: 2.1 time: 0.150996 Aug 27 21:02:44.834557 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1671/3443] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:44 2022] DELETE /compute/v2.1/os-security-groups/df0e579e-f116-492f-a0e0-7a641e09c6c1 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:44.846190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e8c0ba2-8fc6-4bf9-a86d-3b14cbcbac2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] Calling method '.version_select at 0x7ff84e149af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.895520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cb9f07b-9683-41af-807f-7157965e88d7 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 204 len: 0 microversion: 2.1 time: 0.242487 Aug 27 21:02:44.896182 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1773/3444] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:44 2022] DELETE /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:44.899265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e8c0ba2-8fc6-4bf9-a86d-3b14cbcbac2c tempest-ServersTestBootFromVolume-854824990 tempest-ServersTestBootFromVolume-854824990-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80923648" status: 202 len: 0 microversion: 2.1 time: 0.058296 Aug 27 21:02:44.915966 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1672/3445] 10.222.0.40 () {58 vars in 1215 bytes} [Sat Aug 27 21:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80923648 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:44.925951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67", "name": "network-vif-deleted", "tag": "9560a5c9-6d21-45fc-9488-7c445cf165c9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:44.934196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:44.935571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:44.951316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.951995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.952443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.955877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.958488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.959200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.961769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:44.962445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:44.965605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:44.993102 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] Creating event network-vif-deleted:9560a5c9-6d21-45fc-9488-7c445cf165c9 for instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 on nch1-master-1 Aug 27 21:02:45.000739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-67d52d40-de43-43f8-b1b2-a99ae944e78c req-c49e2b9d-7f1e-4053-a754-b04eb8555111 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082955 Aug 27 21:02:45.005748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1673/3446] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:45.016434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.017050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:45.035210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.035743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.036186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.039646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.040293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.041187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.096083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:45.233761 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25d496e1-0c0a-4c4f-94a6-23c9c08e4a41 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 204 len: 0 microversion: 2.1 time: 0.225163 Aug 27 21:02:45.236734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1674/3447] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:45 2022] DELETE /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:45.255209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.256526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:45.264469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:45.265818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:45.266159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.266826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.267429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.268272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.269272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.270351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.278303 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f19fc4fe-eebf-42c6-b2d9-4c73f79bbce8 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1355 microversion: 2.1 time: 0.380803 Aug 27 21:02:45.292628 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1774/3448] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:44 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1355 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:45.301655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.302595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:45.313929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.314785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.315528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.316513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.317197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.318039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.725969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:45.736528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:45.739864 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9148a99d-b9fc-4224-a0c6-57947fde52ee tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1495 microversion: 2.1 time: 0.498961 Aug 27 21:02:45.749452 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1675/3449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:45 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1495 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:45.752931 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-957ac4f3-1fff-4443-aadc-f1e885a32e7b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.457669 Aug 27 21:02:45.768580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1775/3450] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:45 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:45.774014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.774641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:45.778359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b9cc0f-5151-46ae-90d1-e19a177568d1", "name": "network-vif-plugged", "status": "completed", "tag": "b96703da-ab18-43ad-ad7b-01fc7e8394a4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:45.790282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.790800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.791249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.791993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.792571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.793005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.802583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.803365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.804004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.818209 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] Creating event network-vif-plugged:b96703da-ab18-43ad-ad7b-01fc7e8394a4 for instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 on nch2-master-1 Aug 27 21:02:45.823614 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d3db19ca-a288-499a-9c2a-c1407285ca6d req-7647fb8c-b4c4-47c1-952e-7042cb07e64b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052464 Aug 27 21:02:45.824872 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1776/3451] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:45.831026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5572255-78ef-4d1b-9b9a-1489ec72129a tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e6821f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.884701 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5572255-78ef-4d1b-9b9a-1489ec72129a tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.058365 Aug 27 21:02:45.885495 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1777/3452] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:45 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:45.896716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:45.910391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.911717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.912538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.930281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] Creating event network-changed:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:02:45.948149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a012b851-97b3-4e19-ae1f-07c4d7d0d87a req-bd4c99bc-f808-4129-92e8-45e291a065b9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058985 Aug 27 21:02:45.949635 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1778/3453] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:45.956974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:45.958030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:45.970105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.970105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.970105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:45.975486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:45.976386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:45.977058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.464689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:46.498679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5752776a-54c2-4032-9e46-a7dd42f0f015 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.547405 Aug 27 21:02:46.499299 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1779/3454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:45 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:46.520788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:46.521417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:46.534651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.536845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.537757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.539999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.540476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.541283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.546190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:46.560302 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6f364f5-6cca-4d06-a724-bc10d5db54b6 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1645 microversion: 2.1 time: 0.808204 Aug 27 21:02:46.563525 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1676/3455] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:45 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1645 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:46.622586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.623855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.624758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.625507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lazy-loading 'fault' on Instance uuid 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:46.684881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1059213ffb04e778d7f9e2fd1ff2474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3482773a4054d0486ec671b7899e681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:46.704332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a955895-2bfd-4eb6-bc7e-9e3a06140748 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 200 len: 1360 microversion: 2.1 time: 0.203498 Aug 27 21:02:46.707515 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1780/3456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:46 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 1360 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:46.767133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:46.767790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:46.780105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.780690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.781135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.781989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.785020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.785160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:46.785590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.785686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:46.799055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.801248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.802348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:46.805226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:46.806244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:46.808178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:47.171910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:47.188431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68be30e2-a529-4ba0-8b24-c46e72b83892 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1495 microversion: 2.1 time: 0.424508 Aug 27 21:02:47.191891 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1677/3457] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:46 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1495 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:47.209939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:47.226695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-faf5a882-a384-4b1f-b6d7-430cab91d35c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e7138b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:47.228823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54069c99-9304-40d3-a1bd-21093752762b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.452595 Aug 27 21:02:47.243102 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1781/3458] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:46 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:47.305497 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-faf5a882-a384-4b1f-b6d7-430cab91d35c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.110694 Aug 27 21:02:47.306150 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1678/3459] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:47 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:47.520899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:47.521841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:47.529877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:47.531762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:47.532402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:47.533294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:47.534669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:47.535742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:47.583434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:47.584314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:47.586468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:47.588205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=16 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:47.595775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:47.596516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:47.596948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:47.597688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:47.598303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:47.598728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.008916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:48.021708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-def1559a-f52f-4454-9b7a-85275af05e68 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1316 microversion: 2.1 time: 0.504838 Aug 27 21:02:48.040016 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1782/3460] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:47 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:48.045904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:48.046612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] [instance: 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:48.055535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.056141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.056586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.057374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.058055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.058419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.078242 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] HTTP exception thrown: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Request method failure captured: Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 HTTP/1.1 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoYBSlCVNE1mIjBTB4kqz1eMiZcJAYW8R7zBQhVnlt8C9bNdDwsmdzkKbiscyLjDXiFDyx1_G-6lMsJYKIjKpkG_Us1ar_FmgV0Mdy-iqAcmkN55mulLKfYTNou2i0o-fhaU1OyVUXWffjgHROePvRUHLErDhbdgvixsjSUZeBP2p2Y Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c3482773a4054d0486ec671b7899e681 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-983571389 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c3482773a4054d0486ec671b7899e681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c3482773a4054d0486ec671b7899e681"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c3482773a4054d0486ec671b7899e681", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c3482773a4054d0486ec671b7899e681"}]}] Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-983571389 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c3482773a4054d0486ec671b7899e681 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-983571389 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-983571389-project Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: e1059213ffb04e778d7f9e2fd1ff2474 Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-983571389-project Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67'} Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:48.080315 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. Aug 27 21:02:48.084599 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:48.086537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Returning 404 to user: Instance 5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:48.087814 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bafbd12f-bab5-40dd-874e-bcf4d1175cdc tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67" status: 404 len: 111 microversion: 2.1 time: 0.046479 Aug 27 21:02:48.089072 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1783/3461] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:48 2022] GET /compute/v2.1/servers/5251f617-f1b6-4cd7-ac9e-21b0ce7d2f67 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:48.095211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b783eb6d-d028-4826-82fc-24b26bfa2983", "name": "network-vif-deleted", "tag": "8fc6b094-a266-415d-b5ca-b5ef78ca7c69"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:48.107817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.108597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.109311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.124913 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] Creating event network-vif-deleted:8fc6b094-a266-415d-b5ca-b5ef78ca7c69 for instance b783eb6d-d028-4826-82fc-24b26bfa2983 on nch2-master-1 Aug 27 21:02:48.131608 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c7d50203-7a5c-472b-a0f8-97f089266ccc req-dfeb4417-5c8f-4db5-90ea-18d0bc7ac063 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041013 Aug 27 21:02:48.134422 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1784/3462] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:48.142240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-plugged", "status": "completed", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:48.154933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.155909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.156573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.175205 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] Creating event network-vif-plugged:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:02:48.181583 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-239f18ac-474d-44de-b6bf-2b837493e9ad req-d74861a0-7aa6-4b62-89cb-25419cf63c3a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045461 Aug 27 21:02:48.182987 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1785/3463] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:48.190760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4e22dab1-f7be-492e-8a14-f185ca797765 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] Calling method '.version_select at 0x7ff84e682c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:48.207888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:48.218252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4e22dab1-f7be-492e-8a14-f185ca797765 tempest-ServersTestJSON-983571389 tempest-ServersTestJSON-983571389-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599208938" status: 202 len: 0 microversion: 2.1 time: 0.033463 Aug 27 21:02:48.219958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f95feb7-daf9-4321-b556-3389be2f5f16 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1645 microversion: 2.1 time: 0.640188 Aug 27 21:02:48.223092 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1786/3464] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599208938 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:48.225215 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1679/3465] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:47 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1645 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:48.242826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:48.244608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:48.252347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:48.254328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:48.257764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.258672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.259169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.260476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.262450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.262933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.274817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.275328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.276410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.277415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.278051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.278714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.439705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:48.451741 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff06f308-2f73-49f5-bd75-cd6dd9e9fe18 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1292 microversion: 2.1 time: 0.227198 Aug 27 21:02:48.452959 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1787/3466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:48 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:48.460140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d90e9bd-edbd-48ae-b897-1e3db6dcf66b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e5d3700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:48.520710 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d90e9bd-edbd-48ae-b897-1e3db6dcf66b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.066541 Aug 27 21:02:48.521487 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1788/3467] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:48 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:48.686595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74a5f19-5525-4999-a5f1-0e65fe2b60bb", "name": "network-vif-deleted", "tag": "09410308-a05e-4960-a963-81689cf5f6b8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:48.703022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:48.714560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:48.717660 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9ca42ff-d03c-42af-bcbb-918a0266fc61 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.470902 Aug 27 21:02:48.718966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:48.719670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:48.720283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:48.721288 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1680/3468] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:48 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:48.736344 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] Creating event network-vif-deleted:09410308-a05e-4960-a963-81689cf5f6b8 for instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb on nch1-master-1 Aug 27 21:02:48.744042 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6245ad95-78cb-446b-9eb5-89c0531f0c5e req-389e0c56-fc81-4f00-827c-770dcffefc43 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065233 Aug 27 21:02:48.745385 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1789/3469] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:02:49.046589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.047660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.062843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.075680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.076152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.076917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.077386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.078287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.250610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:49.300641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.301378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.345652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.346910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.348036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.351184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.352234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.352948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.444351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:49.457666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.459884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.460800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.462464 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dff628e7-c7e4-493b-a45f-c64a0c93c4d7 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1503 microversion: 2.1 time: 0.419050 Aug 27 21:02:49.463114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lazy-loading 'fault' on Instance uuid a74a5f19-5525-4999-a5f1-0e65fe2b60bb {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:49.479735 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1681/3470] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:49.490327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.493304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.518281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.518784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.519588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.520597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.521216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.521839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.558158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.558914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.559566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.560333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid b783eb6d-d028-4826-82fc-24b26bfa2983 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:49.567538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5c9cf888ac429b819659f076bcfc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a881a5e1e774e1d818d8e465596dd33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:49.576784 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9837cd9a-982a-466b-ad2f-daa99e7e2a40 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 200 len: 1306 microversion: 2.1 time: 0.327133 Aug 27 21:02:49.578029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1790/3471] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 1306 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:49.583479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.584418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.593269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.594188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.594797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.595709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.596574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.597017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.611579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:49.622747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60954070-5ca3-4828-91f2-a5b29b7bb1c4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1310 microversion: 2.1 time: 0.141764 Aug 27 21:02:49.625808 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1682/3472] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1310 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:49.632584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab888aec-64f5-4c6c-a2e2-33a68f49c265 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e149c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.692439 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1a8a9fe-6e9f-41f0-926f-52d12f60805f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "DELETE /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.112895 Aug 27 21:02:49.693911 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1791/3473] 10.222.0.40 () {58 vars in 1296 bytes} [Sat Aug 27 21:02:49 2022] DELETE /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1/os-server-password => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:49.712533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.713667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.729721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.731786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.732664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.734289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.736752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.737281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.754722 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab888aec-64f5-4c6c-a2e2-33a68f49c265 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.127546 Aug 27 21:02:49.762696 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1683/3474] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:49.768033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.768665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.784864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.785368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.789145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.790536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.794814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.795473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.799476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73e0fb71-63e7-4219-9f03-b2712b80a54d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.100209 Aug 27 21:02:49.801082 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1792/3475] 10.222.0.40 () {58 vars in 1293 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1/os-server-password => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:02:49.822685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:49.824558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:49.837488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.845765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.846812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.847738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:49.848352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:49.848933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:49.898745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:50.034565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=5,nova_cell1:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:50.113902 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d804b399-b369-438c-a4e9-e8f90ca54cbb tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "DELETE /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 204 len: 0 microversion: 2.1 time: 0.300398 Aug 27 21:02:50.114684 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1793/3476] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:49 2022] DELETE /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:50.135171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:50.136929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:50.149431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.149932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.151044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:50.153593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.154381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.155425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.155425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.159645 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cc20d05-3b85-4978-a205-66edf31e2a48 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.395707 Aug 27 21:02:50.162124 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1684/3477] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:49 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:50.332361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:50.347665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e5d7db2-106a-4ea6-81d8-2bcb151b807d tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1509 microversion: 2.1 time: 0.228077 Aug 27 21:02:50.350187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1794/3478] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:50 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:50.601471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:50.602177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] [instance: a74a5f19-5525-4999-a5f1-0e65fe2b60bb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:50.614690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.615695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.616320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.618155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.619923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.623914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.646842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:50.647875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:50.658628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.658835 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] HTTP exception thrown: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. Aug 27 21:02:50.660783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Request method failure captured: Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb HTTP/1.1 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoYlUmJimSJtkRTGIGk9qDt2_TjFbNR0mXek7QhtD89W8kZbgD1bEdo_2RMiHHkFevA60DPMigdNflCKBE9WCXLbh8iA3x6oDSy8Cd6iZZmeiNcI95epPSpd5DGRrOTfOO8qWgWhEd358H212bgwtl-HSLNwH1T1Hq7jJCK07JTaiFk Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9a881a5e1e774e1d818d8e465596dd33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9a881a5e1e774e1d818d8e465596dd33", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9a881a5e1e774e1d818d8e465596dd33"}]}] Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 9a881a5e1e774e1d818d8e465596dd33 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-577930100 Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 0c5c9cf888ac429b819659f076bcfc1e Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupsTestJSON-577930100-project Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a74a5f19-5525-4999-a5f1-0e65fe2b60bb'} Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:50.661121 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Returning 404 to user: Instance a74a5f19-5525-4999-a5f1-0e65fe2b60bb could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3186e58-a38b-44fc-84bd-39ad762c9461 tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb" status: 404 len: 111 microversion: 2.1 time: 0.065136 Aug 27 21:02:50.666904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1685/3479] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:50 2022] GET /compute/v2.1/servers/a74a5f19-5525-4999-a5f1-0e65fe2b60bb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:50.670136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.673320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4f9b1e9-acad-4638-b561-34cda9099eed tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e10adc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:50.673684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.674422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.675071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.782763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:50.784974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:50.786320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:50.787355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid b783eb6d-d028-4826-82fc-24b26bfa2983 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:50.919748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:50.930093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc728766-a2cc-4557-92a6-db328709bcff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1310 microversion: 2.1 time: 0.287725 Aug 27 21:02:50.936044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1795/3480] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:50 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:50.955757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ce05fd6-6334-421b-82cb-34bb42efaeaa tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ed589d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:51.046082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ce05fd6-6334-421b-82cb-34bb42efaeaa tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.108603 Aug 27 21:02:51.053438 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1796/3481] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:50 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:51.112020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4f9b1e9-acad-4638-b561-34cda9099eed tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/3220f54d-f64b-4d83-a820-68cd46b4369f" status: 202 len: 0 microversion: 2.1 time: 0.442690 Aug 27 21:02:51.117589 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1686/3482] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:50 2022] DELETE /compute/v2.1/os-security-groups/3220f54d-f64b-4d83-a820-68cd46b4369f => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:02:51.125218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a7a6cfd9-409a-4124-bb69-628efa09f91e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] Calling method '.version_select at 0x7ff84e02c280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:51.183650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:51.184535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:51.197293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:51.198163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:51.198990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:51.200017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:51.202029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:51.202732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:51.666767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:51.700440 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-048eda1b-f7ed-4801-a33f-eff8bc142f49 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.522033 Aug 27 21:02:51.707176 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1687/3483] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:51 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:51.739770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:51.741853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:51.774625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:51.775163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:51.779512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:51.780355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:51.780843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:51.786227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:52.127966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a7a6cfd9-409a-4124-bb69-628efa09f91e tempest-SecurityGroupsTestJSON-577930100 tempest-SecurityGroupsTestJSON-577930100-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/70fad35f-00f1-48f3-9f96-3612d560342a" status: 202 len: 0 microversion: 2.1 time: 1.009297 Aug 27 21:02:52.136960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1797/3484] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:02:51 2022] DELETE /compute/v2.1/os-security-groups/70fad35f-00f1-48f3-9f96-3612d560342a => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:02:52.153674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:52.154505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:52.159020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:52.165998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:52.166728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:52.167444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:52.169180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:52.170110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:52.170994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:52.197181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:52.206548 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed5189e8-c065-4d9b-a4c0-6969b283e1a4 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1509 microversion: 2.1 time: 0.494533 Aug 27 21:02:52.207156 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1688/3485] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:51 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:52.232422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60be794a-9f82-46a3-b80b-3ed392ba3342 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e12a5e0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:52.247244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:52.249855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:52.250332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:52.251491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid b783eb6d-d028-4826-82fc-24b26bfa2983 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:52.301039 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60be794a-9f82-46a3-b80b-3ed392ba3342 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.083320 Aug 27 21:02:52.301298 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1689/3486] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:52 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:52.322641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:52.331300 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f9add17-1c3d-4647-8409-bac3ae757010 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 200 len: 1310 microversion: 2.1 time: 0.193009 Aug 27 21:02:52.331917 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1798/3487] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:52 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:52.726233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:52.727503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:52.737159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:52.748727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:52.749501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:52.750285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:52.750765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:52.751207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.211911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:53.227199 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80b040ad-ba3f-4bbd-b402-1bc31b03ad88 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.505673 Aug 27 21:02:53.233727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1690/3488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:52 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:53.243953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.244324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.270887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.271466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.272679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.274210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.274833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.276640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.316140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-852f14c1-159f-4152-829c-630a64769963 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1493a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.388801 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-852f14c1-159f-4152-829c-630a64769963 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.077655 Aug 27 21:02:53.396999 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1691/3489] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:53.436747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.439005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.456606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.485419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.486427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.489312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.490140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.490982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.518900 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 HTTP/1.1 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b783eb6d-d028-4826-82fc-24b26bfa2983'} Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.521650 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.526654 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.530155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.534369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e40ea4a-2416-4bb0-94f5-b44afded84b6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 404 len: 111 microversion: 2.1 time: 0.132073 Aug 27 21:02:53.540319 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1692/3490] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.551991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.552916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.563246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.564386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.565031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.565963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.566922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.567600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.601478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:02:53.603136 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 HTTP/1.1 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b783eb6d-d028-4826-82fc-24b26bfa2983'} Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.605638 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.610567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.613336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.614809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a006d632-abe1-44a0-a8c0-1695df8e7fbf tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 404 len: 111 microversion: 2.1 time: 0.068215 Aug 27 21:02:53.616046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1693/3491] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:53 2022] DELETE /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.626695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.628408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b783eb6d-d028-4826-82fc-24b26bfa2983] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.640161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.641915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.643830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.645421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.646300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.646908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.671036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 HTTP/1.1 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b783eb6d-d028-4826-82fc-24b26bfa2983'} Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.674161 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. Aug 27 21:02:53.679722 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.697296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance b783eb6d-d028-4826-82fc-24b26bfa2983 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.698426 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c381cbd-250c-4f4c-9fbb-1cf40603cc82 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983" status: 404 len: 111 microversion: 2.1 time: 0.078473 Aug 27 21:02:53.699526 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1694/3492] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/servers/b783eb6d-d028-4826-82fc-24b26bfa2983 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.709923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.710099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.730080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.731260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.731897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.733486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.734140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.734720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.752947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 HTTP/1.1 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '21b86cf4-c6ec-45f8-a707-47da83378c71'} Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.754784 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.758895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.761006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.762330 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ace103c-d905-49fe-aa51-a2e4737d6aaa tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 404 len: 111 microversion: 2.1 time: 0.057105 Aug 27 21:02:53.766365 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1695/3493] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:53 2022] DELETE /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.773763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.774586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 21b86cf4-c6ec-45f8-a707-47da83378c71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.784899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.787388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.789803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.791572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.794212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.794838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.829308 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 HTTP/1.1 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '21b86cf4-c6ec-45f8-a707-47da83378c71'} Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.832029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. Aug 27 21:02:53.837131 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.837648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:53.838666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 21b86cf4-c6ec-45f8-a707-47da83378c71 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.840015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-923c3fe9-1ec0-4a5a-a50e-e1ae9f9da484 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71" status: 404 len: 111 microversion: 2.1 time: 0.071375 Aug 27 21:02:53.845036 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1696/3494] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/servers/21b86cf4-c6ec-45f8-a707-47da83378c71 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.850625 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3018ee03-43af-44fc-8798-bd69115052b3 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1509 microversion: 2.1 time: 0.626065 Aug 27 21:02:53.851261 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1799/3495] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:53.851776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.852505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.863655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.864347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.865491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.868581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.869387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.869980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.891520 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 HTTP/1.1 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '6cc244e6-b697-415e-b85f-754f4fffbe62'} Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.893390 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.899727 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.916049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:53.917965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2f5c6ed-fcfc-46d7-b3d3-c10d4e8ff029 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 404 len: 111 microversion: 2.1 time: 0.070981 Aug 27 21:02:53.922725 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1697/3496] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:53 2022] DELETE /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:53.927220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:53.928059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 6cc244e6-b697-415e-b85f-754f4fffbe62] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:53.943577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.944465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.945073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.945955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:53.946575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:53.947181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:53.990584 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 HTTP/1.1 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '6cc244e6-b697-415e-b85f-754f4fffbe62'} Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:53.992900 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. Aug 27 21:02:54.000219 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.002757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 6cc244e6-b697-415e-b85f-754f4fffbe62 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.004061 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-737c2b7f-dee4-455d-bf58-5b9ee41d63d8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62" status: 404 len: 111 microversion: 2.1 time: 0.080811 Aug 27 21:02:54.005300 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1800/3497] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:53 2022] GET /compute/v2.1/servers/6cc244e6-b697-415e-b85f-754f4fffbe62 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.014228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.014730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.023690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.024534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.025371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.026082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.026616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.037398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.073916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 HTTP/1.1 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5d145188-a594-45b4-8181-8b2f9dbe53f5'} Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.081834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.086417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.088361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.090252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4ce2be5-b928-4751-b060-be33fc81fb34 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 404 len: 111 microversion: 2.1 time: 0.080381 Aug 27 21:02:54.098541 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1698/3498] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:54 2022] DELETE /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.106225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.110284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 5d145188-a594-45b4-8181-8b2f9dbe53f5] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.143757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.144695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.145471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.150902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.153340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.158375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.202764 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 HTTP/1.1 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5d145188-a594-45b4-8181-8b2f9dbe53f5'} Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.206217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. Aug 27 21:02:54.210456 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.224429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 5d145188-a594-45b4-8181-8b2f9dbe53f5 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.225876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0be7fc01-a1a4-4829-b092-8d5e04e802b4 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5" status: 404 len: 111 microversion: 2.1 time: 0.128787 Aug 27 21:02:54.230236 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1801/3499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/5d145188-a594-45b4-8181-8b2f9dbe53f5 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.238378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.239607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.247800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.253157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.254429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.255249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.255924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.267297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.268223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.268919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.288959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.296145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.296900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.300678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.301314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.301906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.319722 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a HTTP/1.1 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '287ce978-0c3f-4b10-8fbb-4ec5054ca75a'} Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.325796 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.332788 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3679dc60-a7a8-4b70-a2a1-20f30ef8343c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 404 len: 111 microversion: 2.1 time: 0.095278 Aug 27 21:02:54.337224 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1699/3500] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:54 2022] DELETE /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:02:54.346095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.346946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 287ce978-0c3f-4b10-8fbb-4ec5054ca75a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.358706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.360309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.361814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.362747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.375655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.376506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.398878 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a HTTP/1.1 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '287ce978-0c3f-4b10-8fbb-4ec5054ca75a'} Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.403228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. Aug 27 21:02:54.410310 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.411636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 287ce978-0c3f-4b10-8fbb-4ec5054ca75a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.420934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd2b2f1b-7093-4997-9a1d-9efbda10a894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a" status: 404 len: 111 microversion: 2.1 time: 0.079364 Aug 27 21:02:54.422728 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1700/3501] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/287ce978-0c3f-4b10-8fbb-4ec5054ca75a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.436712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-429d7ba5-9924-444d-927d-c31c542c1aa7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857cb1ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.526638 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-429d7ba5-9924-444d-927d-c31c542c1aa7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.099280 Aug 27 21:02:54.540306 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1701/3502] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:54.556101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.556878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.572000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.572701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.573374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.574277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.574931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.575556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.616584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f HTTP/1.1 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '05ff9cdd-9ec6-47d4-9a94-4b13efbd624f'} Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.620327 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.625522 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.627926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.628972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c847c38-83c8-4c46-9337-d57260c464f6 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 404 len: 111 microversion: 2.1 time: 0.087328 Aug 27 21:02:54.630662 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1702/3503] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:54 2022] DELETE /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.641681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.642312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.648683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.649176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.649616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.650368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.651290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.651914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.674281 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f HTTP/1.1 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '05ff9cdd-9ec6-47d4-9a94-4b13efbd624f'} Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.676013 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 05ff9cdd-9ec6-47d4-9a94-4b13efbd624f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.680975 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27e25ef1-72e2-4084-bc39-8efabe810915 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f" status: 404 len: 111 microversion: 2.1 time: 0.041664 Aug 27 21:02:54.681595 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1703/3504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/05ff9cdd-9ec6-47d4-9a94-4b13efbd624f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.686753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.687254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.695018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.695809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.696405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.698061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.699175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.699833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.732253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 HTTP/1.1 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7268dfc6-5d34-43fe-8fb9-f314a38cd7b1'} Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.734895 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.739526 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.741670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.752486 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00dbc703-8da4-4e2e-924b-d20b39e41ca9 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1" status: 404 len: 111 microversion: 2.1 time: 0.069691 Aug 27 21:02:54.759063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1704/3505] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:54 2022] DELETE /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.769342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.770585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.784273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.785530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.787701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.790144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.792087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.796850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.813060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:54.827509 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.828675 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8a007e0-7602-420c-aea7-eacf3cd1b013 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.579247 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 HTTP/1.1 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7268dfc6-5d34-43fe-8fb9-f314a38cd7b1'} Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.829079 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:02:54.835615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance 7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:54.836256 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1802/3506] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:54.837042 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46c3eef9-c7cc-4a81-a74e-b4823b0bbeff tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1" status: 404 len: 111 microversion: 2.1 time: 0.074865 Aug 27 21:02:54.842736 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1705/3507] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/7268dfc6-5d34-43fe-8fb9-f314a38cd7b1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:54.857403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.857918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.867379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.867885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.868330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.869043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.869497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.869922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.877302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:54.877987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:54.892320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.893761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.895787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.900234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:54.900968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:54.902477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:54.967221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:02:55.065355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:55.092903 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-30d7f934-70ff-44a9-8b6e-2cff8c24cedf tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1467 microversion: 2.1 time: 0.214727 Aug 27 21:02:55.093572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1706/3508] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:54 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1467 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:55.206563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b9cc0f-5151-46ae-90d1-e19a177568d1", "name": "network-vif-deleted", "tag": "b96703da-ab18-43ad-ad7b-01fc7e8394a4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:55.233739 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9e101f3-ecd1-447e-b134-c44a6c6b3502 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 204 len: 0 microversion: 2.1 time: 0.385457 Aug 27 21:02:55.239462 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1803/3509] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:02:54 2022] DELETE /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:02:55.248885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.249370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.249807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:55.256083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:55.259051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:55.282701 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] Creating event network-vif-deleted:b96703da-ab18-43ad-ad7b-01fc7e8394a4 for instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 on nch2-master-1 Aug 27 21:02:55.284688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.285428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.286982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:55.290336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.291139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.294677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:55.319021 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6896a06c-e2f8-4f61-a178-6fd895171371 req-4e76e0b4-ebf3-43ec-ac65-e7621a227b24 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116076 Aug 27 21:02:55.323690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1707/3510] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:55.545900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4dd7abf9-1cdb-4f91-83bd-378cdc0d5ab9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e114ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:55.638345 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4dd7abf9-1cdb-4f91-83bd-378cdc0d5ab9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.096832 Aug 27 21:02:55.639559 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1708/3511] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:55 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:55.664826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:55.685856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec9f5b1c-3be0-411a-8945-f9cf23d1f952 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1480 microversion: 2.1 time: 0.438345 Aug 27 21:02:55.685856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1804/3512] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:55 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1480 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:55.713332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "name": "network-vif-plugged", "status": "completed", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:55.751838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.757133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.760154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:55.789219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] Creating event network-vif-plugged:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:02:55.801263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5dffdcd9-26c2-46c3-914b-a2dd3e338381 req-2aa43de6-4250-4ee3-94d3-9ea3b796da72 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091594 Aug 27 21:02:55.804089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1709/3513] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:02:55.855654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:55.856280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:55.891328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.892196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.892689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:55.893417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:55.893892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:55.894315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:56.103176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:56.116170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:56.116897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:56.118033 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c160113-745e-4d0b-9c44-73acd6e4d36b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.267594 Aug 27 21:02:56.124882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:56.125822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:56.126671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:56.127700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:56.128488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:56.129090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:56.133666 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1805/3514] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:55 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:56.357670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:56.380512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7562947a-1560-451b-ad44-94bf01ee0c14 tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1467 microversion: 2.1 time: 0.269308 Aug 27 21:02:56.382203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1710/3515] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:56 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:56.654987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e52800d-a9c1-4703-915e-b77d3816b3c6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ecae820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:56.705750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:56.706484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:56.718307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:56.718815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:56.719262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:56.726317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:56.726889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:56.727264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:56.729715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e52800d-a9c1-4703-915e-b77d3816b3c6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.078335 Aug 27 21:02:56.730084 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1806/3516] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:56 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:57.109926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:57.132207 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86c1e0f2-acd3-4c6c-815a-1cfd573e6894 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1480 microversion: 2.1 time: 0.431417 Aug 27 21:02:57.147313 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1711/3517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:56 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1480 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:57.154172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:57.155620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:57.171808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:57.172322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:57.172760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:57.173487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:57.173944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:57.174365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:57.403398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:57.404884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:57.420170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:57.421143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:57.421759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:57.422787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:57.423417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:57.424358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:57.481002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:57.481824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:57.482415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:57.484538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lazy-loading 'fault' on Instance uuid 92b9cc0f-5151-46ae-90d1-e19a177568d1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:57.869158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e48795106941ff8b9c17f8676ae307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136abad8ea774a4db9af7e1d0b9f8de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:57.885532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1cf2d6cb-3f82-4830-85fd-3b2838301d1f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 200 len: 1306 microversion: 2.1 time: 0.481136 Aug 27 21:02:57.886614 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1712/3518] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:57 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 1306 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:02:57.892719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20823d57-c4ea-4383-9497-599fd03dd6bd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857c631f0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:57.992230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20823d57-c4ea-4383-9497-599fd03dd6bd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.104213 Aug 27 21:02:57.993123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1713/3519] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:57 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:58.062364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:58.080788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-541f6b67-a3d1-41bc-b5f0-779e6d950b5f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1323 microversion: 2.1 time: 0.944835 Aug 27 21:02:58.081335 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1807/3520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:57 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1323 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:58.158944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:58.159597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:58.173547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:58.174083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:58.174533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:58.175257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:58.187947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:58.188550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:58.498681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:58.511148 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88221047-1e3e-476b-83f0-4a1a63cf79e8 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1480 microversion: 2.1 time: 0.356061 Aug 27 21:02:58.513613 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1714/3521] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:58 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1480 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:58.912911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:58.915211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] [instance: 92b9cc0f-5151-46ae-90d1-e19a177568d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:58.932690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:58.933214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:58.933662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:58.934398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:58.934860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:58.937763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:58.979664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] HTTP exception thrown: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Request method failure captured: Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 HTTP/1.1 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZiWNM1BvXcjFIJ7dMp2AwSvYosCbLgubhqRsY4sz1_d0-niwrBJYVr-g0fw-uHkFK84YV_wPv297uC7mvjBUax1WMsLhX9s-qTBcpgqvVKWVAruXfUHNqXp2gbSa88yaGpblGKRG36u3a1oNKPIHS6_DSkSGN8zfUtZEcIOOkWw78 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 136abad8ea774a4db9af7e1d0b9f8de4 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerPasswordTestJSON-1013433555 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/136abad8ea774a4db9af7e1d0b9f8de4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/136abad8ea774a4db9af7e1d0b9f8de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_136abad8ea774a4db9af7e1d0b9f8de4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/136abad8ea774a4db9af7e1d0b9f8de4"}]}] Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerPasswordTestJSON-1013433555 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 136abad8ea774a4db9af7e1d0b9f8de4 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1013433555 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerPasswordTestJSON-1013433555-project Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: e6e48795106941ff8b9c17f8676ae307 Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerPasswordTestJSON-1013433555-project Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '92b9cc0f-5151-46ae-90d1-e19a177568d1'} Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:02:58.981460 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. Aug 27 21:02:58.986077 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:02:58.990404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] Returning 404 to user: Instance 92b9cc0f-5151-46ae-90d1-e19a177568d1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:02:58.993221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d2358fe-a17a-400e-9af3-e2b5cd16ea2f tempest-ServerPasswordTestJSON-1013433555 tempest-ServerPasswordTestJSON-1013433555-project] 10.222.0.40 "GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1" status: 404 len: 111 microversion: 2.1 time: 0.084361 Aug 27 21:02:58.996258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1808/3522] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:58 2022] GET /compute/v2.1/servers/92b9cc0f-5151-46ae-90d1-e19a177568d1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:02:59.007560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-969b7c0a-1b76-4503-b1de-834a75081855 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e73d670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:59.101623 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-969b7c0a-1b76-4503-b1de-834a75081855 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.097529 Aug 27 21:02:59.112011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:59.119846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:59.131829 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1715/3523] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:02:59 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:59.133895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.137016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.138816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.141399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.142011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.142552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.449449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7aff3d3-bde8-4425-9497-f076941eb88e", "name": "network-vif-unplugged", "status": "completed", "tag": "425d80a0-fb4c-41fe-8c2b-19075304a84f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:59.470843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.474054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.474700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.501468 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] Creating event network-vif-unplugged:425d80a0-fb4c-41fe-8c2b-19075304a84f for instance b7aff3d3-bde8-4425-9497-f076941eb88e on nch2-master-1 Aug 27 21:02:59.515502 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e2db8bf9-e8a1-404f-a420-510cfc952f50 req-3a2db03a-c1a8-471d-9002-f84bbe65c6e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073931 Aug 27 21:02:59.519402 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1716/3524] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:02:59.535365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:02:59.536368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:59.543883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.544595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.545291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.546185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.546805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.547418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.656946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:02:59.666642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-530089b2-a06e-43c8-a87f-878395df4f06 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1518 microversion: 2.1 time: 0.560033 Aug 27 21:02:59.678198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1809/3525] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:59 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1518 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:02:59.703084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:02:59.706788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:02:59.724073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.724677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.727434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.728286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:02:59.729046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:02:59.730916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:02:59.788489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lazy-loading 'flavor' on Instance uuid 945fca96-ed55-4a5d-822d-8866f70e7e6f {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:02:59.970584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:00.000488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a92da9c5-6382-4fce-b83b-54ba88c19491 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action" status: 200 len: 32 microversion: 2.1 time: 0.301802 Aug 27 21:03:00.002368 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1810/3526] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:02:59 2022] POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:03:00.031839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:00.033146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:00.047163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:00.049994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:00.050694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:00.054095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:00.059958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:00.060905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:00.440222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:00.455032 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59d4437b-1f49-40cf-bb9c-dd00f205c6f1 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1480 microversion: 2.1 time: 0.920949 Aug 27 21:03:00.468510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1717/3527] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:02:59 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1480 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:00.481271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0123279-5180-4c80-8848-cbd46f4b1675 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1494c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:00.547717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0123279-5180-4c80-8848-cbd46f4b1675 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.078025 Aug 27 21:03:00.548523 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1718/3528] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:00 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:00.828381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:00.837970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2e7f7b54-db92-4d52-8036-faccef3047ca tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.829725 Aug 27 21:03:00.848111 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1811/3529] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:00 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:01.203484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7aff3d3-bde8-4425-9497-f076941eb88e", "name": "network-vif-deleted", "tag": "425d80a0-fb4c-41fe-8c2b-19075304a84f"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:01.245575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.246454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.256493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:01.270864 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] Creating event network-vif-deleted:425d80a0-fb4c-41fe-8c2b-19075304a84f for instance b7aff3d3-bde8-4425-9497-f076941eb88e on nch2-master-1 Aug 27 21:03:01.277717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-08bacc45-96ff-46cd-b079-e5ad9fb455e3 req-5e7b627b-5522-4a44-bcc9-250dd4acd36d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079890 Aug 27 21:03:01.278907 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1719/3530] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:01.490516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:01.491663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:01.507938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.508884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.509640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:01.510774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.515305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.516094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:01.571631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a279517-81e8-4ff0-862b-dabcb39fd111 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e10a9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:01.593410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.595934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.599222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:01.600114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lazy-loading 'fault' on Instance uuid b7aff3d3-bde8-4425-9497-f076941eb88e {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:03:01.664147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a279517-81e8-4ff0-862b-dabcb39fd111 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.103849 Aug 27 21:03:01.666531 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1720/3531] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:01 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:01.753228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6872f5357c43bb8807f0141d9c3f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f0f97108e94d9582da49f0e58a0fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:01.766448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a41e2f7e-c796-4cc7-b322-d083c12d2594 tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 200 len: 1282 microversion: 2.1 time: 0.286991 Aug 27 21:03:01.767540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1812/3532] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:01 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:01.869417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:01.870635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:01.882090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.882882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.883996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:01.885118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:01.885962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:01.886858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:02.682052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3e9d63b-0d4f-418d-9930-ab65d291a614 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ec5a670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:02.763982 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a3e9d63b-0d4f-418d-9930-ab65d291a614 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.085982 Aug 27 21:03:02.765250 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1813/3533] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:02 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:02.796912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:02.797945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] [instance: b7aff3d3-bde8-4425-9497-f076941eb88e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:02.813556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:02.814250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:02.814707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:02.823869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:02.824654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:02.825296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:02.850109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] HTTP exception thrown: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Request method failure captured: Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e HTTP/1.1 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoVgiWSxd6i6Ga7O8ZZGkOrzossyLNaoyASRHq7ieCeKSQLDL2kKdUxTB3NpeCY4XHwtO2LHFG4cTAS2e1spY1RjiSTySBZvu114mqrNFzUPwq8sp5_0d4IpjOR9T5Ui2Q1_i2-OQfu7kyYi9VkypqabhcIyogBTzgSskLiqQsmMXwo Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestJSON-663589671 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d5f0f97108e94d9582da49f0e58a0fa6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d5f0f97108e94d9582da49f0e58a0fa6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d5f0f97108e94d9582da49f0e58a0fa6"}]}] Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestJSON-663589671 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d5f0f97108e94d9582da49f0e58a0fa6 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestJSON-663589671 Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestJSON-663589671-project Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7c6872f5357c43bb8807f0141d9c3f9b Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestJSON-663589671-project Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b7aff3d3-bde8-4425-9497-f076941eb88e'} Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:03:02.851857 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. Aug 27 21:03:02.857269 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:03:02.867434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] Returning 404 to user: Instance b7aff3d3-bde8-4425-9497-f076941eb88e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:03:02.868904 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-434cc99a-ff63-4d6e-956c-8b3616123b1c tempest-ServersTestJSON-663589671 tempest-ServersTestJSON-663589671-project] 10.222.0.40 "GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e" status: 404 len: 111 microversion: 2.1 time: 0.079803 Aug 27 21:03:02.870012 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1814/3534] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:02 2022] GET /compute/v2.1/servers/b7aff3d3-bde8-4425-9497-f076941eb88e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:03:03.729703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:03.740413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cccc8c93-3d6f-4b81-ab85-63f0185e8431 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.875542 Aug 27 21:03:03.743882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1721/3535] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:01 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:03.782958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6dff0be-0126-4011-aa05-876893cf25a7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee65310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:03.843878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6dff0be-0126-4011-aa05-876893cf25a7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.068474 Aug 27 21:03:03.848840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1815/3536] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:03 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:04.768466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:04.769130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:04.793067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:04.807921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:04.811266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:04.815009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:04.818025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:04.819996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:04.865149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56e15ba2-9097-408b-a509-233b0af33bb0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeb4d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:04.965343 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56e15ba2-9097-408b-a509-233b0af33bb0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.104857 Aug 27 21:03:04.969148 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1816/3537] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:04 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:05.984052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bbcb22e-20e4-406c-a3ed-138eda338869 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee284c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:06.042848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:06.059531 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87057e17-9959-437e-bafc-7308a1584271 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.288120 Aug 27 21:03:06.060978 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1722/3538] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:04 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:06.092490 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bbcb22e-20e4-406c-a3ed-138eda338869 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.113939 Aug 27 21:03:06.097058 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1817/3539] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:05 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:07.085339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:07.085964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:07.100275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:07.100775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:07.101213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:07.101931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:07.102382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:07.102813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:07.110748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-868dbe50-e50b-420b-bb8c-fe70a0e7557d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee70940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:07.257429 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-868dbe50-e50b-420b-bb8c-fe70a0e7557d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.150813 Aug 27 21:03:07.264254 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1818/3540] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:07 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:08.028754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:08.050458 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e715826-0387-43a2-95d6-b91b10712656 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.968966 Aug 27 21:03:08.054159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1723/3541] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:07 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:08.279003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58b54876-e40d-4436-a2ef-97449dd2293a tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee65c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:08.377537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58b54876-e40d-4436-a2ef-97449dd2293a tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.103271 Aug 27 21:03:08.378536 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1819/3542] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:08 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:09.078582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:09.081252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:09.094519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:09.095288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:09.097181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:09.098116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:09.100063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:09.106666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:09.393741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4d01cb59-c6e9-43cb-a856-a33bd8bb7098 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ec098b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:09.482172 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4d01cb59-c6e9-43cb-a856-a33bd8bb7098 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.089588 Aug 27 21:03:09.490642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1820/3543] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:09 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:09.776746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:09.793406 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-74c789f5-e0fb-415e-8a37-e1ce5b944336 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.719153 Aug 27 21:03:09.796099 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1724/3544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:09 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:10.498604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21e189e2-1c92-4ae0-a7df-f51929aeef36 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eef7ee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:10.586785 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21e189e2-1c92-4ae0-a7df-f51929aeef36 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.093195 Aug 27 21:03:10.603950 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1821/3545] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:10 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:10.830479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:10.831108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:10.857059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:10.859277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:10.861022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:10.861859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:10.864355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:10.864859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:11.617138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e809e09-218e-4786-81db-f6911028083b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84edc0dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:11.706736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:11.743448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9517697a-20aa-4182-9391-6ca4744ba76f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.919848 Aug 27 21:03:11.760470 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1725/3546] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:10 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:11.765776 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e809e09-218e-4786-81db-f6911028083b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.164661 Aug 27 21:03:11.778196 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1822/3547] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:11 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:12.772252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:12.773650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:12.782463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a02650c2-1b58-4a1c-9be2-24dd1b4494bb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee70a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:12.788814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:12.791833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:12.793274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:12.797488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:12.800524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:12.804240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:12.814336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:12.824811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:12.831116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=16 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:12.877616 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a02650c2-1b58-4a1c-9be2-24dd1b4494bb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.100022 Aug 27 21:03:12.893915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1823/3548] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:12 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:13.899256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e44e863-5dfd-421b-a824-189d5ea74cad tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee8a160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:14.029257 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e44e863-5dfd-421b-a824-189d5ea74cad tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.134158 Aug 27 21:03:14.029797 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1824/3549] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:13 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:14.266628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:14.280849 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d0c3c53-04ef-4029-a084-2a0dcb1934cb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.516589 Aug 27 21:03:14.283016 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1726/3550] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:12 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:15.045666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0c3acbc2-15dc-4575-a199-eae3320a714e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeb4310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:15.135036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0c3acbc2-15dc-4575-a199-eae3320a714e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1452 microversion: 2.1 time: 0.094545 Aug 27 21:03:15.136867 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1825/3551] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:15 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:15.314629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:15.318582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:15.335330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:15.335843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:15.336293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:15.338401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:15.339982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:15.340468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:16.151006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b4b7fb0f-339d-4d8a-8e60-9665b800e8e9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee8c700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:16.225148 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b4b7fb0f-339d-4d8a-8e60-9665b800e8e9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1461 microversion: 2.1 time: 0.073772 Aug 27 21:03:16.226530 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1826/3552] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:16 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1461 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:16.239552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c237607a-c7a5-4a8b-8f69-e7eda64f378b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda0f70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:16.316464 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c237607a-c7a5-4a8b-8f69-e7eda64f378b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 200 len: 1461 microversion: 2.1 time: 0.081012 Aug 27 21:03:16.317902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1827/3553] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:16 2022] GET /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:16.335555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:16.336740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:16.350640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:16.352466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:16.355437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:16.356651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:16.358646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:16.360916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:16.660346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:16.669462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fe43c62-f32d-42f1-821a-2fdab3772b9b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.363724 Aug 27 21:03:16.670766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1727/3554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:15 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:16.950060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:16.961103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03bc3223-bf29-4799-8568-283e702bfbd0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1479 microversion: 2.1 time: 0.633896 Aug 27 21:03:16.972235 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1828/3555] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:16 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1479 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:17.690772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:17.691398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:17.702171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=87 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:17.703714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:17.704221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:17.704652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:17.713548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:17.714456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:17.715067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:17.988253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:17.989039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:18.003762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:18.004280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:18.004722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:18.005656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:18.006128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:18.014340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:18.336881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:18.347296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c3c760e-5c11-40f6-9672-e99f27ab6416 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.660487 Aug 27 21:03:18.359720 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1728/3556] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:17 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:18.512502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:18.537100 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cdadb452-c8e7-4e1b-b963-a1090edcc933 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1466 microversion: 2.1 time: 0.552196 Aug 27 21:03:18.540022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1829/3557] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:17 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1466 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:18.570676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-310413709"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:18.573872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:18.594098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:18.597242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:18.597734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:18.601637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:18.603032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:18.607167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:19.118659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a137c4ba-52b8-4b1b-9f58-a31a1c6c26e7 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "POST /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29/action" status: 202 len: 0 microversion: 2.1 time: 0.553907 Aug 27 21:03:19.146134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1729/3558] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:03:18 2022] POST /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 21:03:19.152686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74ecfd80-ebef-48ad-b038-b7737e699894 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee70040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:19.234273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74ecfd80-ebef-48ad-b038-b7737e699894 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.105470 Aug 27 21:03:19.234954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1830/3559] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:19 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:19.372662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:19.373859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:19.388725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:19.391365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:19.397232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:19.399038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:19.400355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:19.401410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:19.889189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:19.902074 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-447ef143-b976-4de5-bccb-978e0850544a tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.535354 Aug 27 21:03:19.903813 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1730/3560] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:19 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:20.250739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-77220a54-b455-4845-892e-1c3ab7e23222 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857c63160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:20.355926 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-77220a54-b455-4845-892e-1c3ab7e23222 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.101147 Aug 27 21:03:20.364299 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1731/3561] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:20 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:20.928588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:20.929215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:20.942296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-570422832", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:20.951888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:20.954660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:20.955141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:20.955936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:20.962678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:20.963284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:21.097609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:03:21.630817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:21.646188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd9fe0ab-a831-428b-83e8-c7b6c261c7cc tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.720266 Aug 27 21:03:21.664564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1732/3562] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:20 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:21.687003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5fa3423-a79d-48c1-912b-9e4e9f2cc60f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e73d310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:21.771959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5fa3423-a79d-48c1-912b-9e4e9f2cc60f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.103139 Aug 27 21:03:21.772880 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1733/3563] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:21 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:22.108377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0031d696-f75e-420a-8e84-fbb6c75af16f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: .version_select at 0x7ff84e7133a0>, body: {"keypair": {"name": "tempest-keypair-2135449054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoqBqQmqEvNpFBzvrduj9JU4GK2VfF83Qlc4TUdCWQMhfSErE7RUph8vka/HLniNl8AAApBjJiw0a5KF0E1YWfB/fl6WSPG9RsbYmvohhpt3dXQv6lxNIZ7xPuhOqfa8g=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:22.177048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0031d696-f75e-420a-8e84-fbb6c75af16f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:22.203749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0031d696-f75e-420a-8e84-fbb6c75af16f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:22.269097 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0031d696-f75e-420a-8e84-fbb6c75af16f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.492728 Aug 27 21:03:22.270392 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1734/3564] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:03:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:22.281225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-unplugged", "status": "completed", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:22.320089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:22.322407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:22.324246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:22.358241 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] Creating event network-vif-unplugged:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:03:22.377324 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1fe2059b-7748-4103-9c93-50d2f4a472b5 req-f37b5f32-9346-4e7e-b234-cfe791805717 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100063 Aug 27 21:03:22.383733 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1735/3565] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:22.689136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:22.696051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:22.755076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:22.759012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:22.763043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:22.766407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:22.769115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:22.771034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:23.626559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:03:23.627754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:03:23.628239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:03:23.628669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:03:23.629088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:23.648066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:23.720957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:23.730743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:23.749631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:03:23.752670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:03:23.822095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:23.837765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11c3f444-8007-4627-9305-ccd7d780faae tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.167484 Aug 27 21:03:23.839317 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1736/3566] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:22 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:23.857042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-238ecbaf-e75e-49e7-bd31-34247bcc067f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e73d310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:23.872288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9842706-e488-4b8c-9838-3c584ae9485f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.753981 Aug 27 21:03:23.873646 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1831/3567] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:03:23.894416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42d76e65-b820-4ac5-8906-25e3e116384e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:23.896975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42d76e65-b820-4ac5-8906-25e3e116384e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:23.968843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-238ecbaf-e75e-49e7-bd31-34247bcc067f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.128235 Aug 27 21:03:23.980697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1737/3568] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:23 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:24.144480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42d76e65-b820-4ac5-8906-25e3e116384e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:24.159511 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42d76e65-b820-4ac5-8906-25e3e116384e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1214 microversion: 2.1 time: 0.274605 Aug 27 21:03:24.160434 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1832/3569] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:23 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:24.862508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:24.863902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:24.881132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:24.881569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:24.882109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:24.882845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:24.883310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:24.884277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:24.985000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2989a0ea-dfb1-43d2-b134-f6b437dd23e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee70040>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:25.060715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2989a0ea-dfb1-43d2-b134-f6b437dd23e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.079746 Aug 27 21:03:25.061527 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1833/3570] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:24 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:25.180828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:25.181474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:25.196292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:25.196814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:25.197265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:25.200251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:25.200736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:25.201182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:25.773058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:25.786191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86f81df8-1971-4291-8e4a-b016622b6d9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1210 microversion: 2.1 time: 0.609143 Aug 27 21:03:25.787641 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1834/3571] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:25 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1210 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:26.092559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Calling method '.version_select at 0x7ff84edc0a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:26.094859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.096354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.097615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:26.155554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.156371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.156991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:26.201897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.202668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.203279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:26.218677 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b0ffcbe-5dc7-43bc-892b-bee95b0b4ae6 tempest-PortsAdminExtendedAttrsTestJSON-1516703578 tempest-PortsAdminExtendedAttrsTestJSON-1516703578-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.429768 Aug 27 21:03:26.221956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1835/3572] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:03:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:26.227041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98018742-f797-4ce0-8804-7cc8d32c7212 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeecc10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:26.345040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98018742-f797-4ce0-8804-7cc8d32c7212 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.121695 Aug 27 21:03:26.346585 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1836/3573] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:26 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:26.548537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:26.558963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05bdd0df-7401-4e69-9412-499240d70ad1 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 1.702209 Aug 27 21:03:26.564503 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1738/3574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:24 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:26.808062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:26.808775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:26.815251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.815906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.816335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:26.817178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.817748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.818258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:26.940160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f92d3-aec4-4977-a112-8836503fee29", "name": "network-vif-plugged", "status": "completed", "tag": "e02cb11d-ed68-4f6c-bbb7-80ef86392ad0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:26.957992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:26.967233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:26.967886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:27.004217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] Creating event network-vif-plugged:e02cb11d-ed68-4f6c-bbb7-80ef86392ad0 for instance e26f92d3-aec4-4977-a112-8836503fee29 on nch1-master-1 Aug 27 21:03:27.016926 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-145904d3-66e4-4585-96e5-ae4a28070ebc req-1bb6d052-2f2b-405b-9610-e8833162dd22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080655 Aug 27 21:03:27.023223 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1739/3575] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:27.027881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:27.044473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-58e8ad47-380c-4d54-881c-96e0e3b6c1d6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1272 microversion: 2.1 time: 0.240201 Aug 27 21:03:27.059506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1837/3576] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:26 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:27.361220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dbd00516-b400-4351-a2a4-5f0c3dafc3b6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1193a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:27.467062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dbd00516-b400-4351-a2a4-5f0c3dafc3b6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.110436 Aug 27 21:03:27.469477 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1740/3577] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:27 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:27.587073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:27.588749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:27.602194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:27.603736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:27.606395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:27.609286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:27.610069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:27.611492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:28.077443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:28.079121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:28.109157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:28.112172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:28.113385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:28.115093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:28.117173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:28.118151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:28.455309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:28.469903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22756bb4-8c09-4b0f-b0db-6588231282d9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 0.887604 Aug 27 21:03:28.470876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1838/3578] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:27 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:28.490038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e11b521b-ab5d-4e5e-9726-7a791fb927f2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ed58670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:28.505412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:28.517396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0caa3f0d-7a0f-4ba2-9f38-2645b35a35ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1272 microversion: 2.1 time: 0.455270 Aug 27 21:03:28.520707 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1741/3579] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:28 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1272 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:28.567304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e11b521b-ab5d-4e5e-9726-7a791fb927f2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.081160 Aug 27 21:03:28.568363 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1839/3580] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:28 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:29.036598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-459465409", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f75aad2c-a76e-4365-abfb-15744ff8d972"}], "security_groups": [{"name": "tempest-securitygroup--1607312565"}], "key_name": "tempest-keypair-2135449054", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:29.493471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:29.494509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:29.549290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:29.559568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:29.560416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:29.561428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:29.565463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:29.566231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:29.773110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] validate_networks() for [('f75aad2c-a76e-4365-abfb-15744ff8d972', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:03:31.486751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:31.509027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7771ac8b-86bb-4c7d-9389-b4d7668e75bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1524 microversion: 2.1 time: 2.020316 Aug 27 21:03:31.512226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1840/3581] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:29 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1524 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:31.534456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:31.535480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:31.544050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:31.545011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:31.545980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:31.547129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:31.547889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:31.548655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:32.224769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:33.387870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:33.398254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9f2c36d-090b-4e2b-ba35-7273f46d5e9d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1314 microversion: 2.1 time: 1.884387 Aug 27 21:03:33.423706 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1841/3582] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:31 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1314 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:33.450851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cb6eb5a-2760-4159-976e-f2ccfb648d8b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeec700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:33.557207 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4cb6eb5a-2760-4159-976e-f2ccfb648d8b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.127906 Aug 27 21:03:33.558219 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1842/3583] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:33 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:33.569074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46927de4-b187-4263-a9f2-7dde0b552ac6", "tag": "41ba7275-15b5-4b06-a92b-8f404b59f149"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:33.629453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:33.630679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:33.641714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:33.663310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:03:33.664504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:03:33.665200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:03:33.666237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:03:33.667724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:03:33.674629 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] Creating event network-changed:41ba7275-15b5-4b06-a92b-8f404b59f149 for instance 46927de4-b187-4263-a9f2-7dde0b552ac6 on nch2-master-1 Aug 27 21:03:33.686282 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e32cb1b8-47f8-4dca-be7e-86d7f92eb943 req-b1889763-8863-48e2-ba57-20a701b637f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126028 Aug 27 21:03:33.691594 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1843/3584] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:33.697736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:33.703432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:33.703878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:33.704330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:33.705074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:33.705537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:33.705971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:33.708713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:33.712261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:33.729123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:33.733055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:33.733767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:33.735649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:33.738221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:33.739846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:33.777525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:33.794525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:33.828894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:03:33.832215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:03:33.939018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb68f3f4-3ba6-4424-8f3e-701b9f71a28a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.907686 Aug 27 21:03:33.948854 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1742/3585] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:03:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 4918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:03:33.965079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b4625d0-c896-409d-84aa-340a638f0692 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:33.967044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b4625d0-c896-409d-84aa-340a638f0692 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:34.142184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4b4625d0-c896-409d-84aa-340a638f0692 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:34.150967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:34.153852 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b4625d0-c896-409d-84aa-340a638f0692 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1238 microversion: 2.1 time: 0.200977 Aug 27 21:03:34.158204 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1743/3586] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:33 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1238 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:34.357572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:34.369048 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-935eacaa-8628-494c-b7b3-e53678501ec7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1504 microversion: 2.1 time: 0.674935 Aug 27 21:03:34.387762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1844/3587] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:33 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1504 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:34.397101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c8474c7-1c9b-4e4b-bc08-3433e5b53d5b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'create', calling method: .version_select at 0x7ff857c68b80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-636873835", "description": "tempest-description-1647371631"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:34.422772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:34.423496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:34.434721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:34.435246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:34.435723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:34.436453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:34.436960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:34.443774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:35.952006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:35.968289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-603e3863-22fc-4938-9809-98fc941f3522 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1314 microversion: 2.1 time: 1.543542 Aug 27 21:03:35.970694 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1845/3588] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:34 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1314 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:35.988201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bcfbae66-b7fc-4e86-94c4-da57dfb3169d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e682af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:36.081248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bcfbae66-b7fc-4e86-94c4-da57dfb3169d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.106474 Aug 27 21:03:36.088882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1846/3589] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:35 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:36.102813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:36.103815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:36.137404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:36.139038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:36.141328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:36.143313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:36.152717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:36.154027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:36.494226 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c8474c7-1c9b-4e4b-bc08-3433e5b53d5b tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 2.101474 Aug 27 21:03:36.494851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1744/3590] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:03:34 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:36.510144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:36.519277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-636873835"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:36.521282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:36.549775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-704639bf-9274-4803-b993-75ba18f90f45 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1290 microversion: 2.1 time: 0.462416 Aug 27 21:03:36.561924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:36.564438 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1847/3591] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1290 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:36.584142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:36.589373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:36.591869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:36.592451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:36.593535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:36.996831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:36.998323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:37.110339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:37.111033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:37.111783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:37.112537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:37.112999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:37.113699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:37.199218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.network.security_group_api [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Adding security group f71ae07f-c4b2-402a-bcb2-ddc4bb4b9720 to port db73b4a0-6085-463e-947d-d10c3b4825ef Aug 27 21:03:37.823292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:37.838222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3bf9d216-e1ca-4689-9727-091d1d91b4c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1314 microversion: 2.1 time: 0.845295 Aug 27 21:03:37.853315 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1848/3592] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:36 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:37.871399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bae0ae3f-cd48-4b19-bdf6-dcc4384ca4c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857dcb310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:37.952788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bae0ae3f-cd48-4b19-bdf6-dcc4384ca4c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.098240 Aug 27 21:03:37.954328 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1849/3593] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:37 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:37.978495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:37.979124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:37.996143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:38.000437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:38.002588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:38.003962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:38.009792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:38.010247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:38.173036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:38.195913 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-002fe68c-e068-4707-a56a-b06469c0bed8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1296 microversion: 2.1 time: 0.233002 Aug 27 21:03:38.198970 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1850/3594] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1296 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:39.255994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f891a0d-5d02-47c3-8ca4-cd2293c5ac14 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Action: 'create', calling method: .version_select at 0x7ff84eecaa60>, body: {"keypair": {"name": "tempest-keypair-442968011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUrinjm2YsWsrclcs3VfzRPy/aCjC2q2uZBzb8OgSDTmBhl0xKVdXXUapi3k+sW8RMvZorgJdXJ7pSuDVcAQzCZKViINng6VxnOt9NtIXH5nfOtiXL2WrCp0DsjcuYIEQ=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:39.329440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5f891a0d-5d02-47c3-8ca4-cd2293c5ac14 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Getting quotas for project cbfba7bee2de4b07b614be1fb9897414. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:39.352707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5f891a0d-5d02-47c3-8ca4-cd2293c5ac14 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Getting quotas for user 4dad9de98d1f4b628ebbcd88524cb501 and project cbfba7bee2de4b07b614be1fb9897414. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:39.408671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f891a0d-5d02-47c3-8ca4-cd2293c5ac14 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.056843 Aug 27 21:03:39.409753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1851/3595] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:03:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:39.421084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:39.421804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:39.438101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:39.439949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:39.440463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:39.443588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:39.444364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:39.444817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:39.733745 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-575cd43a-7f6a-41ba-9614-01927b30a163 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action" status: 202 len: 0 microversion: 2.1 time: 3.228979 Aug 27 21:03:39.734411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1745/3596] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:03:36 2022] POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action => generated 0 bytes in 3231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:03:39.741584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da5db8ea-d789-4789-ac73-b725ce5ea7e6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e10ab80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:39.828336 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da5db8ea-d789-4789-ac73-b725ce5ea7e6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.092458 Aug 27 21:03:39.850039 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1746/3597] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:39 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:39.869804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:39.871325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:39.879633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:39.880660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:39.881708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:39.886210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:39.887224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:39.888646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:40.328535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:40.347675 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20a42c92-3ed1-47b5-b3c6-ccbc3a4e4954 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1296 microversion: 2.1 time: 0.492467 Aug 27 21:03:40.348954 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1747/3598] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:39 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1296 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:40.363445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-636873835"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:40.366261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:40.387150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:40.388110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:40.388742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:40.391444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:40.394545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:40.395725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:40.533258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:40.561211 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad80728a-2236-423f-83cd-c48f18f6f264 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1314 microversion: 2.1 time: 1.149944 Aug 27 21:03:40.562220 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1852/3599] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:39 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1314 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:40.579729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:40.602491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:40.605472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:40.606369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:40.635944 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] Creating event network-changed:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:03:40.657442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f0e5c748-cbf3-4fa9-aa6d-9bf1de212ead req-65b81bad-9909-47ac-80c5-c35edb20c2c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087687 Aug 27 21:03:40.660255 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1853/3600] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:40.846267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32d0b150-08ac-41bc-9558-36107a73967e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f1ec700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:40.932153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32d0b150-08ac-41bc-9558-36107a73967e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.089602 Aug 27 21:03:40.936763 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1854/3601] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:40 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:41.376647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:41.377655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:41.404533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:41.407274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:41.407274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:41.407274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:41.415380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:41.415380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:41.920615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.network.security_group_api [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Removing security group f71ae07f-c4b2-402a-bcb2-ddc4bb4b9720 from port db73b4a0-6085-463e-947d-d10c3b4825ef Aug 27 21:03:42.225438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:42.245745 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f08dcfd7-ca6f-4a26-9ca1-0b861db4c03f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1296 microversion: 2.1 time: 0.880182 Aug 27 21:03:42.250439 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1855/3602] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1296 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:03:42.314375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46927de4-b187-4263-a9f2-7dde0b552ac6", "name": "network-vif-plugged", "status": "completed", "tag": "41ba7275-15b5-4b06-a92b-8f404b59f149"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:42.349502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:42.350726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:42.351366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:42.384901 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] Creating event network-vif-plugged:41ba7275-15b5-4b06-a92b-8f404b59f149 for instance 46927de4-b187-4263-a9f2-7dde0b552ac6 on nch2-master-1 Aug 27 21:03:42.409239 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-39760944-1a3f-4d22-ba4f-c008dbe65e08 req-471c79a9-b0c7-44e1-8c69-59448d6910f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155889 Aug 27 21:03:42.409909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1856/3603] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:42.424697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:42.425887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:42.461227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:42.467847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:42.475521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:42.501349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:42.501881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:42.502534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:42.521541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:43.754178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:43.859459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:43.872644 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0fe2cf12-5242-4ade-80c5-53767077e085 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1314 microversion: 2.1 time: 1.455474 Aug 27 21:03:43.895793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eb3966ff-301c-439a-a83e-0f04ed2d7c0f tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action" status: 202 len: 0 microversion: 2.1 time: 3.542801 Aug 27 21:03:43.897057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1748/3604] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:03:40 2022] POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action => generated 0 bytes in 3546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:03:43.904801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4b01bee-4f42-46b9-9b6d-eebf5f90a092 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e7133a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:43.907515 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1857/3605] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:42 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1314 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:43.925564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:43.928358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:43.958913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:43.969012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:43.971658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:43.972349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:43.973261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:43.974190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:43.988992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:44.046410 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4b01bee-4f42-46b9-9b6d-eebf5f90a092 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.148068 Aug 27 21:03:44.059085 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1749/3606] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:43 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:44.070320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:44.122739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:44.123597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:44.125176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:44.153899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:44.158729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:44.180186 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] Creating event network-changed:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:03:44.188472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8028d96f-a7a2-4111-bd32-59169988bc07 req-b3ece1f8-2486-4903-97cc-5557a1adce6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127655 Aug 27 21:03:44.193067 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1750/3607] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:44.198775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e54fd5af-85da-4f93-b310-a9c1961979e9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'create', calling method: .version_select at 0x7ff84e119700>, body: {"pool": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:45.338353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:45.352489 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9cb5d55d-b627-434a-9ce6-2ace99586457 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 1.443197 Aug 27 21:03:45.377304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1858/3608] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:43 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:45.388313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:45.389228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:45.406888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:45.407900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:45.410025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:45.410770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:45.411233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:45.411693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:46.067525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:46.082122 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5bba96be-8bc8-4408-8313-6e6677df81a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1502 microversion: 2.1 time: 0.703289 Aug 27 21:03:46.098255 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1859/3609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:45 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1502 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:46.110249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04471df7-69d9-4981-8bc5-7eb88f97c45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ebe5820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:46.177197 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04471df7-69d9-4981-8bc5-7eb88f97c45b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.076918 Aug 27 21:03:46.178094 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1860/3610] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:46 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:46.185145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "6dfc4ba9-bbc8-4d14-9351-36e60eaaf398"}], "security_groups": [{"name": "tempest-securitygroup--1055137171"}], "key_name": "tempest-keypair-442968011", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:46.853941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] validate_networks() for [('6dfc4ba9-bbc8-4d14-9351-36e60eaaf398', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:03:48.446129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:03:48.453632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:03:48.459977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:03:48.465334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:03:48.467851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:03:48.494939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:48.495881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:48.496566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:48.498270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:48.499165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:48.500326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:48.542880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Getting quotas for project cbfba7bee2de4b07b614be1fb9897414. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:48.561849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Getting quotas for user 4dad9de98d1f4b628ebbcd88524cb501 and project cbfba7bee2de4b07b614be1fb9897414. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:48.593114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:03:48.608212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:03:48.755752 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-698966c0-58c2-4f0b-acbd-3216cc4e9fb9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.574334 Aug 27 21:03:48.758633 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1861/3611] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:03:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:03:48.783038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:48.784515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:48.795579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:48.796290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:48.796826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:48.798649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:48.800018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:48.801018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:48.835475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:03:49.027776 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c109f69b-8c99-497e-962a-2c25901e9497 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 204 len: 0 microversion: 2.1 time: 0.258817 Aug 27 21:03:49.028572 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1862/3612] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:03:48 2022] DELETE /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:03:49.047805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:49.048810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:49.068049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:49.070182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:49.071618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:49.073410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:49.075130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:49.077859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.377367 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e54fd5af-85da-4f93-b310-a9c1961979e9 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.182954 Aug 27 21:03:50.378267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1751/3613] 10.222.0.40 () {60 vars in 1170 bytes} [Sat Aug 27 21:03:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:50.406718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:50.419042 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-226020cf-ce74-42d4-b610-b4d73fce2d8c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 1.385394 Aug 27 21:03:50.425222 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1863/3614] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:49 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:50.442203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0fe8675f-ccf7-4996-9f33-b22352a6b705 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eecad30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:50.615133 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0fe8675f-ccf7-4996-9f33-b22352a6b705 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.184261 Aug 27 21:03:50.615905 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1864/3615] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:50 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:50.624142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:50.667713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:50.668282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:50.668731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.700684 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] Creating event network-changed:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:03:50.712802 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-385baf83-2000-40dc-8762-032c7c724788 req-9dab1af4-05f6-4138-b5a6-a12380d372be service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092939 Aug 27 21:03:50.718711 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1865/3616] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:50.733506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:50.736107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:50.750832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:50.757274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:50.759057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-139db05e-e5ba-4af8-b90a-f0b340e54d3f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: .version_select at 0x7ff84e0f1a60>, body: {"keypair": {"name": "tempest-keypair-1730367766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED/RkFaxnEf27LxFB9iivJA02zvZ03lD+hRhGY7SXx7Ay/IGtI7Y2SusSluAhesQm6duT1ePEi4JkJE6nD10CWYU85HrY3eL6VmLj4QaLaojKtOXJ8znXyPYNWoBS5ohQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:50.759729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.760880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:50.763393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:50.764074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.782888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:50.824379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-139db05e-e5ba-4af8-b90a-f0b340e54d3f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:50.843681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-139db05e-e5ba-4af8-b90a-f0b340e54d3f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:50.913636 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-139db05e-e5ba-4af8-b90a-f0b340e54d3f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.522874 Aug 27 21:03:50.922826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1752/3617] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:03:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:50.944366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:50.945512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:50.976442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:50.978829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:50.979878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:50.980461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.983491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:50.985317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:50.987909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:50.995087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4bd84e61-7044-4fac-8adf-e9bef8a6f494 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1277 microversion: 2.1 time: 0.274806 Aug 27 21:03:50.998863 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1866/3618] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:50 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:51.022221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.5.174"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:51.031213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:51.063330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:51.064334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:51.064979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:51.065876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:51.072901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:51.075975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:51.179823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 21:03:51.184807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquired lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 21:03:51.622340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:51.646694 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a44e6b7-b153-4f27-807e-c4c8f51e0334 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1508 microversion: 2.1 time: 0.721118 Aug 27 21:03:51.650845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1753/3619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:50 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1508 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:51.685425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:51.686063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:51.708232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:51.708733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:51.709174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:51.709892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:51.720193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:51.723474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:52.180910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:52.204094 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73da5ce0-aa68-4b59-9b6c-55eacb694652 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 0.531719 Aug 27 21:03:52.204900 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1754/3620] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:51 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:52.217466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b15c98fb-1bd8-4fa9-9961-8211e4b8cd2b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0f1160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:52.306365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b15c98fb-1bd8-4fa9-9961-8211e4b8cd2b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.098095 Aug 27 21:03:52.313181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1755/3621] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:52 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:52.334187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:52.339510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:52.355324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:52.357611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:52.360916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:52.362376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:52.363536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:52.364551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:52.707302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:52.736533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7168d57d-c99d-4ec9-8d33-7804da309a89 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1277 microversion: 2.1 time: 0.416275 Aug 27 21:03:52.737146 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1756/3622] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:52 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1277 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:52.754853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46927de4-b187-4263-a9f2-7dde0b552ac6", "name": "network-vif-deleted", "tag": "41ba7275-15b5-4b06-a92b-8f404b59f149"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:52.792835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:52.795299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:52.796861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:52.845369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] Creating event network-vif-deleted:41ba7275-15b5-4b06-a92b-8f404b59f149 for instance 46927de4-b187-4263-a9f2-7dde0b552ac6 on nch2-master-1 Aug 27 21:03:52.870359 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b57a6e99-7cbf-4e0c-8abe-7c09cec5d0da req-2ce619cd-0a4c-4a7b-8916-41a45569ac90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128226 Aug 27 21:03:52.874855 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1757/3623] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:52.895090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:52.900276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:52.917124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:52.918071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:52.918793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:52.920125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:52.920824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:52.922195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:53.016228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:53.018237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:53.021781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:53.022589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lazy-loading 'fault' on Instance uuid 46927de4-b187-4263-a9f2-7dde0b552ac6 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:03:53.212375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:53.230253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3702b35-beca-4173-991a-1aebd67fe585 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 200 len: 1304 microversion: 2.1 time: 0.353698 Aug 27 21:03:53.237375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1758/3624] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:52 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 1304 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:53.278681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:53.281952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:53.301763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:53.302343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:53.302799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:53.303586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:53.304050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:53.304484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:53.963758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:53.980435 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7b76b69-ea9d-44e3-8b33-e30ea7ac6a6e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 0.735643 Aug 27 21:03:53.981161 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1759/3625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:53 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:53.998129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d705413-d5e7-45c6-a9e7-653e179402fb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e13d820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:54.084737 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d705413-d5e7-45c6-a9e7-653e179402fb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1452 microversion: 2.1 time: 0.102181 Aug 27 21:03:54.085846 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1760/3626] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:53 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:54.104247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:54.105191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:54.130959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:54.132806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:54.134134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:54.135715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:54.137011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:54.139270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:54.804125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:54.816131 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad8482e4-aec0-4b13-a19d-e1ea6f5c4305 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1283 microversion: 2.1 time: 0.728642 Aug 27 21:03:54.818937 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1761/3627] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:54 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1283 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:54.829401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:54.832512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:54.848673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:54.849608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:54.850317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:54.851268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:54.855835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:54.856738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:54.892488 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 HTTP/1.1 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '46927de4-b187-4263-a9f2-7dde0b552ac6'} Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:03:54.896903 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:03:54.901964 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:03:54.907690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:03:54.911147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79fb8d85-caf8-4718-a0e3-df6c2bf27e33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 404 len: 111 microversion: 2.1 time: 0.088723 Aug 27 21:03:54.914012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1762/3628] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:54 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:03:55.020589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:55.026390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:55.059033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:55.059660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:55.070580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:55.071381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:55.072139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:55.072413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:55.523283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 21:03:55.537526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:55.545965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29735fa5-cd98-4243-8e76-428cf7c95aa0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 0.542390 Aug 27 21:03:55.554098 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1763/3629] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:55 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:55.559893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7df916fd-24ab-4957-b64b-bc5d3f1d7ac9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0d79d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:55.624597 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7df916fd-24ab-4957-b64b-bc5d3f1d7ac9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1461 microversion: 2.1 time: 0.068956 Aug 27 21:03:55.625188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1764/3630] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:55 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1461 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:55.639042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1148608479", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:55.703928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:03:56.460412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:03:56.461452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:03:56.461452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:03:56.461703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:03:56.462130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:03:56.480963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.484375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.485009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.485948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.486607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.488358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.527995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:56.552790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:56.594704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:03:56.597149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:03:56.707507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Updating instance_info_cache with network_info: [{"id": "db73b4a0-6085-463e-947d-d10c3b4825ef", "address": "fa:16:3e:9d:08:e9", "network": {"id": "150feae6-2392-40c3-b3a2-d063bbe48630", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-763649901-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "13a67dcbc4854d028af4918901310a0b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdb73b4a0-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 21:03:56.712997 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b06df6d5-1221-4ea8-8750-cd911ef24fe0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078569 Aug 27 21:03:56.713670 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1765/3631] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:03:56.724179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:56.742933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Releasing lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 21:03:56.744564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6989081e-da7e-481d-a3a7-4695784c0f15 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action" status: 202 len: 0 microversion: 2.1 time: 5.743475 Aug 27 21:03:56.761146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.764000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.766596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.772839 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1867/3632] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:03:50 2022] POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action => generated 0 bytes in 5768 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 21:03:56.792318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0096d422-5901-47bc-9992-19c3947c539c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee65670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:56.809106 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] Creating event network-changed:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:03:56.832748 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-79643e96-29cf-4a2e-b0c7-ef754724b9d1 req-d5cd5473-df3a-46fa-a2da-c22431b81cf8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117265 Aug 27 21:03:56.833769 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1766/3633] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:56.841927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:56.865007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:56.880438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.882628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.883190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.885885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.886455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.887116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.897086 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0096d422-5901-47bc-9992-19c3947c539c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 200 len: 1461 microversion: 2.1 time: 0.122668 Aug 27 21:03:56.901441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1868/3634] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:03:56 2022] GET /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:56.927689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:56.929514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:56.956280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.957406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.958840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:56.961166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:56.962006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:56.966609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:57.373220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:57.385712 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63a57cab-514e-4207-af5f-aacd82f0c06f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.547614 Aug 27 21:03:57.388390 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1767/3635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:56 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:57.407566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-plugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:57.428309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:57.430799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:57.432855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:57.476385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] Creating event network-vif-plugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:03:57.490137 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bd2d22c1-36b4-4b6d-8ebc-6d2363a143b4 req-4755b65d-f820-459b-a789-7d67b0d6de6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100053 Aug 27 21:03:57.491573 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1768/3636] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:03:57.514559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244837160", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b51e83b-3888-45e9-b028-18277f96139f"}], "security_groups": [{"name": "tempest-securitygroup--421614496"}], "key_name": "tempest-keypair-1730367766", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:57.572601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:57.585859 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-da71c65c-9530-455d-810f-0feb5a9be5b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1364 microversion: 2.1 time: 0.683075 Aug 27 21:03:57.587620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1869/3637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:56 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1364 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:57.600326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:57.603066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:57.618777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:57.619265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:57.621450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:57.622369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:57.627976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:57.628811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:57.939177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:03:57.951534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18c7cce1-63e8-4bbc-839a-d1a821e65881 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1219 microversion: 2.1 time: 0.361957 Aug 27 21:03:57.952138 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1870/3638] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:57 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1219 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:03:57.969115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.5.174"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:03:58.099875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] validate_networks() for [('3b51e83b-3888-45e9-b028-18277f96139f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:03:58.277858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:58.288562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:58.290492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:58.291731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:58.292761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:58.294480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:58.295315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:58.517543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:58.580071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=10 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:03:59.293290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 21:03:59.293876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquired lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 21:03:59.504475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:03:59.505273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:03:59.505958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:03:59.506819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:03:59.507428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:03:59.522330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:59.523328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:59.523999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:59.525093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:59.525879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:59.526522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:59.552158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:03:59.560824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:03:59.583043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:03:59.586636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:03:59.669200 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81d0af85-a15f-4e27-8c55-9b8215c6bf4b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.176003 Aug 27 21:03:59.670690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1769/3639] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:03:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:03:59.676798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:03:59.678543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:03:59.699985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:59.701732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:59.702456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:03:59.704353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:03:59.705466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:03:59.706385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:00.220580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:00.230075 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7018de3-9a85-4ccb-8ee5-a29079c0bec8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1465 microversion: 2.1 time: 0.557935 Aug 27 21:04:00.231775 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1770/3640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:03:59 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1465 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:00.248145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:00.249412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:00.268823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:00.269329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:00.269774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:00.270493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:00.270954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:00.271409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:00.620618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:00.630406 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d4c4177-8d41-4227-839d-37ce8081ecf6 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.392873 Aug 27 21:04:00.631419 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1771/3641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:00 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:00.640075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:00.641371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:00.654638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:00.655435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:00.656051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:00.656975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:00.657630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:00.658287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:01.109681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Building network info cache for instance {{(pid=140434) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 21:04:01.170200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:01.179378 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a87b8e1-cc04-4c0a-9f14-4bf4e0c75b13 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1551 microversion: 2.1 time: 0.546631 Aug 27 21:04:01.184668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1772/3642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:00 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1551 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:01.199384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796226da-bbb0-4789-bc6c-198f2e0eb2d9", "tag": "840cb2a7-5643-4024-832f-9d123b71221d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:01.218202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:01.218698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:01.219133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:01.253254 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] Creating event network-changed:840cb2a7-5643-4024-832f-9d123b71221d for instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 on nch1-master-1 Aug 27 21:04:01.277554 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f6afa7f6-b696-4fac-a7ea-04cb167204a6 req-110a1e6d-2d83-4eec-b6b6-901476b01b6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090686 Aug 27 21:04:01.282414 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1773/3643] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:01.295529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:01.296317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:01.310645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:01.312112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:01.312772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:01.313688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:01.314323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:01.318586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:01.920801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:01.930265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5edf4d4a-6ba7-449d-bdeb-8849c7b4b499 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.646564 Aug 27 21:04:01.932076 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1774/3644] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:01 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:01.938153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:01.939422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:01.948638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:01.949538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:01.950236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:01.951196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:01.951960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:01.952932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.059064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:02.071289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58d02cf4-4490-4d8b-9946-989c4b1388f6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1300 microversion: 2.1 time: 0.137805 Aug 27 21:04:02.072876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1775/3645] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:01 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:02.080749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-538295121"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:02.083852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:02.093061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.093565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.094168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.094907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.095519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.096014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.166117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:02.482282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ddd1fa5b-d5de-465e-bf83-15bc663abd1d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "POST /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312/action" status: 202 len: 0 microversion: 2.1 time: 0.407887 Aug 27 21:04:02.484042 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1776/3646] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:04:02 2022] POST /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 21:04:02.493327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f92d3-aec4-4977-a112-8836503fee29", "name": "network-vif-unplugged", "status": "completed", "tag": "e02cb11d-ed68-4f6c-bbb7-80ef86392ad0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:02.505260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.505890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.506421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.537486 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] Creating event network-vif-unplugged:e02cb11d-ed68-4f6c-bbb7-80ef86392ad0 for instance e26f92d3-aec4-4977-a112-8836503fee29 on nch1-master-1 Aug 27 21:04:02.546914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0d1008e3-6cd0-4339-bcbb-fb4b74d388b5 req-c3b98ea9-1b70-4848-846b-63e7ee708e6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058320 Aug 27 21:04:02.547560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1777/3647] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:02.560229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:02.571871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.572787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.573431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.588475 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] Creating event network-changed:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:04:02.594122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-11295ff3-88da-475d-8aa4-93fa595ca9b8 req-535de95a-c477-4b11-8a2d-863984a8facb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045108 Aug 27 21:04:02.594931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1778/3648] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:02.601491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:02.602327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:02.610791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.611109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.612066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.612939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.613539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.614115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.743781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Updating instance_info_cache with network_info: [{"id": "db73b4a0-6085-463e-947d-d10c3b4825ef", "address": "fa:16:3e:9d:08:e9", "network": {"id": "150feae6-2392-40c3-b3a2-d063bbe48630", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-763649901-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "13a67dcbc4854d028af4918901310a0b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdb73b4a0-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 21:04:02.767064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Releasing lock "refresh_cache-945fca96-ed55-4a5d-822d-8866f70e7e6f" {{(pid=140434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 21:04:02.768739 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05ce5304-2ffd-4d82-92a8-8d9336a40507 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action" status: 202 len: 0 microversion: 2.1 time: 4.815109 Aug 27 21:04:02.773913 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1871/3649] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:03:57 2022] POST /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f/action => generated 0 bytes in 4821 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 21:04:02.786154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:02.787991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:02.802631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.803688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.804512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.804705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd464daa-1692-409d-a303-e8fb7f7e13e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207084 Aug 27 21:04:02.805485 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1779/3650] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:04:02 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:02.812894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44668c17-e05e-473b-9c6a-fdd8cf8756a1 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e143940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:02.813890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:02.819281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:02.820232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:02.887202 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44668c17-e05e-473b-9c6a-fdd8cf8756a1 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.077548 Aug 27 21:04:02.888729 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1780/3651] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:02 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:02.895854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7b3d00c-1fcb-4718-9f5b-2045d4db2375 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '.version_select at 0x7ff84e0ea040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:03.386641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:03.395027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bdc0a45d-040d-471a-afa8-fe58ae4a9e5f tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.619712 Aug 27 21:04:03.397762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1872/3652] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:02 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:03.406659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:03.410308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:03.422921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:03.426354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:03.426989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:03.427952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:03.428585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:03.434359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:04.002309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:04.010375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee8c80c9-f250-4e5e-8b45-0503e548b487 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.611550 Aug 27 21:04:04.017096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1873/3653] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:03 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:04.027526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:04.028166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:04.034547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:04.035307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:04.035969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:04.036885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:04.037530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:04.038159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:04.477441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:04.484726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:04.497930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a18a4b7d-1ddd-4281-89d8-d202d886ee3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.479036 Aug 27 21:04:04.499795 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1874/3654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:04 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:04.514293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32784941-4174-482b-87e3-c3b4addfb06e", "tag": "0623c413-a11c-4771-a053-0d1e8e391fc7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:04.536728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:04.537430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:04.538067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:04.557587 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] Creating event network-changed:0623c413-a11c-4771-a053-0d1e8e391fc7 for instance 32784941-4174-482b-87e3-c3b4addfb06e on nch2-master-1 Aug 27 21:04:04.565476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-90400db0-f5c6-4d53-85ca-1577c770be04 req-75d27d0e-cf82-400c-b23d-5a9290fab5f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064070 Aug 27 21:04:04.566840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1875/3655] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:04.573688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-184c425c-7421-49bf-b4a4-b28bca38529e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda03a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:04.632462 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-184c425c-7421-49bf-b4a4-b28bca38529e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.063803 Aug 27 21:04:04.640878 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1876/3656] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:04 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:04.646139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:04.646986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:04.654828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:04.655676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:04.656340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:04.657263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:04.657945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:04.658613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:05.258152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:05.267724 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e20c0171-d96c-46ad-a330-1306488ce689 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.628861 Aug 27 21:04:05.268839 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1877/3657] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:04 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:05.274767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:05.276019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:05.283227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:05.283985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:05.285506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:05.286257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:05.287012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:05.287615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:05.497334 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7b3d00c-1fcb-4718-9f5b-2045d4db2375 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "DELETE /compute/v2.1/os-floating-ips/5abcef7d-85a0-450e-a16d-070d5c181289" status: 202 len: 0 microversion: 2.1 time: 2.606891 Aug 27 21:04:05.498483 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1781/3658] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 21:04:02 2022] DELETE /compute/v2.1/os-floating-ips/5abcef7d-85a0-450e-a16d-070d5c181289 => generated 0 bytes in 2609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:04:05.507709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7a21f2d-0a7e-4800-b11d-e0c38a93e0fb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '.version_select at 0x7ff84e0eaaf0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:05.638359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:05.653965 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54340236-d0fb-4948-b564-6cc896445f1e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.383494 Aug 27 21:04:05.667261 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1878/3659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:05 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:05.667261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:05.667261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:05.674913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:05.675758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:05.677089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:05.677089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:05.677367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:05.677967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.020141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:06.032542 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-57ed5cf6-fd7b-4bc8-ad25-878aac18c7cc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.377097 Aug 27 21:04:06.033384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1879/3660] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:05 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:06.050332 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7a21f2d-0a7e-4800-b11d-e0c38a93e0fb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/f71ae07f-c4b2-402a-bcb2-ddc4bb4b9720" status: 202 len: 0 microversion: 2.1 time: 0.546381 Aug 27 21:04:06.056429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1782/3661] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:04:05 2022] DELETE /compute/v2.1/os-security-groups/f71ae07f-c4b2-402a-bcb2-ddc4bb4b9720 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:04:06.056927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0851f768-33d2-4be9-a785-cf26c156913f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f8cae50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:06.064136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:06.122624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.125473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.126876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.139063 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0851f768-33d2-4be9-a785-cf26c156913f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.099456 Aug 27 21:04:06.139941 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1880/3662] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:06 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:06.154223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:06.154862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:06.167163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.167707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.169882 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] Creating event network-changed:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:04:06.172253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.173399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.174140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.174751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.197043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-230a8556-6ad0-4312-a91b-f4544bdd0294 req-81814df6-7363-4c7f-abcc-a8c64126efc5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138039 Aug 27 21:04:06.198413 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1783/3663] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:06.246139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:06.289733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:06.290591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:06.317618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.318218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.320802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.322141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.324626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.325289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.452788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5679b846-4c3a-4b8e-b7b6-5a56ebd34c00 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "DELETE /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 204 len: 0 microversion: 2.1 time: 0.308473 Aug 27 21:04:06.455037 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1881/3664] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:06 2022] DELETE /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:06.474123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:06.476646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:06.497199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.499741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.500951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.502971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.504613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.508299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.694531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:06.703476 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e26af062-a363-4f33-8252-3f3e07002770 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.417950 Aug 27 21:04:06.705092 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1784/3665] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:06 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:06.720218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:06.721456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:06.731454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.732380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.733064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:06.734245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:06.734974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:06.735758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.045884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:07.054644 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75649853-20c6-4dc1-9449-efe3f2af8069 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.346087 Aug 27 21:04:07.056194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1785/3666] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:06 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:07.061154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796226da-bbb0-4789-bc6c-198f2e0eb2d9", "name": "network-vif-plugged", "status": "completed", "tag": "840cb2a7-5643-4024-832f-9d123b71221d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:07.077833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.078676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.079289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.094797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:07.095534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] Creating event network-vif-plugged:840cb2a7-5643-4024-832f-9d123b71221d for instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 on nch1-master-1 Aug 27 21:04:07.101676 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3c58194b-e3b1-4f5b-b03d-a5fd12d6270b req-67fc1f49-b5f2-42ff-9d27-68715bef12d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043742 Aug 27 21:04:07.103108 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1786/3667] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:07.110269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:07.111454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:07.112727 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94109ffd-e93b-4353-b9b6-cfc86e4d4b69 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1510 microversion: 2.1 time: 0.653287 Aug 27 21:04:07.123385 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1882/3668] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:06 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:07.123782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:07.125053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.125927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.126623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.129454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.130532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.131244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.157741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb67bab8-e3d3-4ed5-a34b-c811cb2bda94 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff8548bd670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:07.246568 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb67bab8-e3d3-4ed5-a34b-c811cb2bda94 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.094152 Aug 27 21:04:07.249916 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1883/3669] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:07 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:07.504204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:07.521233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a9ec94e-5a14-4c8f-8e85-f0bdb98cd52e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.416459 Aug 27 21:04:07.529495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1787/3670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:07 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:07.666819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bce13ff-c933-4dfa-8b52-c61a97a61491", "tag": "3f71a397-ab40-42f8-9253-da058ad73f44"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:07.689802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.690566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.691191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.709402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] Creating event network-changed:3f71a397-ab40-42f8-9253-da058ad73f44 for instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 on nch2-master-1 Aug 27 21:04:07.717949 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9b4821f0-58f0-46ad-b687-0381a8aadf65 req-ed05238f-b189-4f81-9cce-465415802fe8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055848 Aug 27 21:04:07.718874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1884/3671] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:07.729393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:07.731255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:07.744612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.745109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.745614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.746336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:07.746786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:07.747206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:07.968232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:07.980592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f446d025-5867-4a7d-86e4-72e8eefcc39d tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.256950 Aug 27 21:04:07.982741 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1788/3672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:07 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:08.079684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:08.080990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:08.089641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.091861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.092548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.094888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.096861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.097666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.146610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:08.155696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:08.165648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.167926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.169606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.170952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.173947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.176083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.384733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:08.396710 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cdd5b4f2-5f57-4e51-920a-b9246cf271e8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.321449 Aug 27 21:04:08.398544 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1885/3673] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:08 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:08.405044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b26bfc25-7966-4406-b685-adc7c0882fd3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f8ca820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:08.478049 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b26bfc25-7966-4406-b685-adc7c0882fd3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.078112 Aug 27 21:04:08.478852 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1886/3674] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:08 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:08.493479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:08.505184 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2ba5de6-baea-41c2-a776-c23692a9e5bb tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1510 microversion: 2.1 time: 0.367887 Aug 27 21:04:08.506716 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1789/3675] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:08 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:08.553915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:08.554557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:08.564764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.565536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.566183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.567848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:08.568624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:08.569472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:08.753010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:08.768772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-17112d0f-8b25-4746-9379-51dbbcdc85d5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.221864 Aug 27 21:04:08.770312 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1887/3676] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:08 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:09.013124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:09.016433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:09.025119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.026387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.027596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.029631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.030610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.031311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.279658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:09.289386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f71dc97-05d9-4d46-bab1-571d32a6f754 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1351 microversion: 2.1 time: 0.287835 Aug 27 21:04:09.291939 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1790/3677] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:09 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1351 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:09.418702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:09.420422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:09.464712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.465221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.467881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.468847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.469375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.470330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.494889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9192465e-24b1-47b9-979e-2c95e69195f5 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84efd3700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:09.539657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:09.556973 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9192465e-24b1-47b9-979e-2c95e69195f5 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.067736 Aug 27 21:04:09.557581 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1791/3678] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:09 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:09.569375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:09.570001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:09.572551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=16 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:09.582366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.583003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.583536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.584815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.585354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.585846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.745938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:09.755018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6f11bde6-fdbc-4b29-8ec0-123816016821 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.340604 Aug 27 21:04:09.755883 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1888/3679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:09 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:09.792426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:09.795214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:09.808876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.810785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.813635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.814490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.814981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.820256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:09.824738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.832400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a689d5d-3bd8-40b0-8d03-fad401f406a5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1510 microversion: 2.1 time: 0.266742 Aug 27 21:04:09.833011 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1792/3680] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:09 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:09.968495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945fca96-ed55-4a5d-822d-8866f70e7e6f", "name": "network-vif-deleted", "tag": "db73b4a0-6085-463e-947d-d10c3b4825ef"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:09.983549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:09.984184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:09.984809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:09.998573 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] Creating event network-vif-deleted:db73b4a0-6085-463e-947d-d10c3b4825ef for instance 945fca96-ed55-4a5d-822d-8866f70e7e6f on nch2-master-1 Aug 27 21:04:10.006712 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b769e16b-4e3a-4ac0-ba61-6b1825b03914 req-e86e9fd1-9f0d-481b-affe-106fc71a8901 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042437 Aug 27 21:04:10.008315 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1793/3681] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:10.059007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:10.070915 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1eafa903-f318-49d7-b4c7-835f2bab3e1e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.284315 Aug 27 21:04:10.072589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1889/3682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:09 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:10.319563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:10.320186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:10.330295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32784941-4174-482b-87e3-c3b4addfb06e", "name": "network-vif-plugged", "status": "completed", "tag": "0623c413-a11c-4771-a053-0d1e8e391fc7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:10.333380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.336105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.339540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.341065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.342807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.347910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.350243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.354826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.355277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.378693 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] Creating event network-vif-plugged:0623c413-a11c-4771-a053-0d1e8e391fc7 for instance 32784941-4174-482b-87e3-c3b4addfb06e on nch2-master-1 Aug 27 21:04:10.390436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cb61fa78-b77a-44d4-be32-ad83151945de req-91d9dc22-8458-4013-9020-e004be72bcc7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087500 Aug 27 21:04:10.392178 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1794/3683] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:10.574702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c579d17c-305f-414a-803a-2cb576acb5c8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f1d4940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:10.648442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c579d17c-305f-414a-803a-2cb576acb5c8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.079868 Aug 27 21:04:10.651007 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1795/3684] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:10 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:10.692663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:10.709601 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-530950a6-c0d1-43a2-9e92-566e8d69814e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1541 microversion: 2.1 time: 0.393676 Aug 27 21:04:10.719927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1890/3685] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:10 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1541 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:10.735888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:10.736868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:10.744975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.745739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.746423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.747378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.748049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.748482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.777251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:10.777992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:10.788589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.789195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.790656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.791901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.792303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.792738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.888058 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b0ce48b-f37f-4bb8-bcf5-7a6020620d20 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156561 Aug 27 21:04:10.889044 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1796/3686] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:04:10 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:10.897903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:10.899027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:10.906984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.908010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.908659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.909731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.910502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.911294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.962925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:10.963797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:10.964583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:10.965240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lazy-loading 'fault' on Instance uuid 945fca96-ed55-4a5d-822d-8866f70e7e6f {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:04:10.979610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:10.991954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d76d3a1c-f11f-4cb2-89b4-16dc8121e775 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.218270 Aug 27 21:04:10.993623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1891/3687] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:10 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:11.015495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:11.024545 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d47c7893-f376-423e-856d-aec0bc851527 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1313 microversion: 2.1 time: 0.133779 Aug 27 21:04:11.025213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1797/3688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:10 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1313 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:11.094897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:11.095716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:11.103525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:11.104368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:11.104835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:11.105781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:11.106251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:11.106756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:11.339524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:11.350378 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b84db44-7f2c-4f02-903a-23bce3512f90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.261438 Aug 27 21:04:11.351067 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1892/3689] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:11 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:11.664845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9d33fc4-f2ce-4690-b571-3496978f8f96 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857c68ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:11.720148 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9d33fc4-f2ce-4690-b571-3496978f8f96 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.059774 Aug 27 21:04:11.721257 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1798/3690] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:11 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:12.017181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:12.018657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:12.036847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.037706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.038376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.042611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.043975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.046361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.048134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:12.048945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:12.061191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.061711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.062167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.063082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.063978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.064710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.108076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.108928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.109788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.110852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lazy-loading 'fault' on Instance uuid 945fca96-ed55-4a5d-822d-8866f70e7e6f {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:04:12.180848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '244e4dc6363746338a78ab702d7a6777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a67dcbc4854d028af4918901310a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:12.190224 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d7f1f9a1-1bc0-4bfc-ab34-34668e1225f7 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 200 len: 1313 microversion: 2.1 time: 0.146909 Aug 27 21:04:12.190883 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1799/3691] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:12 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:12.246577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:12.255582 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10d8ab24-6d8a-438e-b0c2-d7877f3c6f48 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.243911 Aug 27 21:04:12.256186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1893/3692] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:12 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:12.372100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:12.372636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:12.380945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.381573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.382302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.385838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.386934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.388427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.411010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-plugged", "status": "completed", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:12.429603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.430477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.431567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.455014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] Creating event network-vif-plugged:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:04:12.463063 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f1cfe4b6-f811-438c-b58f-0c45c797de9e req-40aaaad0-e9c7-4b54-97d8-ea819fd89a80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056150 Aug 27 21:04:12.464377 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1894/3693] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:12.470812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796226da-bbb0-4789-bc6c-198f2e0eb2d9", "tag": "840cb2a7-5643-4024-832f-9d123b71221d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:12.482514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:12.483478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:12.484463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:12.499322 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] Creating event network-changed:840cb2a7-5643-4024-832f-9d123b71221d for instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 on nch1-master-1 Aug 27 21:04:12.506660 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-55f6b672-88f1-4f68-b22e-28c806a72995 req-9c2c4025-8ec2-4452-8ff3-949141d89c56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040053 Aug 27 21:04:12.508015 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1895/3694] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:12.627711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:12.643840 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d6bb3bc-4313-4d82-96d1-98081f4f6f9f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.274169 Aug 27 21:04:12.646285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1800/3695] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:12 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:12.740210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0862acbd-1959-414b-b50d-ba98b433cecc tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee65d30>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:12.866884 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0862acbd-1959-414b-b50d-ba98b433cecc tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.131578 Aug 27 21:04:12.874999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1896/3696] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:12 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:13.217555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:13.219429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] [instance: 945fca96-ed55-4a5d-822d-8866f70e7e6f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:13.232225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.233646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.235633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.237595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.239081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.240658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.281368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:13.283370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:13.292503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] HTTP exception thrown: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Request method failure captured: Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f HTTP/1.1 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoZqam11aHh5XAtJRvqTpf3v33lzbPCoN3WAEDq1YId8LyDRDEx_kTnWNmN-2cz54PhSEzvUtIGcwcwSgG-34pP3o-VqftS9Q-2ARN7CC9ikAnccL2ldY1AzWppblDwHRktY5NjnOfUYvu9pes3ICEsLp_-eWGpReCbjYyYF52HGZZU Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 13a67dcbc4854d028af4918901310a0b Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-109974168 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/13a67dcbc4854d028af4918901310a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/13a67dcbc4854d028af4918901310a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_13a67dcbc4854d028af4918901310a0b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/13a67dcbc4854d028af4918901310a0b"}]}] Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-109974168 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 13a67dcbc4854d028af4918901310a0b Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-109974168 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueTestJSONUnderV235-109974168-project Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 244e4dc6363746338a78ab702d7a6777 Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-109974168-project Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '945fca96-ed55-4a5d-822d-8866f70e7e6f'} Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:13.297448 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:13.307382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] Returning 404 to user: Instance 945fca96-ed55-4a5d-822d-8866f70e7e6f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:13.309113 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ba6fb12-34f2-4322-968a-de75750592e5 tempest-ServerRescueTestJSONUnderV235-109974168 tempest-ServerRescueTestJSONUnderV235-109974168-project] 10.222.0.40 "GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f" status: 404 len: 111 microversion: 2.1 time: 0.095135 Aug 27 21:04:13.312638 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1801/3697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:13 2022] GET /compute/v2.1/servers/945fca96-ed55-4a5d-822d-8866f70e7e6f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:13.316491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.317929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.318548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.319507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.322857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.326309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.378506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:13.667255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:13.668130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:13.680309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.685842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.686951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.687904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:13.692175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:13.694617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:13.774005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:13.793360 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0b8849b5-1fc2-41e8-931e-bd9f67f188ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1315 microversion: 2.1 time: 0.518961 Aug 27 21:04:13.793981 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1897/3698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:13 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:13.884043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-609d7761-de43-4db7-a96e-a7a44748b6cf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857d5e3a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:13.978327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-609d7761-de43-4db7-a96e-a7a44748b6cf tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.099257 Aug 27 21:04:13.987601 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1898/3699] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:13 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:14.492292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:14.494865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:14.512542 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c8219e9-849e-4f6f-a718-1e893e25c660 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.850806 Aug 27 21:04:14.516871 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1802/3700] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:13 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:14.819767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:14.820525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:14.823254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:14.846045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:14.848350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:14.849142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:14.850556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:14.854686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:14.857753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:14.995737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd4ef458-e304-42d3-84ac-e2cd04d7e05d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0d7160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:15.061436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd4ef458-e304-42d3-84ac-e2cd04d7e05d tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.070264 Aug 27 21:04:15.062346 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1803/3701] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:14 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:15.279132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:15.288966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-feb7e93e-cf75-4b53-987f-fcd82854088f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1502 microversion: 2.1 time: 0.475303 Aug 27 21:04:15.292839 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1899/3702] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:14 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:15.541968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:15.543576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:15.574622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:15.579078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:15.581429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:15.584667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:15.587827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:15.589240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:16.088900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d8be6c1-6f1c-4f6f-ab8a-171197fc0d72 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ef3b9d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:16.185315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d8be6c1-6f1c-4f6f-ab8a-171197fc0d72 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.100886 Aug 27 21:04:16.185874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1900/3703] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:16 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:16.576976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:16.592356 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f74f972-8eda-4362-aa35-f69fc3addd4c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 1.056105 Aug 27 21:04:16.593839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1804/3704] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:15 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:16.890822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bce13ff-c933-4dfa-8b52-c61a97a61491", "name": "network-vif-plugged", "status": "completed", "tag": "3f71a397-ab40-42f8-9253-da058ad73f44"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:16.914341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:16.914958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:16.915780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:16.949017 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] Creating event network-vif-plugged:3f71a397-ab40-42f8-9253-da058ad73f44 for instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 on nch2-master-1 Aug 27 21:04:16.959977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-94263fd6-25e2-4152-bd91-420c6af65d64 req-9160d30c-40e9-4571-aa5b-4330f24d089a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072903 Aug 27 21:04:16.960619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1901/3705] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:17.204145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6ceabd6-5db3-4593-82a6-606743627247 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0ea700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:17.290493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b676fbc-affb-4ef6-83b6-7851850043bf"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:17.294002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:17.300516 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6ceabd6-5db3-4593-82a6-606743627247 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.102752 Aug 27 21:04:17.312068 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1805/3706] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:17 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:17.332303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:17.333103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:17.334035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:17.335103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:17.335805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:17.336405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:17.614846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:17.615864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:17.643553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:17.644899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:17.647646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:17.648660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:17.652173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:17.655105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:17.956736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:17.969913 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-422d8686-784c-4737-93f0-836e734f535e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1367 microversion: 2.1 time: 0.359662 Aug 27 21:04:17.989453 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1806/3707] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:17 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:18.319618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0be4792c-c993-4820-b646-dca9c07cf07c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0eaca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:18.432733 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0be4792c-c993-4820-b646-dca9c07cf07c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.111782 Aug 27 21:04:18.433393 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1807/3708] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:18 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:18.996409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:18.997771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:19.012269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:19.013024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:19.014133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:19.027073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:19.027795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:19.028440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:19.110100 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.821791 Aug 27 21:04:19.117771 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1902/3709] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:04:17 2022] POST /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e/os-volume_attachments => generated 194 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:19.278611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:19.309606 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39bc023b-fec6-448c-9e99-73f13f9cf67d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1557 microversion: 2.1 time: 0.318118 Aug 27 21:04:19.310476 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1808/3710] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:18 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1557 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:19.342029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:19.342808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:19.368142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:19.369294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:19.370810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:19.373276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:19.374040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:19.380698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:19.448828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7351a405-3388-4c30-ab90-f7df2527233c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e112ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:19.549663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7351a405-3388-4c30-ab90-f7df2527233c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.104516 Aug 27 21:04:19.550479 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1809/3711] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:19 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:19.568567 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8ed3444-c4bb-4b26-9a9a-e03ee2e945f7 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232480 Aug 27 21:04:19.569403 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1903/3712] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:04:19 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:20.568934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2f3eea7-eae1-4062-87e4-e8a37b23e5a9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e137040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:20.683478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2f3eea7-eae1-4062-87e4-e8a37b23e5a9 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.120802 Aug 27 21:04:20.684391 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1810/3713] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:20 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:21.703701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f75d44af-f7c2-448a-875d-61c7e52c73bb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84ee8ce50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:21.834861 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f75d44af-f7c2-448a-875d-61c7e52c73bb tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.137917 Aug 27 21:04:21.835911 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1904/3714] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:21 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:21.880887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bce13ff-c933-4dfa-8b52-c61a97a61491", "tag": "3f71a397-ab40-42f8-9253-da058ad73f44"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:21.899442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:21.900200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:21.900865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:21.918300 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] Creating event network-changed:3f71a397-ab40-42f8-9253-da058ad73f44 for instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 on nch2-master-1 Aug 27 21:04:21.926823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2a03a1fc-3ca1-49dd-a439-f42623e394ed req-428ba5b2-82b4-4d2f-8f31-3d0ea9c9af1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050890 Aug 27 21:04:21.927822 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1811/3715] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:22.852423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9581b792-08a5-4dab-9fad-b3a6148916ce tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f055dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:22.951243 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9581b792-08a5-4dab-9fad-b3a6148916ce tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.104900 Aug 27 21:04:22.952136 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1905/3716] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:22 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:23.883952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:23.887532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:23.903774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:23.904446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:23.905067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:23.906407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:23.907035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:23.908225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:23.976917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:23.980798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1479dc7-d56d-4112-bf30-bb054d332783 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda0ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:24.095575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1479dc7-d56d-4112-bf30-bb054d332783 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.131899 Aug 27 21:04:24.104023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1906/3717] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:23 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:24.294861 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b571254-7d11-4c75-862a-cf48976305af tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 204 len: 0 microversion: 2.1 time: 0.415273 Aug 27 21:04:24.296608 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1812/3718] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:23 2022] DELETE /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:24.311544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:24.314796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:24.326603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:24.327599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:24.328400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:24.330738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:24.331832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:24.332909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:24.674452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:24.687898 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c208038c-5a81-40b4-9b58-1367273765fe tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1554 microversion: 2.1 time: 0.384872 Aug 27 21:04:24.688717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1907/3719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:24 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1554 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:25.111087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-122ed389-3df0-4eb3-a9f6-0baf8ace2cad tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e094310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:25.203776 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-122ed389-3df0-4eb3-a9f6-0baf8ace2cad tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.096997 Aug 27 21:04:25.209696 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1813/3720] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:25 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:25.712723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:25.713906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:25.724129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:25.726028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:25.728110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:25.729045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:25.729697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:25.730288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:26.220294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6a25e6e-c2b7-4636-a4cb-4084293078bd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e094550>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:26.298737 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6a25e6e-c2b7-4636-a4cb-4084293078bd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.082440 Aug 27 21:04:26.299716 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1814/3721] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:26 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:26.650526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:26.663363 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-073fdc52-939d-46dc-bb1b-c59d10e21526 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1554 microversion: 2.1 time: 0.954988 Aug 27 21:04:26.665104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1908/3722] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:25 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1554 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:27.316520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1011c524-2e80-4907-aa17-af800c36e9de tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0bea60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:27.418989 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1011c524-2e80-4907-aa17-af800c36e9de tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.108612 Aug 27 21:04:27.422677 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1815/3723] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:27 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:27.689969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:27.690576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:27.702976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:27.703554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:27.703956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:27.704687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:27.705162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:27.705702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:27.902322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:27.919363 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-80215fa8-911f-43ad-b7e6-964199c95932 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1512 microversion: 2.1 time: 0.235295 Aug 27 21:04:27.925127 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1909/3724] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:27 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:28.437877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e618b556-ebc8-4812-a4be-a803db256fd8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e11f280>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:28.519389 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e618b556-ebc8-4812-a4be-a803db256fd8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.086195 Aug 27 21:04:28.520096 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1816/3725] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:28 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:28.626493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32784941-4174-482b-87e3-c3b4addfb06e", "name": "network-vif-deleted", "tag": "0623c413-a11c-4771-a053-0d1e8e391fc7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:28.662869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:28.665890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:28.666342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:28.734021 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] Creating event network-vif-deleted:0623c413-a11c-4771-a053-0d1e8e391fc7 for instance 32784941-4174-482b-87e3-c3b4addfb06e on nch2-master-1 Aug 27 21:04:28.752274 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-84938244-5a11-4a11-8629-2337208b665e req-fe046870-d1ae-41fb-b21d-3522b49a7bfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146432 Aug 27 21:04:28.777377 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1910/3726] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:28.947615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:28.948832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:28.971611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:28.974719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:28.978308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:28.980784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:28.987151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:28.988036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:29.171187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:29.185745 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8749084-8486-43f6-a69f-9d787a9aeaee tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 200 len: 1346 microversion: 2.1 time: 0.243355 Aug 27 21:04:29.186341 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1817/3727] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:28 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 1346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:29.537757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a1a123d-544c-4a80-ab32-34a1b0727f74 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f93f1f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:29.668456 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a1a123d-544c-4a80-ab32-34a1b0727f74 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.132551 Aug 27 21:04:29.669169 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1911/3728] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:29 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:30.206207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:30.206837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:30.214139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:30.214629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:30.223482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:30.224462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:30.224953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:30.225393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:30.252041 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e HTTP/1.1 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '32784941-4174-482b-87e3-c3b4addfb06e'} Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:30.257264 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.263140 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.269604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:30.270754 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3494de7-8f00-4a1d-88c6-7f522e3d46d5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 404 len: 111 microversion: 2.1 time: 0.068530 Aug 27 21:04:30.275183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1818/3729] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:30 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:30.453490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:30.457501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:30.496728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:30.519050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:30.523644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:30.526560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:30.529823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:30.530554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:30.569394 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e/os-volume_attachments HTTP/1.1 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': '32784941-4174-482b-87e3-c3b4addfb06e'} Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:30.579881 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:04:30.587813 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:30.594337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:30.596352 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8d06bf6-77da-43c2-a830-ebc5c9c3843a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.147494 Aug 27 21:04:30.598589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1912/3730] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:04:30 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e/os-volume_attachments => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:30.686339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fea2ebd9-6c46-4637-b79a-6edd8906b6a8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0f4c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:30.959666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-402666325", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:31.211674 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fea2ebd9-6c46-4637-b79a-6edd8906b6a8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.528922 Aug 27 21:04:31.214218 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1819/3731] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:30 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:31.291147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:04:32.229283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64b845cf-7af7-43b3-a858-580d5b12b560 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e137af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:32.307403 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64b845cf-7af7-43b3-a858-580d5b12b560 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.079765 Aug 27 21:04:32.308198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1820/3732] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:32 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:32.454969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:04:32.456632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:04:32.457299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:04:32.457969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:04:32.458557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:04:32.479235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:32.481925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:32.484017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:32.486439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:32.487147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:32.487821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:32.543642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:04:32.555878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:04:32.589776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:04:32.593734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:04:32.695150 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65fde16b-cce0-4ffd-ab3f-81389e188075 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741125 Aug 27 21:04:32.698886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1913/3733] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:04:32.709824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-76ea3195-d470-4f11-9c7d-35784edc6941 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:32.710599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-76ea3195-d470-4f11-9c7d-35784edc6941 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:32.831971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-76ea3195-d470-4f11-9c7d-35784edc6941 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:32.839946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-76ea3195-d470-4f11-9c7d-35784edc6941 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae" status: 200 len: 1214 microversion: 2.1 time: 0.134089 Aug 27 21:04:32.852708 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1821/3734] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:32 2022] GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:32.878171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc1075f3-f718-41f1-a47e-b65476628ffa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:32.878837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dc1075f3-f718-41f1-a47e-b65476628ffa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:32.906274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dc1075f3-f718-41f1-a47e-b65476628ffa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:33.323542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a457067b-04ee-4385-bff0-8763e460e46c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1373a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:33.387381 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc1075f3-f718-41f1-a47e-b65476628ffa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae" status: 204 len: 0 microversion: 2.1 time: 0.518824 Aug 27 21:04:33.391599 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1914/3735] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:32 2022] DELETE /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:33.416146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:33.419658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:33.446624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a457067b-04ee-4385-bff0-8763e460e46c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.123803 Aug 27 21:04:33.447272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1822/3736] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:33 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:33.508560 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae HTTP/1.1 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '72bdbb8c-8d8c-463a-b92a-efa874daaeae'} Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:33.521362 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe2441ac-3140-4f85-abca-1c8118fd4426 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae" status: 404 len: 111 microversion: 2.1 time: 0.125648 Aug 27 21:04:33.528124 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1915/3737] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:33 2022] GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:33.873929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-388975342", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:34.056245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:04:34.465009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c8985ef-8243-4727-8fbe-74b25c34407f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857db94c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:34.519429 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c8985ef-8243-4727-8fbe-74b25c34407f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.060502 Aug 27 21:04:34.520163 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1916/3738] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:34 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:35.535167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-948bf612-dcca-46ae-8e42-611657d99d4b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f9c5700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:35.644457 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-948bf612-dcca-46ae-8e42-611657d99d4b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1452 microversion: 2.1 time: 0.113590 Aug 27 21:04:35.645367 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1917/3739] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:35 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:35.703690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:04:35.704262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:04:35.705998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:04:35.706980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:04:35.708029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:04:35.725733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:35.726667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:35.727794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:35.729490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:35.730378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:35.730819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:35.761507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:04:35.777937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:04:35.809207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:04:35.812054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:04:35.932118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81082954-124b-4543-812d-180fde557a47 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066274 Aug 27 21:04:35.933006 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1823/3740] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:04:35.945419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae11f1bc-c6a7-451b-a8d9-ed8a463f2498 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:35.946338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae11f1bc-c6a7-451b-a8d9-ed8a463f2498 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:36.116484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae11f1bc-c6a7-451b-a8d9-ed8a463f2498 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:36.134903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae11f1bc-c6a7-451b-a8d9-ed8a463f2498 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1214 microversion: 2.1 time: 0.194638 Aug 27 21:04:36.137690 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1918/3741] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:35 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:36.434209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-171119893", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:36.501930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] validate_networks() for [('13aa375b-8d4e-4b5e-890e-fb0d2980573c', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:04:36.660201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b550665-5021-48f8-b4f5-b8efa7167b09 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84edc0280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:36.734075 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b550665-5021-48f8-b4f5-b8efa7167b09 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1461 microversion: 2.1 time: 0.077881 Aug 27 21:04:36.735280 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1919/3742] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:36 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1461 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:36.753805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50723857-7e9e-498c-9fb5-dc9cacb8bae0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f694b80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:36.858001 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50723857-7e9e-498c-9fb5-dc9cacb8bae0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 200 len: 1461 microversion: 2.1 time: 0.112784 Aug 27 21:04:36.859080 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1920/3743] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:36 2022] GET /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:36.874779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:36.876327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:36.891598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:36.897959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:36.898812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:36.899947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:36.900595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:36.901872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:37.326026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:37.337513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e5b3cf5-a831-4a16-9247-1ee6ac607e11 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1479 microversion: 2.1 time: 0.468003 Aug 27 21:04:37.343133 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1921/3744] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:36 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1479 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:37.358320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:37.359131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:37.372068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:37.372265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:04:37.372754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:04:37.373295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:04:37.373933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:04:37.374073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:37.375364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:04:37.375862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:37.376672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:37.377331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:37.378457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:37.379105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:37.406603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:37.407254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:37.408462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:37.410796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:37.412630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:37.413180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:37.456415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:04:37.477780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for user 5d8126f174f5424ebdcc1f062ffb9b69 and project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:04:37.493822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:04:37.496826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:04:37.529953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:37.546630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3deabb55-a51c-4b08-b089-9c9623d57983 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1266 microversion: 2.1 time: 0.201795 Aug 27 21:04:37.547591 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1922/3745] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:37 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:37.570263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ff0072e7-6d5f-4ff4-83ac-fd76450ef01d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.424743 Aug 27 21:04:37.572139 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1824/3746] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:04:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:04:37.592081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3b932c7-35a3-4080-99c9-2733e891aabd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:37.592861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3b932c7-35a3-4080-99c9-2733e891aabd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:37.680816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3b932c7-35a3-4080-99c9-2733e891aabd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:37.689324 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3b932c7-35a3-4080-99c9-2733e891aabd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1221 microversion: 2.1 time: 0.110496 Aug 27 21:04:37.689928 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1923/3747] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:37 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:37.877563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1972922808", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:38.021625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] validate_networks() for [('13aa375b-8d4e-4b5e-890e-fb0d2980573c', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:04:38.364359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:38.365444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:38.383481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.384823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.386800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.387752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.398399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.400788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.714407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:38.725175 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-131110c0-124e-47e1-bf05-9507cf5554dd tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1466 microversion: 2.1 time: 0.364658 Aug 27 21:04:38.725774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1924/3748] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:38 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1466 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:38.736114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:38.739688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:38.767495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.767871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.768312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.769030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.769486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.769921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.925701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:04:38.926322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:04:38.926666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:04:38.927078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:04:38.927701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:04:38.941325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.942922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.943651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.946136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:38.946774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:38.947501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:38.981352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:04:38.994244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for user 5d8126f174f5424ebdcc1f062ffb9b69 and project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:04:39.007773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:39.016455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:04:39.017568 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2298007b-890a-4990-9b03-df869f147af7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1272 microversion: 2.1 time: 0.285162 Aug 27 21:04:39.018176 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1925/3749] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:38 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:39.028700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:04:39.030261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e57ad55e-a118-4056-b66b-b6423e27ac2e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e5d39d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.155281 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4da5200-41e8-41ce-afa0-ef159428d19e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.282680 Aug 27 21:04:39.156258 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1825/3750] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:04:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:04:39.168069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fa11a1e-527b-42e0-9d93-80d5f3f75160 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.169130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2fa11a1e-527b-42e0-9d93-80d5f3f75160 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:39.246065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e57ad55e-a118-4056-b66b-b6423e27ac2e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?changes-since=2022-08-27T21%3A02%3A11Z" status: 200 len: 2373 microversion: 2.1 time: 0.220732 Aug 27 21:04:39.248040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1926/3751] 10.222.0.40 () {58 vars in 1199 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?changes-since=2022-08-27T21%3A02%3A11Z => generated 2373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:39.267155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-738aac0d-b1d5-4c70-a229-8b99ca5bc4a0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda0820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.346693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fa11a1e-527b-42e0-9d93-80d5f3f75160 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:39.358537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fa11a1e-527b-42e0-9d93-80d5f3f75160 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1222 microversion: 2.1 time: 0.194247 Aug 27 21:04:39.360333 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1826/3752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:39.413935 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-738aac0d-b1d5-4c70-a229-8b99ca5bc4a0 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1705468822" status: 200 len: 485 microversion: 2.1 time: 0.152751 Aug 27 21:04:39.414674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1927/3753] 10.222.0.40 () {58 vars in 1231 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1705468822 => generated 485 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:39.430370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3fd34187-bd2e-43d7-acfa-c689d5ea1a8c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e080ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.585740 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3fd34187-bd2e-43d7-acfa-c689d5ea1a8c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?server=a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 956 microversion: 2.1 time: 0.160022 Aug 27 21:04:39.586743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1827/3754] 10.222.0.40 () {58 vars in 1209 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?server=a350818b-8ecc-45bd-900d-0f17518fd312 => generated 956 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:39.608468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f04dc6c2-f626-472c-a697-fd8db74e0327 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeecc10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.721627 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f04dc6c2-f626-472c-a697-fd8db74e0327 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 484 microversion: 2.1 time: 0.123082 Aug 27 21:04:39.724561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1928/3755] 10.222.0.40 () {58 vars in 1317 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29 => generated 484 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:39.741648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a986fb9-8666-43a9-9c96-c028e419e22b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0adb80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:39.834534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a986fb9-8666-43a9-9c96-c028e419e22b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 484 microversion: 2.1 time: 0.101066 Aug 27 21:04:39.844239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1828/3756] 10.222.0.40 () {58 vars in 1303 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29 => generated 484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:39.854012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3cd3d9e-4ed4-4d8d-be34-2ec32fb4ba93 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e02c940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.052133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.052772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:40.083010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:40.088426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:40.088682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:40.092981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:40.093222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:40.096865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:40.300483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3cd3d9e-4ed4-4d8d-be34-2ec32fb4ba93 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.452341 Aug 27 21:04:40.313342 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1929/3757] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 21:04:39 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:40.331687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa8e1377-e7e0-48cd-b873-0d3afbf8a989 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eeec700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.482938 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa8e1377-e7e0-48cd-b873-0d3afbf8a989 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.165796 Aug 27 21:04:40.483589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1930/3758] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:40.502413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.505695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:40.523303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:40.524804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:40.528049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:40.529039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:40.532649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:40.533593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:40.553493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:40.565287 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72e87646-f596-490c-9c04-83e049b62576 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.527323 Aug 27 21:04:40.570247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1829/3759] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:40.585996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c90c49f-dc91-4a35-9ad9-7c6b778d515c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0adee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.693203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:40.697429 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c90c49f-dc91-4a35-9ad9-7c6b778d515c tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.125324 Aug 27 21:04:40.698250 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1830/3760] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:40.709977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff1aa775-228a-4766-a4af-edf0c12cf0b2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1274 microversion: 2.1 time: 0.214525 Aug 27 21:04:40.720782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-af78f252-c31b-4b32-8cd3-5782ef7ae932 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e7133a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.726258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1931/3761] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:40.829459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-unplugged", "status": "completed", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:40.834948 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-af78f252-c31b-4b32-8cd3-5782ef7ae932 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T21%3A02%3A07Z" status: 200 len: 6326 microversion: 2.1 time: 0.125048 Aug 27 21:04:40.836837 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1831/3762] 10.222.0.40 () {58 vars in 1220 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T21%3A02%3A07Z => generated 6326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:40.846353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:40.846744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:40.847809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:40.869141 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] Creating event network-vif-unplugged:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:04:40.872340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78bc83e0-1e35-493b-99ec-8722ee819875 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0eaf70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:40.876911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-dec9e711-c9b1-4356-a42a-276347c8bc99 req-e621a450-153c-43d5-9b52-2438d7cef079 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051611 Aug 27 21:04:40.878091 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1932/3763] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:41.415687 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78bc83e0-1e35-493b-99ec-8722ee819875 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1705468822" status: 200 len: 665 microversion: 2.1 time: 0.561328 Aug 27 21:04:41.416599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1832/3764] 10.222.0.40 () {58 vars in 1252 bytes} [Sat Aug 27 21:04:40 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1705468822 => generated 665 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:41.433390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfd5bb37-0db1-474f-8862-e15f2bbbc756 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda08b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.499448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfd5bb37-0db1-474f-8862-e15f2bbbc756 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1464 microversion: 2.1 time: 0.070703 Aug 27 21:04:41.500440 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1933/3765] 10.222.0.40 () {58 vars in 1338 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fv2.1%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29 => generated 1464 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:41.517265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc7ee89b-10bd-458d-8ca2-2bf62ef88510 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e13d9d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.588358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.589092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:41.601908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:41.602815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:41.603588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:41.605924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:41.606657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:41.607350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:41.614180 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc7ee89b-10bd-458d-8ca2-2bf62ef88510 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1464 microversion: 2.1 time: 0.099939 Aug 27 21:04:41.615057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1833/3766] 10.222.0.40 () {58 vars in 1324 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.40%2Fcompute%2Fservers%2Fe26f92d3-aec4-4977-a112-8836503fee29 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:41.634678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b2949327-aad6-40bf-8b6f-f1efc119d56b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e0addc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.765281 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b2949327-aad6-40bf-8b6f-f1efc119d56b tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.135809 Aug 27 21:04:41.767817 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1834/3767] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:41.788009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:41.797636 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa86c6b3-aa74-4f7e-9821-df890869b23d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.213870 Aug 27 21:04:41.807483 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1934/3768] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:41.807483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.807483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:41.810142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:41.810881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:41.811648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:41.812612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:41.813271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:41.815119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:41.902390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:41.912364 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-628ab397-7e8a-45d1-bc97-809e972a1c75 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1280 microversion: 2.1 time: 0.112413 Aug 27 21:04:41.913168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1935/3769] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:41.918905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b072bde0-f2bd-472a-aff8-f74827b627e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda0ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:41.939153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1931002623", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "e59e5087-7f09-4984-8507-a6dcd69ddbde"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:42.004308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] validate_networks() for [('e59e5087-7f09-4984-8507-a6dcd69ddbde', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:04:42.010061 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b072bde0-f2bd-472a-aff8-f74827b627e3 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.095529 Aug 27 21:04:42.011288 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1936/3770] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 21:04:41 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:42.029265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-771aea18-5790-4faa-b807-a3a128fe6fe4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e5d3670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:42.078914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-771aea18-5790-4faa-b807-a3a128fe6fe4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e" status: 200 len: 784 microversion: 2.1 time: 0.055272 Aug 27 21:04:42.079670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1937/3771] 10.222.0.40 () {58 vars in 1233 bytes} [Sat Aug 27 21:04:42 2022] GET /compute/v2.1/images/3c9ca970-c391-4d4a-9934-78cc80446a1e => generated 784 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:42.095067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-253488d2-73b2-464c-abc5-91b927c4ebb2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e682160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:42.152617 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-253488d2-73b2-464c-abc5-91b927c4ebb2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.062342 Aug 27 21:04:42.153671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1938/3772] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 21:04:42 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:42.169909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47ce8ebc-3882-4fea-87f5-12adcb2f0bd4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84eda03a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:42.419783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:04:42.420365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:04:42.420653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:04:42.421137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:04:42.421538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:04:42.433150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:42.433628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:42.434067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:42.434802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:42.435282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:42.435804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:42.454963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Getting quotas for project 6d783e6e60ee46e3841e787bc32692d9. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:04:42.461557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Getting quotas for user 2080e683fd744eda8f9f2ad156e6b045 and project 6d783e6e60ee46e3841e787bc32692d9. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:04:42.490848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:04:42.493726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:04:42.522563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:42.552875 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d555c076-cc73-402f-91aa-2f1021ab2a27 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780415 Aug 27 21:04:42.552875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1835/3773] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:04:42.570051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7833c46c-fca0-45f9-b752-434ceb38a2ac tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:42.571965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7833c46c-fca0-45f9-b752-434ceb38a2ac tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:42.724449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7833c46c-fca0-45f9-b752-434ceb38a2ac tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:42.735862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7833c46c-fca0-45f9-b752-434ceb38a2ac tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1214 microversion: 2.1 time: 0.176970 Aug 27 21:04:42.742573 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1836/3774] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:42 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:42.821896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:42.822873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:42.833448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:42.835640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:42.837631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:42.838616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:42.839806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:42.841372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.036292 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47ce8ebc-3882-4fea-87f5-12adcb2f0bd4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07" status: 204 len: 0 microversion: 2.1 time: 0.870146 Aug 27 21:04:43.042832 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1939/3775] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:42 2022] DELETE /compute/v2.1/images/dcacdb80-c321-42a3-9024-05aa3c1e9c07 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:04:43.052021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:43.053997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:43.074569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:43.075313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:43.075804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.077104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:43.077574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:43.078004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.113754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:43.354694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:43.367827 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-adc4dd54-58de-48b9-a652-b8f40e02e8c3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1280 microversion: 2.1 time: 0.322870 Aug 27 21:04:43.383765 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1940/3776] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:43 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1280 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:43.401757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-12480027-89e5-4874-846e-1598a999d2ef tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84f37af70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:43.668454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:43.678508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-916cced8-9a03-4bc0-b1f2-22399f63af33 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.861532 Aug 27 21:04:43.681838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1837/3777] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:42 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:43.696860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a807372-5608-40dd-aaac-1a93480a4911", "tag": "bd8baa82-0163-4041-a0cd-779d22b774d4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:43.712966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:43.714123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:43.714817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.741909 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] Creating event network-changed:bd8baa82-0163-4041-a0cd-779d22b774d4 for instance 4a807372-5608-40dd-aaac-1a93480a4911 on nch2-master-1 Aug 27 21:04:43.759576 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b876941c-36cd-4170-bb5f-ba93c3fedb22 req-4894bfa2-4611-4cb4-adac-d3590e763be2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076229 Aug 27 21:04:43.761173 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1838/3778] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:43.776842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:43.778153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:43.785719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:43.786450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:43.787046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.788472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:43.789779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:43.790468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:43.912472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:43.924091 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3715fc67-a6da-45bb-b3f0-a25d7b7c1e4a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1210 microversion: 2.1 time: 0.161077 Aug 27 21:04:43.950166 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1839/3779] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:43 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:44.357223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-12480027-89e5-4874-846e-1598a999d2ef tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f" status: 204 len: 0 microversion: 2.1 time: 0.970943 Aug 27 21:04:44.363755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1941/3780] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:43 2022] DELETE /compute/v2.1/images/ba2eedf7-5b5f-48ed-9296-305f55cee84f => generated 0 bytes in 976 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:44.369219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d17dc71-a747-4992-bf9e-568994ba4ed4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e1b14c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:44.391002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:44.393748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:44.411878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:44.414859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:44.417706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:44.420220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:44.421015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:44.423004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:44.762485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:44.772782 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09ba6b57-385b-4e70-986e-82c989992754 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.387067 Aug 27 21:04:44.789337 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1942/3781] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:44 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:44.802921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:44.808237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:44.819426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:44.820046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:44.820951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:44.822203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:44.822885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:44.823628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.098472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d17dc71-a747-4992-bf9e-568994ba4ed4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817" status: 204 len: 0 microversion: 2.1 time: 0.733288 Aug 27 21:04:45.103055 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1840/3782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:44 2022] DELETE /compute/v2.1/images/429a1348-f8c5-4e82-9a0e-7062ef80f817 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:45.107422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:45.108793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:45.118534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.119096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.119525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.120947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.121428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.122358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.129297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:45.230220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:45.237389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:45.239130 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b499c8b-8767-44d8-ad3c-55fad8c57f62 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.447694 Aug 27 21:04:45.251263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4daca1b-b870-42fc-bf88-81c74170ec6e tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1272 microversion: 2.1 time: 0.149977 Aug 27 21:04:45.252461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1841/3783] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:45 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:45.254717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1943/3784] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:44 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:45.260100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:45.260603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:45.266847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.267358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.267808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.268558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.269191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.269755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.306488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:45.430957 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-801c18f8-35ec-4a5e-9001-de2c1ef724d4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 204 len: 0 microversion: 2.1 time: 0.176300 Aug 27 21:04:45.432118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1842/3785] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:45 2022] DELETE /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:45.441306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:45.442640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:45.445065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:45.452172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.452926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.453619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.454792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.455250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.456586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.683676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:45.698912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7d71691-84f5-4118-bc49-ebd381e3ab61 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1471 microversion: 2.1 time: 0.261981 Aug 27 21:04:45.713455 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1944/3786] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:45 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:45.796840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:45.797455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:45.803815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.804313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.804810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.806076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.806391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.807055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.835202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9133a12-8ade-4172-8ebf-cf81a8e3122b", "tag": "38211ab7-bb51-4b28-b052-7dd55bbd2ec2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:45.849509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:45.850484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:45.851274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:45.871895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] Creating event network-changed:38211ab7-bb51-4b28-b052-7dd55bbd2ec2 for instance c9133a12-8ade-4172-8ebf-cf81a8e3122b on nch1-master-1 Aug 27 21:04:45.878087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6424403e-2b22-413e-8379-84cb5502ff51 req-bf55fb57-024b-48f8-a972-3cc5ebcd1b98 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047405 Aug 27 21:04:45.879004 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1945/3787] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:46.024794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:46.034200 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fbef32e-9518-4e63-9318-2cc2f6dffe7d tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.241468 Aug 27 21:04:46.034569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1843/3788] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:45 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:46.263698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:46.264623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:46.272609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:46.273190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:46.282486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.282975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.283436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.284137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.284579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.285002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.291393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.292130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.292755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.293651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.294087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.294741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.507963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:46.515073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:46.524619 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0b1af10-7b6a-4aa4-b4d2-d67a4413849c tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.255762 Aug 27 21:04:46.526016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfe7f809-5258-47bb-9132-1a8462079e78 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.266620 Aug 27 21:04:46.526620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1946/3789] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:46 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:46.527756 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1844/3790] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:46 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:46.723738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:46.724538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:46.734741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.735214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.735729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.736440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:46.736893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:46.737319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:46.883451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:46.892576 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a72ce8d7-b198-490e-b850-e9bf908daf7f tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1471 microversion: 2.1 time: 0.172929 Aug 27 21:04:46.893308 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1947/3791] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:46 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:47.055782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:47.056853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:47.063320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.064751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.065448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:47.066158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.066949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.067392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:47.561921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:47.562521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:47.569874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.570380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.571255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:47.571774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.572235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.572660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:47.686009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:47.814072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:47.823525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6013b2f5-d37a-4d2e-a344-4ab36896303e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.771736 Aug 27 21:04:47.824089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1845/3792] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:47 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:47.830028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:47.830830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:47.842733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.843286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.844057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:47.845980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:47.846563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:47.847286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.140096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:48.151055 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e259451f-b9d0-4e12-8605-40befbb871e9 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.593060 Aug 27 21:04:48.152265 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1948/3793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:47 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:48.156939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07479cc-0162-4f91-afb1-59a070704d0a", "tag": "1073f6ac-a607-4655-9afc-bc62716d5188"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:48.167912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.168440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.168877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.181409 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] Creating event network-changed:1073f6ac-a607-4655-9afc-bc62716d5188 for instance a07479cc-0162-4f91-afb1-59a070704d0a on nch2-master-1 Aug 27 21:04:48.186929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2dc71d13-a201-498c-b921-3b88b54cc255 req-bf18d90b-16c0-448c-83a8-fad6bb5a2687 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033341 Aug 27 21:04:48.187597 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1949/3794] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:48.192649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:48.193359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:48.200009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.200498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.200947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.201658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.202121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.202551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.210407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:48.224452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e986c8f0-b06a-4672-b524-06dc8b113ce5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.398617 Aug 27 21:04:48.225155 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1846/3795] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:47 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:48.506203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:48.515045 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-80937af0-dfff-43a2-a0b3-028300949b77 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1471 microversion: 2.1 time: 0.326288 Aug 27 21:04:48.515685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1950/3796] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:48 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:48.610111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42310c09-5e3a-43a9-9ede-bbf683949956", "tag": "127bb487-03e9-441a-ac88-a363dab92cfd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:48.621113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.621601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.622146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.633711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] Creating event network-changed:127bb487-03e9-441a-ac88-a363dab92cfd for instance 42310c09-5e3a-43a9-9ede-bbf683949956 on nch1-master-1 Aug 27 21:04:48.638983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-78c60f4c-cc34-4036-a46e-e397956efeec req-eb55290f-24ea-4649-a736-bd655b71484c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032680 Aug 27 21:04:48.639625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1847/3797] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:48.845463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:48.846063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:48.853617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.854134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.854583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:48.855290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:48.855794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:48.856226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.061970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:49.070941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6c0a891-fc01-48b4-a212-383faf51bbf3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.229507 Aug 27 21:04:49.071607 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1951/3798] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:48 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:49.173723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:49.174435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:49.181473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.181944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.182389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.183098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.183620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.184052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.249394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:49.250022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:49.256930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.257428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.258086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.258833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.259302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.259759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.432283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:49.440302 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc75c6e5-58f7-4c3e-a12e-fe3489503fa4 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.271193 Aug 27 21:04:49.440929 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1848/3799] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:49 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:49.479484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:49.487776 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c57b3e58-16c7-49a8-978f-4a6588e1f362 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.245424 Aug 27 21:04:49.489630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1952/3800] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:49 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:49.537208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:49.537829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:49.544111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.544673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.545114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.545816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:49.546268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:49.546691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:49.871906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:49.882515 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6ab232d-ee54-4e71-9090-d35c4063fa12 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1471 microversion: 2.1 time: 0.348832 Aug 27 21:04:49.884159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1849/3801] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:49 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:50.092967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:50.093629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:50.101275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.102125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.102930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:50.103873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.104473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.104915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:50.463966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:50.468838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:50.475546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:50.506388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6dfdbf2-bdd6-4e63-a0c8-ef5d9c73c764 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.397083 Aug 27 21:04:50.508190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.525744 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1953/3802] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:50 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:50.528877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.529348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:50.530126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.530594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.531028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:50.539117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:50.539759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:50.572670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.573727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.574852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:50.577071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:50.578733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:50.581381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.083637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:51.099578 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab05062f-0f9c-4b04-8be0-7da063db7088 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.570946 Aug 27 21:04:51.102937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1954/3803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:50 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:51.114185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26f92d3-aec4-4977-a112-8836503fee29", "name": "network-vif-deleted", "tag": "e02cb11d-ed68-4f6c-bbb7-80ef86392ad0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:51.138646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:51.143192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.145537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.146020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.153136 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7063889-bc89-4ed5-b0b4-2b662c250ef7 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.694153 Aug 27 21:04:51.155702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1850/3804] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:50 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:51.170766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:51.171848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:51.192294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.194013 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] Creating event network-vif-deleted:e02cb11d-ed68-4f6c-bbb7-80ef86392ad0 for instance e26f92d3-aec4-4977-a112-8836503fee29 on nch1-master-1 Aug 27 21:04:51.195048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.196262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.199621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.203508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.205397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.208487 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-bd2a8bad-4d71-42a2-97e1-a02c66ec2a20 req-080253ee-e8f0-4a55-b64e-7d9394070fac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103964 Aug 27 21:04:51.212968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1955/3805] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:51.290661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.291493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.291634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.295664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lazy-loading 'fault' on Instance uuid e26f92d3-aec4-4977-a112-8836503fee29 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:04:51.499799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:51.515714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd4dbcc6-8e38-4a32-a31b-94689ccd9f03 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 200 len: 1307 microversion: 2.1 time: 0.356997 Aug 27 21:04:51.516360 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1851/3806] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:51 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:51.538341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:51.540268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:51.547735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.548543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.549258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.550221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:51.550899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:51.551750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:51.720557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:51.732250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f791b5f-ac93-48b3-97a9-7573649fbcd0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.199339 Aug 27 21:04:51.733050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1956/3807] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:51 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:52.122517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.123142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.142483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.144461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.147672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.148466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.152272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.153023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.182804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.184144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.204131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.204630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.205058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.206439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.207106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.207784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.409729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:52.424551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-156ade2e-0129-4dfb-9ccf-9fc73d696156 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.305618 Aug 27 21:04:52.425859 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1852/3808] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:52 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:52.445079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:52.455167 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08a48e05-4201-4726-8c9c-b36fc17a9753 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.278029 Aug 27 21:04:52.455943 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1957/3809] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:52 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:52.538415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.541220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: e26f92d3-aec4-4977-a112-8836503fee29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.544931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:52.563444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.564001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.564730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.565510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.566757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.567204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.586294 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] HTTP exception thrown: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Request method failure captured: Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 HTTP/1.1 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoZOhCAataWtAxgXgJCcaRrWEm9h7N8dylwvm4PgKnmoeX5vPsGA8mRNwOiExVJgQPo0MK86TigAgwoCQY4KhFfk0Bzk6iAEfehttz6fMNdABIhuroJmTcsjFhM8_e3OclNopG9hELFPik0USStQ700K-MqyrQJMNYzPPKb7eCyLpYw Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f7aafa82d7904f0aa64297caa208d731 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7aafa82d7904f0aa64297caa208d731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7aafa82d7904f0aa64297caa208d731"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7aafa82d7904f0aa64297caa208d731", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7aafa82d7904f0aa64297caa208d731"}]}] Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f7aafa82d7904f0aa64297caa208d731 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ListImageFiltersTestJSON-774915738-project Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2bfeec4f9c624115a4500998cd5715d7 Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ListImageFiltersTestJSON-774915738-project Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e26f92d3-aec4-4977-a112-8836503fee29'} Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:52.588540 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Returning 404 to user: Instance e26f92d3-aec4-4977-a112-8836503fee29 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fb3c55e8-abe0-45d5-98b4-93849daaad55 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29" status: 404 len: 111 microversion: 2.1 time: 0.056083 Aug 27 21:04:52.594875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1853/3810] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:52 2022] GET /compute/v2.1/servers/e26f92d3-aec4-4977-a112-8836503fee29 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:52.600929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.601508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.611317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.611903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.612661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.615091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.615616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.616336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.648778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:52.700107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:52.743109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c4b0f82-dfca-4056-994e-ddde07608693 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 204 len: 0 microversion: 2.1 time: 0.144946 Aug 27 21:04:52.743754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1958/3811] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:52 2022] DELETE /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:52.753630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.754592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.756566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=30 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:52.764368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:52.765079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:52.770101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.771093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.771819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.772068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.772755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.773206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.773460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.774891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.775241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:52.775735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:52.776038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:52.776161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.104056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:53.113014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f1dbc22-dc63-40c5-a8fc-59e700942ed8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.352995 Aug 27 21:04:53.113609 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1959/3812] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:52 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:53.131454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:53.149976 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d201ac1-ca6d-4bff-a47e-194b6fab8656 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1472 microversion: 2.1 time: 0.399910 Aug 27 21:04:53.150998 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1854/3813] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:52 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:53.271114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a807372-5608-40dd-aaac-1a93480a4911", "name": "network-vif-plugged", "status": "completed", "tag": "bd8baa82-0163-4041-a0cd-779d22b774d4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:53.281956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:53.282524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:53.283017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.296139 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] Creating event network-vif-plugged:bd8baa82-0163-4041-a0cd-779d22b774d4 for instance 4a807372-5608-40dd-aaac-1a93480a4911 on nch2-master-1 Aug 27 21:04:53.301307 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-757b3fd5-c7c7-4d57-85d3-aa765cb181f1 req-0b020e99-2796-45df-aedc-47f72515cf2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186611 Aug 27 21:04:53.302269 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1960/3814] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:53.450091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:53.450715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:53.460514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:53.461365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:53.461969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.462855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:53.463536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:53.464135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.479876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:53.480866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:53.495707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:53.500029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:53.500807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.501871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:53.502502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:53.503100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:53.748523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:53.758147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7faba15a-9e75-4c72-b72d-7471997856b6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.312947 Aug 27 21:04:53.767930 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1855/3815] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:53 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:53.816658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:53.825816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9156d8fd-8dd8-414b-86aa-e14e72890a86 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.350575 Aug 27 21:04:53.826664 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1961/3816] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:53 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:54.134303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:54.134948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:54.137696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:54.143039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.143592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.144036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.144758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.145206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.145659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.175003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:54.175648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:54.183637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.184130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.184571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.185275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.185729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.186154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.408865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:54.417573 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60867480-9151-4c66-99c3-ff319042ae62 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.287216 Aug 27 21:04:54.418072 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1856/3817] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:54 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:54.437578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:54.446624 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39d0b27f-a2ee-4af1-8d51-b0924e28ee39 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1472 microversion: 2.1 time: 0.275490 Aug 27 21:04:54.447318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1962/3818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:54 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:54.788887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:54.789783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:54.800550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.800550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.800550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.800550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.801108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.801475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.804457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:54.848260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:54.849060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:54.856413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.857057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.857579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:54.858555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:54.859096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:54.860107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.056413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:55.068337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5575156-4947-44a6-9db3-aa8d27da15c6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1314 microversion: 2.1 time: 0.283834 Aug 27 21:04:55.070034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1857/3819] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:54 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:55.087134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:55.099456 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb347369-bb31-420b-92ec-859ee6e8cad6 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.255011 Aug 27 21:04:55.100050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1963/3820] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:54 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:55.320849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9133a12-8ade-4172-8ebf-cf81a8e3122b", "name": "network-vif-plugged", "status": "completed", "tag": "38211ab7-bb51-4b28-b052-7dd55bbd2ec2"}, {"server_uuid": "a07479cc-0162-4f91-afb1-59a070704d0a", "name": "network-vif-plugged", "status": "completed", "tag": "1073f6ac-a607-4655-9afc-bc62716d5188"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:55.332482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:55.333067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:55.333423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.348189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Creating event network-vif-plugged:38211ab7-bb51-4b28-b052-7dd55bbd2ec2 for instance c9133a12-8ade-4172-8ebf-cf81a8e3122b on nch1-master-1 Aug 27 21:04:55.348702 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] Creating event network-vif-plugged:1073f6ac-a607-4655-9afc-bc62716d5188 for instance a07479cc-0162-4f91-afb1-59a070704d0a on nch2-master-1 Aug 27 21:04:55.359538 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-170143c0-c789-498b-bf83-94164d4e302b req-59e08372-9a4c-4570-83d5-8814732a2f9e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044433 Aug 27 21:04:55.360592 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1858/3821] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:04:55.439454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:55.440869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:55.450636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:55.451397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:55.451889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.452647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:55.453109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:55.453594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.473820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:55.474742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:55.483815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:55.484321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:55.484947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.485879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:55.486773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:55.487402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:55.678237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:55.687937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:55.692289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-17c801af-5c66-4166-af03-eabb3ecf51d7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.257261 Aug 27 21:04:55.692856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1964/3822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:55 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:55.698498 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b63ef8a5-eab5-4594-b062-3f6b17072152 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1472 microversion: 2.1 time: 0.233186 Aug 27 21:04:55.699193 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1859/3823] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:55 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:56.090873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:56.091676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.098995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.099535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.100202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.100921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.101379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.102060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.120995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:56.122299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.128917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.129409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.129850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.130554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.131014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.131471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.335724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:56.342892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:56.348874 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fdcc8ff2-71dd-427a-9454-aed3ca02d5a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1501 microversion: 2.1 time: 0.262355 Aug 27 21:04:56.349649 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1965/3824] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:56 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:56.351445 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5efba54f-f953-4ca1-af52-82536f52fe8d tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.234370 Aug 27 21:04:56.352214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1860/3825] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:56 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:56.369706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:56.370247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.376287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.376788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.377225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.377933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.378394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.378827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.450959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a9db9c69-4af8-47d9-b57f-fedd930c131b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911/action" status: 202 len: 0 microversion: 2.1 time: 0.085048 Aug 27 21:04:56.451725 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1966/3826] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:04:56 2022] POST /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:04:56.460871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:56.461584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.468454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.469221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.469657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.470410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.470877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.471326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.605369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:56.613384 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4630581-0078-4d3c-9eaf-01079b0e5ebb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1506 microversion: 2.1 time: 0.157362 Aug 27 21:04:56.613958 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1861/3827] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:56 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:56.714406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:56.715852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.726404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.727111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.727374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.728127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:56.728752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:56.732636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.733117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.733547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.736701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.737486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.738107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:56.739460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:56.740180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:56.741066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.279707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:57.287098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:57.288735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8930c0a7-3ada-47f4-af99-65d151b1981a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1322 microversion: 2.1 time: 0.579138 Aug 27 21:04:57.289801 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1967/3828] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:56 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:57.296504 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ddaa8001-4c7d-425a-b373-6af14dcb52c2 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1472 microversion: 2.1 time: 0.581270 Aug 27 21:04:57.303429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1862/3829] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:56 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1472 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:57.372456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:57.373424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:57.379533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.380243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.380684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.381626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.382067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.382708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.634949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:57.635865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:57.643187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.644130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.644761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.645676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.646136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.646568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.766029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:57.775174 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-293eb3b8-976a-4416-af14-054d676d4539 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.406389 Aug 27 21:04:57.776348 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1968/3830] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:57 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:57.909303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:57.918765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bfa52b85-04ec-4593-85cd-b90744780656 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1486 microversion: 2.1 time: 0.287872 Aug 27 21:04:57.919995 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1863/3831] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:57 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1486 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:57.944462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:57.945236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:57.954598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.955443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.956044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.957553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:57.958176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:57.958767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:57.989535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:04:58.139540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ee0a300-dc10-4a3a-8dbb-a3b9b70814c5 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 204 len: 0 microversion: 2.1 time: 0.197588 Aug 27 21:04:58.140260 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1969/3832] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:04:57 2022] DELETE /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:04:58.162063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:58.162662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.177991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.178569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.179099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.179787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.180414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.184001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.284138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a350818b-8ecc-45bd-900d-0f17518fd312", "name": "network-vif-deleted", "tag": "f47494dd-3687-49b2-96bd-32972f89424e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:58.307890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.309004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.309626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.327514 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] Creating event network-vif-deleted:f47494dd-3687-49b2-96bd-32972f89424e for instance a350818b-8ecc-45bd-900d-0f17518fd312 on nch1-master-1 Aug 27 21:04:58.336256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-67e0332d-816e-475c-95a2-f850c6a0865c req-b9849fbf-ba96-418a-a523-b9159ef88428 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292476 Aug 27 21:04:58.337044 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1864/3833] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:58.345825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:58.346574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.366542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.367050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.369175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.371023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.371703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.372348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.397671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:58.409120 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-693e3c89-69b0-4ed0-bb5f-c2ad38fc9281 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1492 microversion: 2.1 time: 0.260307 Aug 27 21:04:58.423983 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1970/3834] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:58 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1492 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:04:58.429660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:58.430582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.455504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.456134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.456661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.460720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.461372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.461852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.520778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.521269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.521704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.522335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lazy-loading 'fault' on Instance uuid a350818b-8ecc-45bd-900d-0f17518fd312 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:04:58.596638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bfeec4f9c624115a4500998cd5715d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7aafa82d7904f0aa64297caa208d731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:58.600997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:58.606335 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-446c327b-0d53-4ee2-a018-db61d9780a3e tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 200 len: 1307 microversion: 2.1 time: 0.181110 Aug 27 21:04:58.606927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1971/3835] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:58 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:58.609958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d4521c1-dd00-4676-b299-aa8a869d690a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1516 microversion: 2.1 time: 0.269256 Aug 27 21:04:58.610719 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1865/3836] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:58 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1516 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:58.630739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:58.633392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.639693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.640173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.640618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.641386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.641786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.642231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.666893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'flavor' on Instance uuid a07479cc-0162-4f91-afb1-59a070704d0a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:04:58.670643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:04:58.749959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93778410-2c71-4497-85b3-b811d00959e0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action" status: 200 len: 32 microversion: 2.1 time: 0.123361 Aug 27 21:04:58.750696 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1972/3837] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:04:58 2022] POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:04:58.761544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:58.762162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.771145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.771668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.772118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.772828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.773709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.774311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.801534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:58.805504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:58.818233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.819726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.820534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.821389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:58.822080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:58.822621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:58.989227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:58.997953 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5a93ee6b-3ee3-43e6-a2a3-b2a191a02582 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.240558 Aug 27 21:04:58.998727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1866/3838] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:58 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:59.014118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:59.022137 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-512790b8-31bd-4b93-9e91-15004b5f48f8 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.229291 Aug 27 21:04:59.022854 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1973/3839] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:58 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:59.434778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:59.437295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:59.447298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:59.447897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:59.448950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:59.449838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:59.450923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:59.451777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:59.588474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42310c09-5e3a-43a9-9ede-bbf683949956", "name": "network-vif-plugged", "status": "completed", "tag": "127bb487-03e9-441a-ac88-a363dab92cfd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:04:59.603452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:59.604223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:59.604903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:59.617221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] Creating event network-vif-plugged:127bb487-03e9-441a-ac88-a363dab92cfd for instance 42310c09-5e3a-43a9-9ede-bbf683949956 on nch1-master-1 Aug 27 21:04:59.624917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-774f4757-fb77-4eb2-9e9d-bf5909bbe659 req-f8845f89-4bc4-4169-bfb3-e3b1e4a63dc1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041312 Aug 27 21:04:59.626046 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1974/3840] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:04:59.632758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:04:59.635373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] [instance: a350818b-8ecc-45bd-900d-0f17518fd312] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:04:59.637990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:04:59.641966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:59.642698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:59.643674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:59.644610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:04:59.645270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:04:59.645898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:04:59.648993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc8c73ca-5797-4618-aed0-ad57879fe173 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1492 microversion: 2.1 time: 0.222068 Aug 27 21:04:59.649885 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1867/3841] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:59 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1492 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:04:59.662091 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] HTTP exception thrown: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Request method failure captured: Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 HTTP/1.1 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoZOhCAataWtAxgXgJCcaRrWEm9h7N8dylwvm4PgKnmoeX5vPsGA8mRNwOiExVJgQPo0MK86TigAgwoCQY4KhFfk0Bzk6iAEfehttz6fMNdABIhuroJmTcsjFhM8_e3OclNopG9hELFPik0USStQ700K-MqyrQJMNYzPPKb7eCyLpYw Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f7aafa82d7904f0aa64297caa208d731 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7aafa82d7904f0aa64297caa208d731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7aafa82d7904f0aa64297caa208d731"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7aafa82d7904f0aa64297caa208d731", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7aafa82d7904f0aa64297caa208d731"}]}] Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f7aafa82d7904f0aa64297caa208d731 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-774915738 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ListImageFiltersTestJSON-774915738-project Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2bfeec4f9c624115a4500998cd5715d7 Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ListImageFiltersTestJSON-774915738-project Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a350818b-8ecc-45bd-900d-0f17518fd312'} Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:04:59.663901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. Aug 27 21:04:59.669480 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:04:59.671524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Returning 404 to user: Instance a350818b-8ecc-45bd-900d-0f17518fd312 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:04:59.672627 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4121f35b-5405-4f83-b69b-ed6fcd76bba6 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312" status: 404 len: 111 microversion: 2.1 time: 0.045239 Aug 27 21:04:59.673429 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1975/3842] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:59 2022] GET /compute/v2.1/servers/a350818b-8ecc-45bd-900d-0f17518fd312 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:04:59.691447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bea9c091-013c-44bb-9f33-c63ce2685b49 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff857cdff70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.020653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.021935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:00.031406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.031923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.032374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.037778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.041273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.041906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.161683 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bea9c091-013c-44bb-9f33-c63ce2685b49 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0" status: 204 len: 0 microversion: 2.1 time: 0.475565 Aug 27 21:05:00.162300 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1868/3843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:04:59 2022] DELETE /compute/v2.1/images/0311fa00-1245-4bfb-8661-8f44f61772a0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:00.170461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.171468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:00.178244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.178747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.179623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.186899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.187743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.188469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.260677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:00.272650 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b9b12af-7f46-427d-af1a-e2017e437a0c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.256485 Aug 27 21:05:00.273358 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1976/3844] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:00 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:00.278533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1c6a331-99f5-41a6-9f08-af577a4167f8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84df8ca60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.383994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:00.393082 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1b9af79-75fa-4824-8219-8e4c4a831086 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1314 microversion: 2.1 time: 0.229642 Aug 27 21:05:00.395163 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1869/3845] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:00 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:00.671915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.672711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:00.682245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.683163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.683879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.685082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:00.686652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:00.687809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:00.735298 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1c6a331-99f5-41a6-9f08-af577a4167f8 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f" status: 204 len: 0 microversion: 2.1 time: 0.460551 Aug 27 21:05:00.736055 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1977/3846] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:00 2022] DELETE /compute/v2.1/images/005af71c-b8bb-44c5-b7ec-68d82a06e38f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:00.745984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cde44c3-074e-4c69-8266-5deca1dcdea4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] Calling method '.version_select at 0x7ff84e55d790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:00.897297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:00.909005 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c564a3a-be8d-4d0f-af09-d4745cd8d1f2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 200 len: 1492 microversion: 2.1 time: 0.242383 Aug 27 21:05:00.909810 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1870/3847] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:00 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 1492 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:01.072261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a807372-5608-40dd-aaac-1a93480a4911", "name": "network-vif-deleted", "tag": "bd8baa82-0163-4041-a0cd-779d22b774d4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:01.087192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.087880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.088385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.104345 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] Creating event network-vif-deleted:bd8baa82-0163-4041-a0cd-779d22b774d4 for instance 4a807372-5608-40dd-aaac-1a93480a4911 on nch2-master-1 Aug 27 21:05:01.110549 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c304246a-4487-41ef-8cfb-1d6a1c4dd459 req-f9364109-fa07-48d3-9f4f-dd77b712f48d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043135 Aug 27 21:05:01.115375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1871/3848] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:01.297126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:01.297877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:01.308822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.309620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.311204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.312215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.312853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.313511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.447474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5cde44c3-074e-4c69-8266-5deca1dcdea4 tempest-ListImageFiltersTestJSON-774915738 tempest-ListImageFiltersTestJSON-774915738-project] 10.222.0.40 "DELETE /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954" status: 204 len: 0 microversion: 2.1 time: 0.707009 Aug 27 21:05:01.448272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1978/3849] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:00 2022] DELETE /compute/v2.1/images/e0de21d6-8e57-4d33-bc7d-644398792954 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:01.454506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:01.460368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:01.488801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.492313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.493675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.495465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.499730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.500894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.527395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:01.541125 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4eb3b65-e6ff-43d7-963f-655f7652fafe tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.249973 Aug 27 21:05:01.542135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1872/3850] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:01 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:01.679419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:01.690270 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b341c37-9429-40cf-ace3-405552e396da tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1499 microversion: 2.1 time: 0.240510 Aug 27 21:05:01.691782 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1979/3851] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:01 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:01.932565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:01.933405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:01.940610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.941506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.942063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.943002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:01.943741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:01.944397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:01.962059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 HTTP/1.1 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4a807372-5608-40dd-aaac-1a93480a4911'} Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:01.964333 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:01.970168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2afc55d8-da73-4f54-b0e4-a9daea6add0f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 404 len: 111 microversion: 2.1 time: 0.042952 Aug 27 21:05:01.971185 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1873/3852] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:01 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:02.125032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2147444352", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:02.199183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:05:02.565473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:02.566945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:02.575786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:02.576536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:02.577091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:02.577880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:02.578454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:02.579134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:02.907321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:02.923120 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-094e28bb-48df-429e-be3a-5217be94aa91 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.362044 Aug 27 21:05:02.938887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1874/3853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:02 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:02.954787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:05:02.954787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:05:02.954787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:05:02.954787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:05:02.954787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:05:02.972583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:02.973227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:02.973771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:02.974687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:02.975279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:02.975897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:02.996186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.002387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.016336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:05:03.018752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:05:03.073184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c32fd3f8-c541-415d-82cd-a21865437dcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952951 Aug 27 21:05:03.079511 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1980/3854] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:05:03.085139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-355ce22b-f55e-48ac-a034-9ec5dd408e69 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.085767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-355ce22b-f55e-48ac-a034-9ec5dd408e69 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:03.173123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-355ce22b-f55e-48ac-a034-9ec5dd408e69 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:03.194686 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-355ce22b-f55e-48ac-a034-9ec5dd408e69 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1215 microversion: 2.1 time: 0.113572 Aug 27 21:05:03.199406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1875/3855] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:03 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:03.262946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e65f69d-b95b-47d6-8262-a2b522705c8b tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84e642310>, body: {"keypair": {"name": "tempest-keypair-1183516709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVOqMufSMiZPvgMsbmDov3y0p+yyERej9vymI0fJUeZ9oYHeY0ucMuvOm17ols6a5vuIux1Kora2miNm2icMpNdEmDceeq4O0L8eK57Dzq6A6s2mvAwdUcTTZqXkE/d4g=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.279847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:03.301496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7e65f69d-b95b-47d6-8262-a2b522705c8b tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.315076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7e65f69d-b95b-47d6-8262-a2b522705c8b tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.368719 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e65f69d-b95b-47d6-8262-a2b522705c8b tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.271547 Aug 27 21:05:03.369805 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1981/3856] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 274 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:03.380513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d77df46a-74b5-4da9-b9a4-3f894eef81c0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff857c684c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.395795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d77df46a-74b5-4da9-b9a4-3f894eef81c0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-1183516709" status: 200 len: 513 microversion: 2.2 time: 0.019197 Aug 27 21:05:03.396815 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1876/3857] 10.222.0.40 () {60 vars in 1258 bytes} [Sat Aug 27 21:05:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1183516709 => generated 513 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:03.408588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5be31d30-d482-4369-bbaa-ee6c792c5815 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84f250ee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.433923 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5be31d30-d482-4369-bbaa-ee6c792c5815 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183516709" status: 204 len: 0 microversion: 2.2 time: 0.029231 Aug 27 21:05:03.434517 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1982/3858] 10.222.0.40 () {60 vars in 1261 bytes} [Sat Aug 27 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183516709 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:03.448073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4234b2a4-5ed3-4b6a-be0e-a00bf89a9630 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84e09f700>, body: {"keypair": {"name": "tempest-keypair-1411831654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNoIhHAlzHvAXsZLfbBFp+5OtEooZKljiIKo88dAVSZrIXSEi2d8Zfe8ltYFFycbzrMRfNlk5FY/dlbO4Rn+HMn0NHRVyVOf6f1rjRwKgwi1Vm6ezKRcTsXSQRXQhqYqg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.465048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-4234b2a4-5ed3-4b6a-be0e-a00bf89a9630 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.471003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-4234b2a4-5ed3-4b6a-be0e-a00bf89a9630 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.516053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4234b2a4-5ed3-4b6a-be0e-a00bf89a9630 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.072827 Aug 27 21:05:03.522229 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1877/3859] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:03.529817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8491af3d-10ef-4e1b-aa5c-30d02d71f1cb tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e642af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.568413 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8491af3d-10ef-4e1b-aa5c-30d02d71f1cb tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411831654" status: 204 len: 0 microversion: 2.2 time: 0.032948 Aug 27 21:05:03.568413 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1983/3860] 10.222.0.40 () {60 vars in 1261 bytes} [Sat Aug 27 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411831654 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:03.568871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a9cb2cb-bebe-4594-9057-1c72aad6a3e0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff857cd6c10>, body: {"keypair": {"name": "tempest-keypair-585826127", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.589780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6a9cb2cb-bebe-4594-9057-1c72aad6a3e0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.596908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6a9cb2cb-bebe-4594-9057-1c72aad6a3e0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.630800 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a9cb2cb-bebe-4594-9057-1c72aad6a3e0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.067874 Aug 27 21:05:03.637849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1878/3861] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 27 21:05:03.643759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-01ecceb2-adc7-4961-a4e1-6ab5165489a3 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff857d75790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.667105 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-01ecceb2-adc7-4961-a4e1-6ab5165489a3 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585826127" status: 204 len: 0 microversion: 2.2 time: 0.027302 Aug 27 21:05:03.667740 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1984/3862] 10.222.0.40 () {60 vars in 1258 bytes} [Sat Aug 27 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585826127 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:03.682913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3ba2806-01ac-40f8-95b2-33acefdd9c5f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84ea73040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1851493093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2lp1zbA1/Xdt+NlJXuj7Cq5OYMnqsWR88EdEcUawj4T3lxxqn+wwbBSLi7ATn6qp4y3yiitwanFjhIloaWjhGC41aswKcHqitzQP2znAEQ5bD/2zOjFdznOX1O4Di8zw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.704937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e3ba2806-01ac-40f8-95b2-33acefdd9c5f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.711900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e3ba2806-01ac-40f8-95b2-33acefdd9c5f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.744805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3ba2806-01ac-40f8-95b2-33acefdd9c5f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.068376 Aug 27 21:05:03.745903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1879/3863] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:03.759792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cbc22f21-4668-48af-90c2-395f1f108868 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84e565c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-897798663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL5k6LfJ8CqNW2OHbiZ+QEQZAtoG0hT9qQid7/QNXqtAATvXdES8lQQK9asppao9vy4uYKL5MRnrDRyLr53ImuMaA3lezsEzKM+RphbESBK7pXossvghfj+CyvpFSBw+Q=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.778572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cbc22f21-4668-48af-90c2-395f1f108868 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.787032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cbc22f21-4668-48af-90c2-395f1f108868 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.817570 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cbc22f21-4668-48af-90c2-395f1f108868 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.061730 Aug 27 21:05:03.826415 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1985/3864] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:03.832293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-818cf2b4-9e44-4995-be77-d0a985a52e81 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84e73df70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-703429762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3vT/PV8AEExx9eH9VUiuLe7AtrubYszo9kJnijj/9ryT3bMLTQxYtbCUtGzCOLoHOswv/LUrehRmvysAdYQ58vOJ1UAWRqCANTu8SuOnyHgONT/W2HhpbSUItvqksRqw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:03.850419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-818cf2b4-9e44-4995-be77-d0a985a52e81 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:03.855967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-818cf2b4-9e44-4995-be77-d0a985a52e81 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:03.883246 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-818cf2b4-9e44-4995-be77-d0a985a52e81 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.055228 Aug 27 21:05:03.886891 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1880/3865] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:03.894964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44e09615-b95e-4600-837a-35b50377fe7e tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e57bca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.899457 ncdv-master-1 devstack@n-api.service[140434]: WARNING oslo_db.sqlalchemy.utils [None req-44e09615-b95e-4600-837a-35b50377fe7e tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 21:05:03.905931 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44e09615-b95e-4600-837a-35b50377fe7e tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.015098 Aug 27 21:05:03.906732 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1986/3866] 10.222.0.40 () {60 vars in 1177 bytes} [Sat Aug 27 21:05:03 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:03.920815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ab38ed2-8190-4cd2-8561-262f6e46a3b0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e13d670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.949268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.950954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:03.953311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ab38ed2-8190-4cd2-8561-262f6e46a3b0 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-703429762" status: 204 len: 0 microversion: 2.2 time: 0.037771 Aug 27 21:05:03.954320 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1881/3867] 10.222.0.40 () {60 vars in 1318 bytes} [Sat Aug 27 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-703429762 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:03.963507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b79335c1-2781-4c04-a0e5-935a965e417a tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff857c689d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:03.967990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:03.969142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:03.970747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:03.972038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:03.973502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:03.974252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:03.992535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b79335c1-2781-4c04-a0e5-935a965e417a tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-897798663" status: 204 len: 0 microversion: 2.2 time: 0.033335 Aug 27 21:05:03.993174 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1882/3868] 10.222.0.40 () {60 vars in 1318 bytes} [Sat Aug 27 21:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-897798663 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:05:04.016964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef65eb8c-7714-41d3-bdad-c50302ff6677 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e1b1310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.032113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:04.043823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef65eb8c-7714-41d3-bdad-c50302ff6677 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1851493093" status: 204 len: 0 microversion: 2.2 time: 0.037872 Aug 27 21:05:04.044449 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1883/3869] 10.222.0.40 () {60 vars in 1321 bytes} [Sat Aug 27 21:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1851493093 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:05:04.061483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7b1d644-d407-4b32-b100-c94c047c87b1 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff857cd64c0>, body: {"keypair": {"name": "tempest-keypair-954051832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0wKHPCyb9m+t7dg6o3cGYc3m9MxeGWtEzZZKQBMu7/hEoYr3pfTkM5q1eBG+j+qYLi2j6HLJg2OGwEfPTajV3yjYdBtzbJCEuaFhOSYZZwKCUTlnP8B51er5shh6QeYw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:04.088953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e7b1d644-d407-4b32-b100-c94c047c87b1 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:04.104717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e7b1d644-d407-4b32-b100-c94c047c87b1 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:04.143742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7b1d644-d407-4b32-b100-c94c047c87b1 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.089562 Aug 27 21:05:04.144694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1884/3870] 10.222.0.40 () {62 vars in 1199 bytes} [Sat Aug 27 21:05:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 21:05:04.157640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db1579cb-b79b-4d7c-815b-be5b2cc8da26 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff857cd6700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.168863 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db1579cb-b79b-4d7c-815b-be5b2cc8da26 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-954051832" status: 200 len: 512 microversion: 2.2 time: 0.017020 Aug 27 21:05:04.169561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1885/3871] 10.222.0.40 () {60 vars in 1255 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-954051832 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:04.181360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60bd1e73-fff0-467c-935e-327a26954301 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e1b1160>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.185537 ncdv-master-1 devstack@n-api.service[140433]: WARNING oslo_db.sqlalchemy.utils [None req-60bd1e73-fff0-467c-935e-327a26954301 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 21:05:04.192303 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60bd1e73-fff0-467c-935e-327a26954301 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015053 Aug 27 21:05:04.192900 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1886/3872] 10.222.0.40 () {60 vars in 1177 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:04.205045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59c3dd52-9c9f-43ea-bb21-8b4840faab22 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff857c52af0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.241086 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59c3dd52-9c9f-43ea-bb21-8b4840faab22 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954051832" status: 204 len: 0 microversion: 2.2 time: 0.040269 Aug 27 21:05:04.242044 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1887/3873] 10.222.0.40 () {60 vars in 1258 bytes} [Sat Aug 27 21:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954051832 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:04.250812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.251628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:04.258687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.259176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.259653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:04.260353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.260814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.261233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:04.309149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:04.324659 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-228c77a2-879b-40e8-b409-2a1e427b6173 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.382694 Aug 27 21:05:04.325470 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1987/3874] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:03 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:04.330386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Action: 'create', calling method: .version_select at 0x7ff84f1f2e50>, body: {"keypair": {"name": "tempest-keypair-64275302", "type": "x509"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:04.347261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:04.352699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:04.387693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.processutils [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1t193mxa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1t193mxa/temp.key -subj /CN=108cb11ce65b48acbcc4c0ddefa6be4b -extensions v3_req_client {{(pid=140434) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 21:05:04.615864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.processutils [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1t193mxa/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1t193mxa/temp.key -subj /CN=108cb11ce65b48acbcc4c0ddefa6be4b -extensions v3_req_client" returned: 0 in 0.227s {{(pid=140434) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 21:05:04.618465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.processutils [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1t193mxa/temp.key -password pass: {{(pid=140434) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 21:05:04.661347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.processutils [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1t193mxa/temp.key -password pass:" returned: 0 in 0.042s {{(pid=140434) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 21:05:04.716528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:04.724592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21699d84-66d4-4e3f-b7b8-af62e2e03090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1267 microversion: 2.1 time: 0.479910 Aug 27 21:05:04.729285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1888/3875] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1267 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:04.742169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:04.742169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Getting quotas for user 108cb11ce65b48acbcc4c0ddefa6be4b and project cb6f1cc796f54e9783f66a88668d0f16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:04.748539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.749405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:04.756258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.756991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.757542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:04.758484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.759077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.759548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:04.761959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3afd93a3-e677-4e89-9f7e-38db80280eb9 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.435071 Aug 27 21:05:04.763637 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1988/3876] 10.222.0.40 () {62 vars in 1198 bytes} [Sat Aug 27 21:05:04 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 437 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:04.775914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4092d6e-0898-471a-9694-a111f5b4318f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84e57b700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.788289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4092d6e-0898-471a-9694-a111f5b4318f tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs/tempest-keypair-64275302" status: 200 len: 1532 microversion: 2.2 time: 0.018301 Aug 27 21:05:04.789710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1989/3877] 10.222.0.40 () {60 vars in 1252 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-64275302 => generated 1532 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:04.800987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0ce51af3-5fa7-45a2-af9b-3a56acdc6ffe tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84df8ca60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.802193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:05:04.805851 ncdv-master-1 devstack@n-api.service[140434]: WARNING oslo_db.sqlalchemy.utils [None req-0ce51af3-5fa7-45a2-af9b-3a56acdc6ffe tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 21:05:04.811645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0ce51af3-5fa7-45a2-af9b-3a56acdc6ffe tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.014734 Aug 27 21:05:04.812874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1990/3878] 10.222.0.40 () {60 vars in 1177 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:04.823122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-afa44485-0ff7-4dae-b600-52e32b98db12 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] Calling method '.version_select at 0x7ff84eda0670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.833443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:04.846989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-afa44485-0ff7-4dae-b600-52e32b98db12 tempest-KeyPairsV22TestJSON-1012728720 tempest-KeyPairsV22TestJSON-1012728720-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64275302" status: 204 len: 0 microversion: 2.2 time: 0.027450 Aug 27 21:05:04.852262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1991/3879] 10.222.0.40 () {60 vars in 1255 bytes} [Sat Aug 27 21:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64275302 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:05:04.907051 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9bdac909-6e4c-4c4a-bf07-56bd4804940a tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "DELETE /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 204 len: 0 microversion: 2.1 time: 0.162744 Aug 27 21:05:04.908034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1889/3880] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:05:04 2022] DELETE /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:04.917652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:04.918412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:04.925298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.925850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.926294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:04.927768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:04.928208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:04.928812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:05.084779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:05.107093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ffe83f33-c2d2-49cf-9f9f-c478404ff35f tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1505 microversion: 2.1 time: 0.193840 Aug 27 21:05:05.120851 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1992/3881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:04 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:05.354165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:05.355912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:05.368029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:05.368690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:05.369261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:05.370127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:05.371118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:05.372376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:05.596400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:05.607596 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7649d17b-ca9b-4061-8d01-44866d36e271 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.263230 Aug 27 21:05:05.608439 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1890/3882] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:05 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:05.754621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:05.755454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:05.772021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:05.773775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:05.774401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:05.775295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:05.775819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:05.776464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:05.950944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:05.959393 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10ae79fc-6f9c-46ef-9c86-fe25a87bb8a8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.213419 Aug 27 21:05:05.960349 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1993/3883] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:05 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:06.129325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:06.129952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:06.137646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:06.138377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:06.139015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:06.139757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:06.140386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:06.140986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:06.354172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:06.363419 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d2f9414c-271a-4ffe-84e2-62e95c107177 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1505 microversion: 2.1 time: 0.238014 Aug 27 21:05:06.375807 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1891/3884] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:06 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:06.513648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8cc0de-cc27-4f8d-8b5c-610432b437c7", "tag": "5b75cf02-3db6-4088-bc87-a3bdb3bf2b63"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:06.526575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:06.527307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:06.527802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:06.540809 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] Creating event network-changed:5b75cf02-3db6-4088-bc87-a3bdb3bf2b63 for instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 on nch2-master-1 Aug 27 21:05:06.546850 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-05cccc6b-aca6-45ee-be8f-967ac6ccce56 req-1963ce91-b12b-4c72-b80a-584a01a43e41 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036951 Aug 27 21:05:06.548306 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1994/3885] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:06.628853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:06.629571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:06.637755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:06.638257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:06.638693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:06.639430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:06.639878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:06.640600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:06.828297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:06.837467 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6f8f3dd-5949-4f57-b97d-b16aa9af39aa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.212605 Aug 27 21:05:06.838267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1892/3886] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:06 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:06.989635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:06.993706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:07.004889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.005843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.006877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:07.007808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.008437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.009022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:07.283946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:07.298767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-26565f9e-1125-459c-a75f-9afcbb46bc9f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.318619 Aug 27 21:05:07.299980 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1995/3887] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:06 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:07.396570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:07.397041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:07.407260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.408520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.409233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:07.411179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.436626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.437488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:07.552437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2080e683fd744eda8f9f2ad156e6b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d783e6e60ee46e3841e787bc32692d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:07.562692 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e283f4f8-c561-42ff-95d5-2dd1203a26cc tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 200 len: 1463 microversion: 2.1 time: 0.177210 Aug 27 21:05:07.563284 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1893/3888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:07 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:07.858980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:07.859688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:07.866123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.866610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.867084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:07.867942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:07.868581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:07.869176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.048438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:08.060245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10bcf3f8-8a9d-48c9-b383-069bf9041d9e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.204880 Aug 27 21:05:08.062125 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1996/3889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:07 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:08.326014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:08.326745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:08.335641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:08.337272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:08.337981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.338936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:08.339743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:08.340248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.583414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42310c09-5e3a-43a9-9ede-bbf683949956", "name": "network-vif-deleted", "tag": "127bb487-03e9-441a-ac88-a363dab92cfd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:08.609022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:08.609605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:08.610768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.626865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] Creating event network-vif-deleted:127bb487-03e9-441a-ac88-a363dab92cfd for instance 42310c09-5e3a-43a9-9ede-bbf683949956 on nch1-master-1 Aug 27 21:05:08.632238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-30d04949-9a55-4fdf-892a-87b38f2ff17c req-eec29b71-0af3-4f7c-8d64-716223db4e9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055469 Aug 27 21:05:08.633460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1997/3890] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:08.639995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:08.640896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] [instance: 42310c09-5e3a-43a9-9ede-bbf683949956] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:08.648320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:08.649733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:08.650706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.651621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:08.652229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:08.652992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:08.661881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:08.672264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] HTTP exception thrown: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. Aug 27 21:05:08.672929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68912d50-5a2c-43cb-a6b8-f917b8c3a707 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.353717 Aug 27 21:05:08.675917 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1894/3891] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:08 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Request method failure captured: Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 HTTP/1.1 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCobl_yie5w8NtXqyueoiZkeX7LwFfNcdNDDEdT0pNIVPMI6vSMWmVdDp7pQy2VHNBAvrgTXgiAvvkB3jNe8Hu2W13vDTENbgy3VnmbD55-8fpAVZFC_KkBGAoHSW-0K4OZzoi_ZRKlGFnhPIjQjwB-k927MH79p52fchrmINonjfCMo Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 6d783e6e60ee46e3841e787bc32692d9 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesActionsTest-1560717861 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d783e6e60ee46e3841e787bc32692d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d783e6e60ee46e3841e787bc32692d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d783e6e60ee46e3841e787bc32692d9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d783e6e60ee46e3841e787bc32692d9"}]}] Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesActionsTest-1560717861 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 6d783e6e60ee46e3841e787bc32692d9 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesActionsTest-1560717861 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesActionsTest-1560717861-project Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 2080e683fd744eda8f9f2ad156e6b045 Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesActionsTest-1560717861-project Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '42310c09-5e3a-43a9-9ede-bbf683949956'} Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:08.676254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] Returning 404 to user: Instance 42310c09-5e3a-43a9-9ede-bbf683949956 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf824bd6-a6c8-4e6a-8727-94150e813075 tempest-VolumesActionsTest-1560717861 tempest-VolumesActionsTest-1560717861-project] 10.222.0.40 "GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956" status: 404 len: 111 microversion: 2.1 time: 0.046667 Aug 27 21:05:08.690265 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1998/3892] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:08 2022] GET /compute/v2.1/servers/42310c09-5e3a-43a9-9ede-bbf683949956 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:09.083441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:09.084329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:09.103485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:09.110364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:09.111634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:09.113675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:09.114618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:09.115226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:09.447586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:09.460845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-157227a0-68e0-4822-8377-7c3ce5c5f941 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.382249 Aug 27 21:05:09.476447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1895/3893] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:09 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:09.694904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:09.695618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:09.709734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:09.711387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:09.716069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:09.717170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:09.717872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:09.718541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:10.103056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:10.116759 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e64b9a79-80e0-47e3-b9ed-92d1fc2a2315 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.425627 Aug 27 21:05:10.118166 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 1999/3894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:09 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:10.484370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:10.487412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:10.503747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:10.507188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:10.511731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:10.513000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:10.515090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:10.515841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:11.142396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:11.143026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:11.155272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:11.155832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:11.157336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:11.158587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:11.159302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:11.160225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:11.233639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:11.245901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4fb369a-79aa-4b11-b61d-5b84747b6f33 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.767209 Aug 27 21:05:11.247572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1896/3895] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:10 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:11.434562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:11.446479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e490ca3c-be12-46fe-8336-66589517e460 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.311794 Aug 27 21:05:11.448774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2000/3896] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:11 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:12.267732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:12.268686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:12.276108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:12.277115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:12.277756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:12.278659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:12.279290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:12.279911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:12.439369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:12.448452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ba92338-f6b5-4bbc-bf43-c6e31f988e36 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.184706 Aug 27 21:05:12.449391 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1897/3897] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:12 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:12.468535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:12.469755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:12.477893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:12.478390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:12.478833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:12.479584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:12.480114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:12.480546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:12.638547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:12.654494 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dee19a64-048a-46ee-a274-f3d7d82606fa tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.190095 Aug 27 21:05:12.655890 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2001/3898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:12 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:13.471387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:13.472251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:13.482066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:13.484105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:13.484876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:13.486506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:13.487189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:13.488093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:13.682104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:13.684629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:13.698885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:13.705761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:13.722172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:13.723577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:13.727047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:13.729446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:13.730704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:13.741525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:13.755571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-52b415c0-0491-4a6a-bfb7-12849a09b853 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.289048 Aug 27 21:05:13.756940 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1898/3899] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:13 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:13.977035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:13.993846 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05809787-6380-4a4a-9586-fa100625a0a6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.319448 Aug 27 21:05:13.994760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2002/3900] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:13 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:14.784571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:14.799153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:14.809744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=22 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:14.816947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:14.817861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:14.819116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:14.821057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:14.822117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:14.822847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:15.023589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:15.024533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:15.028586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=22 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:15.047400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:15.047923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:15.048375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:15.049102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:15.058106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:15.058880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:15.134122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:15.139582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:15.144179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c50e7dc7-48ac-4e4b-9090-aa33dab65886 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.363559 Aug 27 21:05:15.144779 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1899/3901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:14 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:15.435986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:15.479028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f977cfd-8a2a-4db7-959b-0aeb61773d9a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.432532 Aug 27 21:05:15.480151 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2003/3902] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:15 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:15.857162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8cc0de-cc27-4f8d-8b5c-610432b437c7", "name": "network-vif-plugged", "status": "completed", "tag": "5b75cf02-3db6-4088-bc87-a3bdb3bf2b63"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:15.892475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:15.895764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:15.896556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:15.927666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] Creating event network-vif-plugged:5b75cf02-3db6-4088-bc87-a3bdb3bf2b63 for instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 on nch2-master-1 Aug 27 21:05:15.937828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1bb212b8-0196-4aa9-9e8f-6c1d4890f31a req-7045b25c-074c-4c7f-899a-32e6df296ee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088324 Aug 27 21:05:15.939627 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1900/3903] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:16.172292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:16.180439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:16.209314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:16.209815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:16.210256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:16.221783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:16.222409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:16.224366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:16.504235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:16.505699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:16.514946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:16.517378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:16.518085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:16.523116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:16.524833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:16.525557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:16.750773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:16.772445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fcde9982-a53c-47fc-8aa6-a95eac855de3 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.608102 Aug 27 21:05:16.786291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2004/3904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:16 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:16.877744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:16.895665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f328a6f8-094e-4bc7-b02c-574a29fdb9d9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1315 microversion: 2.1 time: 0.396313 Aug 27 21:05:16.896712 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1901/3905] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:16 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:17.010009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57f48581-5bf1-40f7-bbe2-3c0947b8ae7f tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff857d75700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1064052993", "description": "tempest-description-2113749177"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:17.402159 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-57f48581-5bf1-40f7-bbe2-3c0947b8ae7f tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.613118 Aug 27 21:05:17.403574 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2005/3906] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:05:16 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:17.416804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c0bf7d1-210a-410c-8414-25869f359543 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84e13d700>, body: {"security_group_rule": {"parent_group_id": "5094e832-4cf6-4dc0-9783-9c0cd65c189e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:17.794461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:17.795084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:17.801944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:17.802776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:17.804466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:17.805701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:17.806468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:17.808134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.071384 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c0bf7d1-210a-410c-8414-25869f359543 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.657922 Aug 27 21:05:18.072205 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1902/3907] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:18.086129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:18.087042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:18.093937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.094714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.095384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.096343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.097061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.097508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.149213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:18.162235 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de798c31-b03c-4d9d-bee4-ef3ca57b9ca7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.371568 Aug 27 21:05:18.162859 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2006/3908] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:17 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:18.171764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-adfafb1a-7aeb-4f54-b159-7c46029be51b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff857d75280>, body: {"security_group_rule": {"parent_group_id": "5094e832-4cf6-4dc0-9783-9c0cd65c189e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:18.306371 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-adfafb1a-7aeb-4f54-b159-7c46029be51b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-adfafb1a-7aeb-4f54-b159-7c46029be51b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 138 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: {"security_group_rule": {"parent_group_id": "5094e832-4cf6-4dc0-9783-9c0cd65c189e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: exception: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5094e832-4cf6-4dc0-9783-9c0cd65c189e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:18.308023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-adfafb1a-7aeb-4f54-b159-7c46029be51b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: This rule already exists in group 5094e832-4cf6-4dc0-9783-9c0cd65c189e {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-adfafb1a-7aeb-4f54-b159-7c46029be51b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.145288 Aug 27 21:05:18.316744 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2007/3909] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:18 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:05:18.318891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f46c6d78-1a81-4064-b991-b8cf80ccbec0 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84e6421f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:18.465043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:18.478593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20d5028c-91a9-4e80-9369-92e533667692 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1503 microversion: 2.1 time: 0.396368 Aug 27 21:05:18.479450 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1903/3910] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:18 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1503 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:18.502152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:18.502708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:18.512265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.513003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.513582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.514493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.515152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.516055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.568874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lazy-loading 'flavor' on Instance uuid 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:05:18.790680 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f46c6d78-1a81-4064-b991-b8cf80ccbec0 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/fbda5aab-c4ef-46f8-ab1b-46c667d9a246" status: 202 len: 0 microversion: 2.1 time: 0.475275 Aug 27 21:05:18.791833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2008/3911] 10.222.0.40 () {58 vars in 1287 bytes} [Sat Aug 27 21:05:18 2022] DELETE /compute/v2.1/os-security-group-rules/fbda5aab-c4ef-46f8-ab1b-46c667d9a246 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:18.802373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82fd64e2-e6a0-4785-976b-1567a95c0484 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84fbb3b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-143841809", "description": "tempest-description-1265195175"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:18.857658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa23ef17-9f05-4a89-bcc6-a6b9e8f22888 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7/action" status: 202 len: 0 microversion: 2.1 time: 0.360061 Aug 27 21:05:18.858334 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1904/3912] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:18 2022] POST /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:05:18.868867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:18.870254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:18.878074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.878991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.880020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.881771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:18.882729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:18.884277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:18.918452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:19.232515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:19.250727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-135c8d0a-493a-4849-957e-b9d4aa139dde tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.386437 Aug 27 21:05:19.252183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1905/3913] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:18 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:19.267279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82fd64e2-e6a0-4785-976b-1567a95c0484 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.469179 Aug 27 21:05:19.268306 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2009/3914] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:05:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:19.294470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-951e7414-3af7-41eb-bb5a-35cfedbe9109 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84e57b1f0>, body: {"security_group_rule": {"parent_group_id": "d48829f4-51f3-42f8-88a4-f37d41e7ab4a", "ip_protocol": "tcp", "from_port": 653620159, "to_port": 22}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:19.301032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:19.308007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:19.317210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:19.318259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:19.321362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:19.323164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:19.324017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:19.325078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:19.509016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-951e7414-3af7-41eb-bb5a-35cfedbe9109 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Invalid port range 653620159:22. Former value cannot be greater than the later Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-951e7414-3af7-41eb-bb5a-35cfedbe9109 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 145 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: {"security_group_rule": {"parent_group_id": "d48829f4-51f3-42f8-88a4-f37d41e7ab4a", "ip_protocol": "tcp", "from_port": 653620159, "to_port": 22}} Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid port range 653620159:22. Former value cannot be greater than the later Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd48829f4-51f3-42f8-88a4-f37d41e7ab4a', 'ip_protocol': 'tcp', 'from_port': 653620159, 'to_port': 22}}} Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 653620159:22. Former value cannot be greater than the later Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 653620159:22. Former value cannot be greater than the later Aug 27 21:05:19.513172 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 653620159:22. Former value cannot be greater than the later Aug 27 21:05:19.519674 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.522083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-951e7414-3af7-41eb-bb5a-35cfedbe9109 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: Invalid port range 653620159:22. Former value cannot be greater than the later {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:19.523237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-951e7414-3af7-41eb-bb5a-35cfedbe9109 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.240051 Aug 27 21:05:19.524540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2010/3915] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:19 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:05:19.535749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1199c0e3-c8eb-4df4-8c75-d0367ea45d87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84dff8310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-307513415", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:19.540691 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1199c0e3-c8eb-4df4-8c75-d0367ea45d87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Security group id should be uuid Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1199c0e3-c8eb-4df4-8c75-d0367ea45d87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 130 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-307513415", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group id should be uuid Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-307513415', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:19.542181 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:19.547206 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 21:05:19.547206 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:19.547206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1199c0e3-c8eb-4df4-8c75-d0367ea45d87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: Security group id should be uuid {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:19.547206 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1199c0e3-c8eb-4df4-8c75-d0367ea45d87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.012969 Aug 27 21:05:19.547206 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2011/3916] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:19 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:05:19.553322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf23ac15-72dc-4c21-b360-e4640fbc1a65 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84fb89d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-735437879", "description": "tempest-description-2124233060"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:19.718239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:19.726914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-84547a3c-d3e8-4454-881d-c90d6ff5f104 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.433203 Aug 27 21:05:19.727622 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1906/3917] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:19 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:19.944714 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf23ac15-72dc-4c21-b360-e4640fbc1a65 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.394492 Aug 27 21:05:19.947669 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2012/3918] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:05:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:19.960300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f35a9a05-b6ea-4d80-915d-e89b32acadc5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff85408fe50>, body: {"security_group_rule": {"parent_group_id": "e81e8f6f-6234-4c79-a74a-f22235252c87", "ip_protocol": "tempest-999-443529836", "from_port": 22, "to_port": 22}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:20.032523 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f35a9a05-b6ea-4d80-915d-e89b32acadc5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Invalid IP protocol tempest-999-443529836. Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f35a9a05-b6ea-4d80-915d-e89b32acadc5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 156 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: {"security_group_rule": {"parent_group_id": "e81e8f6f-6234-4c79-a74a-f22235252c87", "ip_protocol": "tempest-999-443529836", "from_port": 22, "to_port": 22}} Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid IP protocol tempest-999-443529836. Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e81e8f6f-6234-4c79-a74a-f22235252c87', 'ip_protocol': 'tempest-999-443529836', 'from_port': 22, 'to_port': 22}}} Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-443529836. Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-443529836. Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.035086 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-443529836. Aug 27 21:05:20.040324 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.044367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f35a9a05-b6ea-4d80-915d-e89b32acadc5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: Invalid IP protocol tempest-999-443529836. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:20.045272 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f35a9a05-b6ea-4d80-915d-e89b32acadc5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.089037 Aug 27 21:05:20.045869 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1907/3919] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:19 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:05:20.055693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e01b0063-b72c-4d00-921e-5c1ac032dd87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84e642790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-618835841", "description": "tempest-description-1924781483"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:20.274181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:20.277595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:20.286423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:20.287439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:20.288065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:20.289380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:20.290073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:20.290692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:20.326731 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e01b0063-b72c-4d00-921e-5c1ac032dd87 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.275316 Aug 27 21:05:20.327842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2013/3920] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:05:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:05:20.343710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42357318-5af1-4c1f-a92e-40b9151dcc16 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84f92ad30>, body: {"security_group_rule": {"parent_group_id": "fc9c805c-4000-4bfa-8449-c9189841329c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:20.529016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-42357318-5af1-4c1f-a92e-40b9151dcc16 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42357318-5af1-4c1f-a92e-40b9151dcc16 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 138 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: {"security_group_rule": {"parent_group_id": "fc9c805c-4000-4bfa-8449-c9189841329c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fc9c805c-4000-4bfa-8449-c9189841329c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 21:05:20.532002 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 21:05:20.538187 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:20.540488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42357318-5af1-4c1f-a92e-40b9151dcc16 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:20.541717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42357318-5af1-4c1f-a92e-40b9151dcc16 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.204290 Aug 27 21:05:20.542960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2014/3921] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:20 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:05:20.552133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-11ea2cd3-58b8-42e1-b58a-032bdedc326f tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84fb89d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-221700463", "description": "tempest-description-2011296486"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:20.607010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:20.626810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61411a98-f7f3-4f1d-9ea1-b7895f94461c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.356363 Aug 27 21:05:20.636738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1908/3922] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:20 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:20.751955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:20.753314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:20.761015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:20.761908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:20.762638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:20.763915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:20.764658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:20.765302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:20.963611 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-11ea2cd3-58b8-42e1-b58a-032bdedc326f tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.415332 Aug 27 21:05:20.964236 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2015/3923] 10.222.0.40 () {60 vars in 1180 bytes} [Sat Aug 27 21:05:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:20.979956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-618c4878-b473-4e34-9b4c-d5b78266c5a7 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84dff8160>, body: {"security_group_rule": {"parent_group_id": "3d8d0f33-99de-4126-aa20-86c23114ba73", "ip_protocol": "tcp", "from_port": 22, "to_port": 2016612888}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:21.013581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:21.025066 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1258a5aa-d753-4a05-8430-65aed52805c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.279728 Aug 27 21:05:21.028020 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1909/3924] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:20 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:21.070504 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-618c4878-b473-4e34-9b4c-d5b78266c5a7 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-618c4878-b473-4e34-9b4c-d5b78266c5a7 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 146 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: {"security_group_rule": {"parent_group_id": "3d8d0f33-99de-4126-aa20-86c23114ba73", "ip_protocol": "tcp", "from_port": 22, "to_port": 2016612888}} Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3d8d0f33-99de-4126-aa20-86c23114ba73', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2016612888}}} Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 Aug 27 21:05:21.072533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 Aug 27 21:05:21.077922 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.079920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-618c4878-b473-4e34-9b4c-d5b78266c5a7 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 400 to user: Invalid port range 22:2016612888. Valid TCP ports should be between 1-65535 {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:21.080998 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-618c4878-b473-4e34-9b4c-d5b78266c5a7 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.105695 Aug 27 21:05:21.082116 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2016/3925] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:20 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:05:21.093517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Action: 'create', calling method: .version_select at 0x7ff84f5af670>, body: {"security_group_rule": {"parent_group_id": "c09870f7-5fac-4627-8f1f-f66a66f60599", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:21.164722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG neutronclient.v2_0.client [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist", "detail": ""}} {{(pid=140433) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:05:21.165368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.security_group_api [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Neutron security group c09870f7-5fac-4627-8f1f-f66a66f60599 not found {{(pid=140433) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 21:05:21.166312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.166312 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 138 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: {"security_group_rule": {"parent_group_id": "c09870f7-5fac-4627-8f1f-f66a66f60599", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: exception: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c09870f7-5fac-4627-8f1f-f66a66f60599', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:05:21.168355 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 404 to user: Security group c09870f7-5fac-4627-8f1f-f66a66f60599 does not exist Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: Neutron server returns request_ids: ['req-c9e35a19-5e48-42fd-bb8f-50a985692c04'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1dfd753-f65d-4007-a3fe-4a8c806e1a1b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.085105 Aug 27 21:05:21.176810 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1910/3926] 10.222.0.40 () {60 vars in 1195 bytes} [Sat Aug 27 21:05:21 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:21.196107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84e642700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:21.248391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG neutronclient.v2_0.client [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist", "detail": ""}} {{(pid=140434) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 21:05:21.250238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Neutron security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b not found {{(pid=140434) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 21:05:21.251694 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] HTTP exception thrown: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.251694 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Request method failure captured: Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-security-group-rules/2558713f-7562-4337-8b0a-b117f22bfc3b HTTP/1.1 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCocMR5rS5aSO4B7cbBexBnLXQtFs12mnpKIAM1B2gsAmkQM43k-Tr4L3Q8XHtIFrEthJcdmV3-vbOaaHHYeUbquzOXAGAxz7gpAJMCncSGFPdKm9Tw3mkoAJrzj-I4l07vOKJWKrK6cR01XcDgi820_awC5VasDdNzLWt9YDxbiCfmU Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a911320b08174d569825a268688afa2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a911320b08174d569825a268688afa2b", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a911320b08174d569825a268688afa2b"}]}] Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a911320b08174d569825a268688afa2b Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 52e3640cc0f148398eb650d072e910b2 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: exception: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '2558713f-7562-4337-8b0a-b117f22bfc3b'} Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 21:05:21.256568 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] Aug 27 21:05:21.266861 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:21.279859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Returning 404 to user: Security group rule 2558713f-7562-4337-8b0a-b117f22bfc3b does not exist Aug 27 21:05:21.279859 ncdv-master-1 devstack@n-api.service[140434]: Neutron server returns request_ids: ['req-0b1fef02-5088-486b-b79e-8d668101f520'] {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:21.282575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c7b2b19-28a1-4573-a046-862e99112899 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-group-rules/2558713f-7562-4337-8b0a-b117f22bfc3b" status: 404 len: 199 microversion: 2.1 time: 0.101436 Aug 27 21:05:21.290540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2017/3927] 10.222.0.40 () {58 vars in 1287 bytes} [Sat Aug 27 21:05:21 2022] DELETE /compute/v2.1/os-security-group-rules/2558713f-7562-4337-8b0a-b117f22bfc3b => generated 199 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:21.302919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21f1e62c-6261-47ac-a74a-cc5e143cb618 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84ea9ed30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:21.543841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21f1e62c-6261-47ac-a74a-cc5e143cb618 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/3d8d0f33-99de-4126-aa20-86c23114ba73" status: 202 len: 0 microversion: 2.1 time: 0.246633 Aug 27 21:05:21.552637 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1911/3928] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:05:21 2022] DELETE /compute/v2.1/os-security-groups/3d8d0f33-99de-4126-aa20-86c23114ba73 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:05:21.555283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-247cbb5d-f67b-4018-8bd1-34c71d35c8a5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84e642dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:21.650320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:21.651595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:21.658067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:21.658648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:21.659161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:21.660600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:21.661192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:21.661701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:21.837174 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-247cbb5d-f67b-4018-8bd1-34c71d35c8a5 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/fc9c805c-4000-4bfa-8449-c9189841329c" status: 202 len: 0 microversion: 2.1 time: 0.286593 Aug 27 21:05:21.838439 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2018/3929] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:05:21 2022] DELETE /compute/v2.1/os-security-groups/fc9c805c-4000-4bfa-8449-c9189841329c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:21.844854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:21.847564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8cea401-434d-43e0-8e2c-7cc8dbc7520b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84e57bee0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:21.864578 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b233a157-a8cd-4a37-afef-52f86ca46f97 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.218139 Aug 27 21:05:21.865240 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1912/3930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:21 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:22.026250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.026883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:22.038208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.039890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.040531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.042433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.043210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.045597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.085282 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8cea401-434d-43e0-8e2c-7cc8dbc7520b tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/e81e8f6f-6234-4c79-a74a-f22235252c87" status: 202 len: 0 microversion: 2.1 time: 0.241806 Aug 27 21:05:22.086306 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2019/3931] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:05:21 2022] DELETE /compute/v2.1/os-security-groups/e81e8f6f-6234-4c79-a74a-f22235252c87 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:05:22.094846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.095646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:22.106290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.106830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.107864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.108993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.109733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.110434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.349822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:22.355583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:22.360881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-90e1cc85-c86f-40fe-955e-c640fdff5ce5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.273392 Aug 27 21:05:22.362042 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2020/3932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:22 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:22.372095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fcb9cd08-0254-4436-bdd0-e46f62c8ad95 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.341889 Aug 27 21:05:22.378923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1913/3933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:22 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:22.384964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.385628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:22.390209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95cb5503-ccb8-44ed-9103-524a552a6208 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff857db9c10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.394384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.394921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.395368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.396098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.396677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.396983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.584065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:22.597171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c3ba3f3-4965-4dd2-9a3f-1094d626c579 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.215251 Aug 27 21:05:22.597297 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1914/3934] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:22 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:22.635190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.636144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:22.651224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.652338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.653336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.656242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.656888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.657668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.690114 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95cb5503-ccb8-44ed-9103-524a552a6208 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/d48829f4-51f3-42f8-88a4-f37d41e7ab4a" status: 202 len: 0 microversion: 2.1 time: 0.310160 Aug 27 21:05:22.690947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2021/3935] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:05:22 2022] DELETE /compute/v2.1/os-security-groups/d48829f4-51f3-42f8-88a4-f37d41e7ab4a => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:22.699440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-708e3a17-b5c1-4937-be4a-398a07d01800 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] Calling method '.version_select at 0x7ff84e6421f0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.935985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:22.949548 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05e084e9-954b-473e-a94a-04408bd32144 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.330244 Aug 27 21:05:22.956102 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1915/3936] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:22 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:22.961376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:22.968309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:22.979088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.979784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.980582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:22.981611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:22.982252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:22.982860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:23.145600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-708e3a17-b5c1-4937-be4a-398a07d01800 tempest-SecurityGroupRulesNegativeTestJSON-1430659779 tempest-SecurityGroupRulesNegativeTestJSON-1430659779-project] 10.222.0.40 "DELETE /compute/v2.1/os-security-groups/5094e832-4cf6-4dc0-9783-9c0cd65c189e" status: 202 len: 0 microversion: 2.1 time: 0.450248 Aug 27 21:05:23.146448 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2022/3937] 10.222.0.40 () {58 vars in 1272 bytes} [Sat Aug 27 21:05:22 2022] DELETE /compute/v2.1/os-security-groups/5094e832-4cf6-4dc0-9783-9c0cd65c189e => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:23.157337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-576086422"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:23.160902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:23.174927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:23.179484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:23.180872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:23.183591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:23.184704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:23.185094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:23.225244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:23.236860 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-331049d7-0c5c-4dad-8a97-d6e68b125e0a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.279531 Aug 27 21:05:23.237418 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1916/3938] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:22 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:23.387498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:23.388652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:23.398434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:23.399738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:23.400284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:23.401373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:23.402089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:23.402712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:23.475950 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e207941f-77dc-447e-a330-87c2e6515847 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.327823 Aug 27 21:05:23.478395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2023/3939] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:23 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 21:05:23.881413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:23.891425 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8662fd86-d734-4b57-8d08-824c4ccfa8e5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.509895 Aug 27 21:05:23.892350 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1917/3940] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:23 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:24.287459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:24.294888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:24.320985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:24.323093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:24.326357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:24.327135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:24.330200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:24.330954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:24.331527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:24.616083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:24.627323 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e74bb0bd-6e69-463d-ad65-d6e2391fd0e6 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.372576 Aug 27 21:05:24.641787 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2024/3941] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:24 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:24.912959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:24.914335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:24.928803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:24.930598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:24.931209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:24.932464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:24.932957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:24.933440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:25.211044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:25.220194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba394317-608f-4c54-92d2-e452e9efd15a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.311286 Aug 27 21:05:25.220744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1918/3942] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:24 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:25.668622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:25.670500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:25.694527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:25.696024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:25.699799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:25.702720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:25.704366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:25.705063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:25.993729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:26.002790 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a541b9d-0e73-4e15-86df-d39c101a7025 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.354222 Aug 27 21:05:26.018388 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2025/3943] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:25 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:26.241590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:26.242322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:26.263008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:26.263785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:26.264419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:26.265421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:26.265885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:26.266490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:26.850731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:26.866171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4fbe830-35c6-4029-8b9c-c2c86c48171a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.628984 Aug 27 21:05:26.866859 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1919/3944] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:26 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:27.025841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:27.026453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:27.039203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:27.039877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:27.040316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:27.041041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:27.041545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:27.042830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:27.338548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:27.357437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0337bc7e-c45f-4dc8-ac6a-602a8be2df41 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.335557 Aug 27 21:05:27.362040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2026/3945] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:27 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:27.887721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:27.888963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:27.903517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:27.904131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:27.905319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:27.906180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:27.906896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:27.907594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:28.142197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:28.154426 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6117a23e-8492-4671-9adf-fa7f4725e681 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.270521 Aug 27 21:05:28.167190 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1920/3946] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:27 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:28.382030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:28.383594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:28.394283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:28.395018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:28.395761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:28.396635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:28.409163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:28.410488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:28.626617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:28.637237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f150bab-ee68-405d-a55b-137a56fa0b7e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.262463 Aug 27 21:05:28.638506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2027/3947] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:28 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:29.180619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:29.182314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:29.195674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:29.196706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:29.197476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:29.198606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:29.199359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:29.200045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:29.425553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:29.447806 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82554a19-eb62-4328-a4d6-0a16d6620d8a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1522 microversion: 2.1 time: 0.266649 Aug 27 21:05:29.466489 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1921/3948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:29 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:29.662299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:29.663017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:29.700118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:29.703012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:29.704133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:29.706801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:29.714573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:29.718363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:29.998521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:30.011242 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93106c60-215f-41f3-b1b2-7691e879b777 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.353983 Aug 27 21:05:30.013954 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2028/3949] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:29 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:30.475395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:30.476807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:30.492590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:30.493118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:30.497133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:30.498203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:30.498838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:30.499517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:30.823232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:30.824921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:30.848812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:30.856221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:30.857760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:30.859248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:30.860146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:30.861640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:30.905767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:05:31.059227 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56603d65-eb69-488b-b950-8ae4ce213dc9 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "DELETE /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 204 len: 0 microversion: 2.1 time: 0.240875 Aug 27 21:05:31.063302 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2029/3950] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:05:30 2022] DELETE /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:05:31.070590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:31.071311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:31.077911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.078687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.079125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:31.084781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.084781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.084781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:31.535453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:31.555034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:31.556951 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9e1cb93-383d-4e15-968d-047612d58b47 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1502 microversion: 2.1 time: 1.083746 Aug 27 21:05:31.561530 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1922/3951] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:30 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1502 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:31.566590 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6fea05ad-52ca-40e7-beec-a6aaf53f539b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.501712 Aug 27 21:05:31.567205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2030/3952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:31 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:31.576022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:31.576022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:31.583549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:31.583549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:31.586819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.587677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.588784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:31.589850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.590885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.592008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:31.606500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.609587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.611109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:31.621570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:31.622210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:31.622782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.244336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:32.257705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50cc1b3c-0634-4167-aac6-55d32eab780a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1665 microversion: 2.1 time: 0.690270 Aug 27 21:05:32.258382 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1923/3953] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:31 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1665 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:32.284061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-plugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:32.308801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.311235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.311703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.330696 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] Creating event network-vif-plugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:05:32.352496 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0c2e3b7a-6b84-45b1-85b6-e3395acef722 req-a55e1878-26f4-4b1c-abee-42107678f2b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077290 Aug 27 21:05:32.355747 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1924/3954] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:32.424034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:32.438191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7dc2f108-3acf-494d-abf0-868f937cf690 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1515 microversion: 2.1 time: 0.860740 Aug 27 21:05:32.440961 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2031/3955] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:31 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1515 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:32.468422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:32.472270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:32.480717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa/action HTTP/1.1 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 14 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: {"rescue": {}} Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa', 'body': {'rescue': {}}} Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:32.501000 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. Aug 27 21:05:32.507253 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:05:32.512130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 404 to user: Instance e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:32.514127 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-71136b8a-45b8-4eb8-ba4d-7d39f92a0005 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa/action" status: 404 len: 111 microversion: 2.1 time: 0.053495 Aug 27 21:05:32.515849 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1925/3956] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:32 2022] POST /compute/v2.1/servers/e8e1c5fe-7c4c-4f0d-acde-b0acdafaacfa/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:32.525934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:32.526900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:32.535729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.536767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.537462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.538613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.540067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.540895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.600276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:32.603200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:32.625660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.626635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.627430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.628340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.628976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.629860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.660000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:32.677280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:32.781610 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f37b2ea-90f3-4729-a17f-9bbc8bd888e9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action" status: 202 len: 0 microversion: 2.1 time: 0.246086 Aug 27 21:05:32.793685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2032/3957] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:32 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:32.821014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:32.822291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:32.839083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.852219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.852771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.854318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:32.854919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:32.855385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:32.971441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:32.982262 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c03a7d82-a55e-4151-b4c9-597432923ca1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.393559 Aug 27 21:05:32.982844 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1926/3958] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:32 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:33.281568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:33.282195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:33.292086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:33.292586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:33.293023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:33.293737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:33.294193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:33.294617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:33.662004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:33.674288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97d2a4b1-1439-44f3-8d2c-67358d6d3f8f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1520 microversion: 2.1 time: 0.878626 Aug 27 21:05:33.674895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2033/3959] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:32 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1520 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:33.775717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:33.786879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-baff220b-ce92-4b9d-992d-2de23e0b5603 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1665 microversion: 2.1 time: 0.510789 Aug 27 21:05:33.799839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1927/3960] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:33 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1665 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:34.008019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:34.008959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:34.024376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.025108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.025764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:34.026681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.027333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.028063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:34.290197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:34.305573 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42b84535-7fb1-4995-9a82-a2c64bb7e7e2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.304459 Aug 27 21:05:34.307413 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2034/3961] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:33 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:34.699782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:34.700819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:34.703984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:34.717201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.717703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.718150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:34.718861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.719321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.719767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:34.808802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:34.809479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:34.825625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.826095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.826465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:34.827192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:34.827686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:34.828120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.461933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:35.473876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7eadb411-f367-405f-8953-45bc9d3274f8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1500 microversion: 2.1 time: 0.778023 Aug 27 21:05:35.474475 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1928/3962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:34 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1500 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:35.492830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:35.493664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:35.507195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.508871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.510019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.512674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.513349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.516446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.592122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:35.602286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8d9f6417-997b-4cd5-9caa-c31e4ba3d589 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1665 microversion: 2.1 time: 0.797488 Aug 27 21:05:35.608701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2035/3963] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:34 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1665 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:35.623853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:35.626819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:35.640934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.644480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.645403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.646313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.648115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.649217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.707050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'flavor' on Instance uuid c9133a12-8ade-4172-8ebf-cf81a8e3122b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:05:35.750288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Cannot 'rescue' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state paused Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action HTTP/1.1 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 14 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: {"rescue": {}} Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'rescue' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state paused Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'c9133a12-8ade-4172-8ebf-cf81a8e3122b', 'body': {'rescue': {}}} Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state paused Aug 27 21:05:35.752628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state paused Aug 27 21:05:35.758071 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:35.768433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 409 to user: Cannot 'rescue' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state paused {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:35.771936 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-838acfa6-63c9-4b73-ae18-51d89cf130cd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action" status: 409 len: 144 microversion: 2.1 time: 0.159578 Aug 27 21:05:35.773048 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2036/3964] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:35 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action => generated 144 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:05:35.785320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:35.786119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:35.812810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.817956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.819168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:35.822134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:35.824567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:35.830386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.009910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-073713ca-f1b2-4f84-b049-2f3d16e487ec tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action" status: 202 len: 0 microversion: 2.1 time: 0.231586 Aug 27 21:05:36.011669 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2037/3965] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:35 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:05:36.036784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:36.064585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:36.089210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.089720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.096077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.097173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.097843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.099438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.144124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:36.159907 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07d3e6cb-efa4-4809-b16c-6dafb24fe6ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.679044 Aug 27 21:05:36.167631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1929/3966] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:35 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:36.201524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:36.202055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:36.214352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.214858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.215855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.229277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.230655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.233276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.347683 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ddbc26e3-ba32-4af5-a948-0d018d1e1abe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/ips" status: 200 len: 150 microversion: 2.1 time: 0.150313 Aug 27 21:05:36.356464 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1930/3967] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:05:36 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/ips => generated 150 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:36.632777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:36.634106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:36.645559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.646061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.646506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.647221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.647782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.648206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.718349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:36.733344 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af138ba4-06a9-483b-931f-45262678b358 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1507 microversion: 2.1 time: 0.700400 Aug 27 21:05:36.745444 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2038/3968] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:36 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1507 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:36.763142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796226da-bbb0-4789-bc6c-198f2e0eb2d9", "name": "network-vif-deleted", "tag": "840cb2a7-5643-4024-832f-9d123b71221d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:36.785379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:36.788858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:36.790111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:36.855043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] Creating event network-vif-deleted:840cb2a7-5643-4024-832f-9d123b71221d for instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 on nch1-master-1 Aug 27 21:05:36.883391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1b9337b5-03be-40f4-8f92-9effb15c6f18 req-7177254c-bb46-4d83-bd09-2dd770e09450 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132603 Aug 27 21:05:36.884076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2039/3969] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:37.087708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:37.109908 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b6bec24-8d92-4bcd-83de-309f16cd4199 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1597 microversion: 2.1 time: 0.476536 Aug 27 21:05:37.121064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1931/3970] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:36 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1597 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:37.201730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:37.203442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:37.216232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:37.216920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:37.217561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:37.219376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:37.219960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:37.220561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:37.768540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:37.773768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:37.785292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:37.786304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:37.787208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:37.788558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:37.789302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:37.790001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:38.923367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:38.939876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de239ac6-7500-484a-854b-da95000e2ce0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1507 microversion: 2.1 time: 1.183390 Aug 27 21:05:38.955690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1932/3971] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:37 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1507 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:38.973865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:38.974508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:38.988009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:38.990933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:38.992034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:38.994217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:38.996859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:38.997556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:39.062125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:39.080315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b649014d-8c8d-4d52-9ddc-78f37895ba82 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 1.884258 Aug 27 21:05:39.081262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2040/3972] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:37 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:39.105122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:39.117499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:39.126992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:39.127535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:39.127973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:39.139928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:39.140709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:39.141320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:39.397841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:39.419582 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5175e68f-b622-43ef-9de4-6abca0827b8a tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1597 microversion: 2.1 time: 0.455702 Aug 27 21:05:39.433937 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1933/3973] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:38 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1597 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:39.751380 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668606 Aug 27 21:05:39.753130 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2041/3974] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:05:39 2022] POST /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:39.964726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:39.966293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:39.973792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:39.974290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:39.974730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:39.975616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:39.976265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:39.977002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:40.108600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:40.109325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:40.134390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:40.135001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:40.135544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:40.136534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:40.137715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:40.141470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:41.362216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:41.380145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-745ba053-e2de-4a1f-af65-86f17b873202 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1507 microversion: 2.1 time: 1.420297 Aug 27 21:05:41.385347 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1934/3975] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:39 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1507 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:41.391054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:41.391709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:41.417187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:41.418012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:41.418628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:41.419602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:41.420243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:41.420998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:41.457610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:41.475703 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7579a2d1-349c-42e4-90b0-67abacf4c812 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 1.372554 Aug 27 21:05:41.495292 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2042/3976] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:40 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:41.610715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dad9de98d1f4b628ebbcd88524cb501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfba7bee2de4b07b614be1fb9897414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:41.620751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9207825-f0e2-409b-b6db-8e20e03cbffa tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 200 len: 1597 microversion: 2.1 time: 0.233824 Aug 27 21:05:41.628066 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1935/3977] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:41 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 1597 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:42.409777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:42.411546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:42.438091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:42.441262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:42.443637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:42.444375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:42.444883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:42.445554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:42.497200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:42.497827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:42.522841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:42.526873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:42.531011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:42.535127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:42.535925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:42.538099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:43.111724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:43.117550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:43.128939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f28b7ec0-0706-42f7-be6c-aa9023f6b67a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1515 microversion: 2.1 time: 0.724452 Aug 27 21:05:43.142470 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2043/3978] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:42 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:43.174174 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-994ef1c6-f592-442b-976e-93ab908c5552 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.680938 Aug 27 21:05:43.177734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1936/3979] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:42 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:43.194605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:43.199106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] [instance: 796226da-bbb0-4789-bc6c-198f2e0eb2d9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:43.216673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:43.217172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:43.217619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:43.218332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:43.218842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:43.219274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:43.253821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] HTTP exception thrown: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Request method failure captured: Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 HTTP/1.1 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaqgfVnRGzimcqrZ-TysoDpEhvdY8renVDkzPxx2MQk1t_qiCbSQcO_Pm_eFzQ7myqJhEKJD8BV9h9HSV9oYr9kPzoD2G5d0u-ucRNggGg25m6pr_Aiwlj_pPeyZWemWTUO_IqJ31EMjmyRpP6E36lSAgZROZbgfTixW6rHuz5ZQ34 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: cbfba7bee2de4b07b614be1fb9897414 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersTestFqdnHostnames-1200105069 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cbfba7bee2de4b07b614be1fb9897414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cbfba7bee2de4b07b614be1fb9897414"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cbfba7bee2de4b07b614be1fb9897414", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cbfba7bee2de4b07b614be1fb9897414"}]}] Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersTestFqdnHostnames-1200105069 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: cbfba7bee2de4b07b614be1fb9897414 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1200105069 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersTestFqdnHostnames-1200105069-project Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4dad9de98d1f4b628ebbcd88524cb501 Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersTestFqdnHostnames-1200105069-project Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '796226da-bbb0-4789-bc6c-198f2e0eb2d9'} Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:05:43.255640 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Returning 404 to user: Instance 796226da-bbb0-4789-bc6c-198f2e0eb2d9 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb7b4565-cdf4-46a6-827f-354afe57e82e tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9" status: 404 len: 111 microversion: 2.1 time: 0.096321 Aug 27 21:05:43.261994 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2044/3980] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:43 2022] GET /compute/v2.1/servers/796226da-bbb0-4789-bc6c-198f2e0eb2d9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:05:43.269015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-992f022a-140e-4da0-960f-ab4fe57eb9e8 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] Calling method '.version_select at 0x7ff84f5103a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:43.340921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-992f022a-140e-4da0-960f-ab4fe57eb9e8 tempest-ServersTestFqdnHostnames-1200105069 tempest-ServersTestFqdnHostnames-1200105069-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442968011" status: 202 len: 0 microversion: 2.1 time: 0.074578 Aug 27 21:05:43.343603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1937/3981] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 21:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442968011 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:05:44.200381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:44.201098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:44.214536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:44.222757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:44.223254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:44.224077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:44.224547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:44.225039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:44.617860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1812e37-1b39-4d6b-be9b-4090571f2a7f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: .version_select at 0x7ff857d19e50>, body: {"keypair": {"name": "tempest-keypair-2050780874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS5U1hQPW5orOxL+Lyn/XypsherZoGV18WhOLOJltX1PhYPOuUHgIDuSbQZpEM7yI39UmDFx9O2EzqOqgWeQCP2VQ4kI4wepD2mwjgQaD/PAsuf7hXEBlBBdXwbkCqs4g=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:44.658388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b1812e37-1b39-4d6b-be9b-4090571f2a7f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:44.671287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b1812e37-1b39-4d6b-be9b-4090571f2a7f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:44.788265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1812e37-1b39-4d6b-be9b-4090571f2a7f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175465 Aug 27 21:05:44.791115 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1938/3982] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:05:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:45.126749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:45.140587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:45.162167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:45.169372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:45.172980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:45.174683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:45.180074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:45.184216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:45.247571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'flavor' on Instance uuid c9133a12-8ade-4172-8ebf-cf81a8e3122b {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:05:45.249300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:45.259036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e45b76b-577a-40c9-8c9b-ec3313f31c50 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 1.064155 Aug 27 21:05:45.276768 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2045/3983] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:44 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:45.427198 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3eddcb70-1558-47b0-9855-bcd76fa56036 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action" status: 200 len: 32 microversion: 2.1 time: 0.306573 Aug 27 21:05:45.428889 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1939/3984] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:05:45 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:05:45.446449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:45.449674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:45.497154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:45.504825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:45.507543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:45.508458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:45.508933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:45.509440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:45.869546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:45.888110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d4e69b40-ecad-4fed-a006-bc98c94becd1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.451542 Aug 27 21:05:45.904739 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2046/3985] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:45 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:46.283851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:46.284677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:46.298874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:46.300555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:46.302065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:46.304051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:46.306038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:46.306764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:46.912871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:46.913741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:46.932422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:46.934378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:46.935827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:46.938167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:46.938808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:46.940603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:46.980805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:46.993004 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4462e78a-0b01-4c6a-bf1c-a4a85110ef5a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.715591 Aug 27 21:05:46.993612 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1940/3986] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:46 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:47.741454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:47.751490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:47.764908 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bec7da99-0150-4132-bc6f-284e5fbd3e76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.851948 Aug 27 21:05:47.765604 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2047/3987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:46 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:48.015230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:48.015803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:48.046504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:48.047030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:48.047512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:48.048244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:48.048868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:48.049131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:48.786504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:48.787714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:48.797813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:48.805430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:48.806322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:48.807305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:48.812151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:48.812603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:48.814363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:48.830220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f08493f-11fb-4c37-9e3c-0ab53f0dbfe4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 0.818936 Aug 27 21:05:48.833633 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1941/3988] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:48 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:49.855494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:49.856377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:49.871732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:49.873310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:49.875108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:49.877529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:49.878599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:49.879222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:50.817233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:50.827123 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79b85345-95dd-4a56-af9a-d01eb1d19de6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 2.044766 Aug 27 21:05:50.846999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2048/3989] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:48 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:51.061141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:51.074889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6097a2b2-b616-425d-94d7-a438588a5dfb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1509 microversion: 2.1 time: 1.224166 Aug 27 21:05:51.078144 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1942/3990] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:49 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1509 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:51.855960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:51.856577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:51.872507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:51.874354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:51.874979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:51.878111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:51.878815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:51.879966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:52.098593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:52.100166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:52.114971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:52.118805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:52.123559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:52.125717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:52.126238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:52.126686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:52.215038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:52.731190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:52.746767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aacd9349-837a-4084-b641-6b48f8c04745 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.894927 Aug 27 21:05:52.750127 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2049/3991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:51 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:52.768151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-673904226", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b51e83b-3888-45e9-b028-18277f96139f"}], "security_groups": [{"name": "tempest-securitygroup--1999048752"}], "key_name": "tempest-keypair-2050780874", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:53.380010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:53.384204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] validate_networks() for [('3b51e83b-3888-45e9-b028-18277f96139f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:05:53.396844 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78c872b5-5001-45b6-9d6d-9f2642748090 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1530 microversion: 2.1 time: 1.302590 Aug 27 21:05:53.408209 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1943/3992] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:52 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1530 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:53.779029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:53.779643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:53.791256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:53.792188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:53.794160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:53.798230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:53.804183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:53.805175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:54.377771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:54.412698 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-064e4668-4ebf-448b-baa8-a246cde75df7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.646512 Aug 27 21:05:54.416463 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1944/3993] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:53 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:54.450840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:54.452741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:54.468280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:54.472758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:54.473855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:54.475108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:54.476353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:54.478140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:54.479910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:54.701524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:05:55.692163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:55.715963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bca6c535-846e-4f9a-bec5-fd092ba0f244 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1530 microversion: 2.1 time: 1.283455 Aug 27 21:05:55.719437 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1945/3994] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:54 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1530 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:55.736558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:55.737784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:55.781305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:55.781933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:55.783385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:55.828130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:55.832138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:55.832798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.139313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:56.148401 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15562bc5-12bb-4311-97f9-f35f3d7aa7a1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.422914 Aug 27 21:05:56.153687 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1946/3995] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:55 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:56.176326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8cc0de-cc27-4f8d-8b5c-610432b437c7", "name": "network-vif-plugged", "status": "completed", "tag": "5b75cf02-3db6-4088-bc87-a3bdb3bf2b63"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:05:56.203173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:56.203968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:56.204595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.227488 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] Creating event network-vif-plugged:5b75cf02-3db6-4088-bc87-a3bdb3bf2b63 for instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 on nch2-master-1 Aug 27 21:05:56.242965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-78c4da38-a18f-4a73-9ecf-c5488f5738d4 req-d052fc2f-54b7-4720-9d7c-2e8366100bea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074147 Aug 27 21:05:56.246791 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1947/3996] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:05:56.322995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:05:56.323384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:05:56.323647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:05:56.324089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:05:56.324520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:05:56.353707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:56.357046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:56.357563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.363456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:56.364102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:56.364552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.433551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:05:56.454431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:05:56.488545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:05:56.495948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:05:56.639882 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e7677b8-32bd-47e5-8ab8-ce56dea73150 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.886419 Aug 27 21:05:56.640866 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2050/3997] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:05:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:05:56.652741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-918f68fc-72fb-4c66-8a78-b9725ff32d22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:56.653468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-918f68fc-72fb-4c66-8a78-b9725ff32d22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:56.737675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:56.738847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:56.752363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:56.752866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:56.753320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.761516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:56.762011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:56.762463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:56.821501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-918f68fc-72fb-4c66-8a78-b9725ff32d22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:56.841164 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-918f68fc-72fb-4c66-8a78-b9725ff32d22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1241 microversion: 2.1 time: 0.192425 Aug 27 21:05:56.846814 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1948/3998] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:56 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:57.175034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:57.176055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:57.217439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:57.217439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:57.218719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:57.219213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:57.222232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:57.222691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:57.966625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:57.991098 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf7935fc-e457-432d-9fb9-e97244bbe9a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.257908 Aug 27 21:05:57.993657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2051/3999] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:56 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:58.008803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:58.009616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:58.028368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:58.036572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:58.036572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:58.036572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:58.036572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:58.037950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:58.360204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:58.378248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ea0194c-f616-4df5-8eb4-baac888c8929 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1245 microversion: 2.1 time: 0.382488 Aug 27 21:05:58.381637 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2052/4000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:57 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1245 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:58.572943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:58.602808 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3481f863-6e04-4b5b-bc40-efb1916ce21e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 1.427107 Aug 27 21:05:58.604377 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1949/4001] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:57 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:05:59.024323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:59.024967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:59.040257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.042939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.043453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:59.044202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.046905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.047422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:59.402226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:59.404036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:59.425359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.426112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.426995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:59.427904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.429205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.429798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:59.821373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:05:59.859085 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9d58e65-bd84-47f2-a7b6-0052c7002885 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1293 microversion: 2.1 time: 0.461380 Aug 27 21:05:59.870697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1950/4002] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:59 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:05:59.885625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:05:59.900374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:05:59.923296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.928302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.928940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:05:59.930112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:05:59.935722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:05:59.936531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:00.021869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:00.047113 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3b92ff84-28f4-4767-abf8-9b30a8339073 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.028945 Aug 27 21:06:00.048686 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2053/4003] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:59 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:00.893718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:00.895006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:00.912689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:00.913847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:00.915814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:00.921115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:00.921894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:00.922705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:01.357149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:01.366420 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cd1ed0e-74d2-4a73-bee2-409fda48a632 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1311 microversion: 2.1 time: 0.476650 Aug 27 21:06:01.379717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2054/4004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:00 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:01.385780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:01.393946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:01.416348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:01.416853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:01.417298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:01.418013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:01.418479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:01.418900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:01.614196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:01.624604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c39e1397-5ad7-447b-8898-042fd72b759c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 1.752363 Aug 27 21:06:01.635879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1951/4005] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:05:59 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:02.401543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:02.402528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:02.432997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:02.441547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:02.442248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:02.444299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:02.445106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:02.447248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:02.646721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:02.659534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f83774ab-1d44-4836-8a6b-c2ca4000275d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.278587 Aug 27 21:06:02.660172 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2055/4006] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:01 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:02.676184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:02.676827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:02.696831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:02.697328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:02.697776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:02.698497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:02.698952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:02.714646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:02.823191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:02.832153 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-731e9a22-b594-44af-9d2a-c44bba7376d0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1299 microversion: 2.1 time: 0.440550 Aug 27 21:06:02.846917 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1952/4007] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:02 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1299 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:03.395904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:03.397241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:03.407094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.409805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.410289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.411038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.413348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.413828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.424142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:03.440706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6580b94a-4710-4eb4-b06f-70a83a303cbd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1501 microversion: 2.1 time: 0.778167 Aug 27 21:06:03.459718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2056/4008] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:02 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1501 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:03.475241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd305a5-b2c7-4635-a2cf-500ae342a530"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:03.484787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:03.504221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.504947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.506719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.509965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.512082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.512850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.606491 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Cannot 'attach_volume' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state rescued Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/os-volume_attachments HTTP/1.1 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 74 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: {"volumeAttachment": {"volumeId": "acd305a5-b2c7-4635-a2cf-500ae342a530"}} Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'attach_volume' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state rescued Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': 'c9133a12-8ade-4172-8ebf-cf81a8e3122b', 'body': {'volumeAttachment': {'volumeId': 'acd305a5-b2c7-4635-a2cf-500ae342a530'}}} Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 21:06:03.608230 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state rescued Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state rescued Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 409 to user: Cannot 'attach_volume' instance c9133a12-8ade-4172-8ebf-cf81a8e3122b while it is in vm_state rescued {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3fb8f59d-9408-4e1a-ae08-9adc65045670 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.148836 Aug 27 21:06:03.617103 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2057/4009] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:06:03 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/os-volume_attachments => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:06:03.641147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:03.641692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:03.665889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.666538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.666803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.674180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.678596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.681860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.805521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:03.825475 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d46e3b9f-4829-48e8-aba8-8afbb2ace4d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.433164 Aug 27 21:06:03.827062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1953/4010] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:03 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:03.831968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:03.840566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:03.850534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.858343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.859105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.860031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.860630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.861218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.879690 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-700e5496-7512-4edb-bcb0-d7206b824eb8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action" status: 202 len: 0 microversion: 2.1 time: 0.242339 Aug 27 21:06:03.883489 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2058/4011] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:06:03 2022] POST /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:06:03.902037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:03.902884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:03.927026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.929590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.930055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:03.933182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:03.933598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:03.936223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:04.570059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:04.578236 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6598157e-cdf1-4204-a000-b888a1d2f7fb tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1299 microversion: 2.1 time: 0.693446 Aug 27 21:06:04.578836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2059/4012] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:03 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1299 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:04.584959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:04.585596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:04.596203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:04.599611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:04.600160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:04.600913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:04.601384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:04.608327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.002926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:05.023719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64cf7796-3a09-44db-bd17-7f9a1ae1d504 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.195293 Aug 27 21:06:05.037993 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1954/4013] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:03 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:05.046397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:05.047477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:05.053806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:05.057159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.058491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.059124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.060650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.061266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.062096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.237354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:05.249807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-67f7e8d3-989c-4cd2-82a3-34d6223380c7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1509 microversion: 2.1 time: 0.669445 Aug 27 21:06:05.261279 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2060/4014] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:04 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1509 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:05.601685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:05.602531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:05.617550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.618057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.618497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.640611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.641116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.646925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.710978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:05.727585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12ca9b56-6963-4229-94ff-4752623ccac3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.686228 Aug 27 21:06:05.728210 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1955/4015] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:05 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:05.760319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-548884737"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:05.765762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:05.779835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.782053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.782663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:05.784595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:05.787004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:05.789573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:06.216515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:06.238208 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f1f09ee-e34c-43cd-bbc7-86c14ecc4d96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.633541 Aug 27 21:06:06.254660 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2061/4016] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:05 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:06.264424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:06.265296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:06.279086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:06.279475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:06.280698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:06.282886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:06.283808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:06.284506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:06.361602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2edb05b8-5f71-48ba-9173-0d67bc04fe87 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.586943 Aug 27 21:06:06.363103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1956/4017] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:06:05 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 21:06:06.397130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:06.399787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:06.416886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:06.419624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:06.422786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:06.423624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:06.427772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:06.428560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:06.432294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:06.470779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:06.599806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:06.617149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a36e3ca2-e9ad-4d6e-aa5f-f0fe753fb4a9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.358432 Aug 27 21:06:06.621575 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2062/4018] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:06 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:06.831070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:06.881300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:06.912111 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91ddd965-6bb3-4e63-add5-8a4f42a5cee9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1509 microversion: 2.1 time: 0.546264 Aug 27 21:06:06.918856 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1957/4019] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:06 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:07.260547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:07.261926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:07.291000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.296272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.297841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:07.300616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.316827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.318287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:07.642729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:07.643806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:07.664316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.667204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.668257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:07.671666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.672436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.673474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:07.721712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:07.736257 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f352ed0-9d68-4f00-bf1d-66e39488f710 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.479266 Aug 27 21:06:07.740377 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2063/4020] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:07 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:07.937238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:07.937951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:07.950985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.951736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.952912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:07.956097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:07.956803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:07.957385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:08.014508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:08.596218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:08.612456 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2117341-708e-45ad-ae37-9df43d91d7ea tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.974473 Aug 27 21:06:08.636472 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1958/4021] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:07 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:08.641618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-unplugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:08.668289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:08.669557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:08.670219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:08.702369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] Creating event network-vif-unplugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:06:08.719533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6a3baa4a-eb7d-4daa-be64-bdc2115ce585 req-a67d3739-1f29-4e81-8b4f-1f59f6c07cbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081319 Aug 27 21:06:08.720521 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1959/4022] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:08.765185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:08.765498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:08.773757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:08.776939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:08.780001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:08.780629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:08.781541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:08.783937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:08.784744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:08.793847 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-763cdcfd-beec-454d-b65e-40c529d57ebf tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1509 microversion: 2.1 time: 0.863089 Aug 27 21:06:08.797727 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2064/4023] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:07 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1509 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:09.064843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:09.080265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8eb23fd4-b872-4be2-b22d-bc059be843dd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.317123 Aug 27 21:06:09.097089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1960/4024] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:08 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:09.448988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1750bd7e-c490-4129-b9b8-0f8079470e2d", "tag": "bf96bdab-d107-4833-9746-ea8907b4977d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:09.506123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:09.506620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:09.507061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:09.554715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] Creating event network-changed:bf96bdab-d107-4833-9746-ea8907b4977d for instance 1750bd7e-c490-4129-b9b8-0f8079470e2d on nch1-master-1 Aug 27 21:06:09.573915 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-58778211-537a-43f2-96a3-1ac01a662efd req-56cf5bea-6410-4c32-8a98-5b1998a0e400 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128150 Aug 27 21:06:09.577140 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2065/4025] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:09.642944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:09.643772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:09.674155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:09.676610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:09.679422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:09.680383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:09.681680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:09.685467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:09.698109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:09.820085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:09.822071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:09.842513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:09.845895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:09.847770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:09.848733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:09.850051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:09.852188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:10.466296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:10.492047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4976a4ee-c048-43a2-aadb-40dd92af52b3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.854104 Aug 27 21:06:10.492872 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1961/4026] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:09 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:10.520037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:10.520685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:10.536287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:10.536793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:10.537272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:10.538295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:10.538776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:10.539216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:11.088021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:11.106290 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6a13271-796f-4b93-aa47-4642dbb9a7c2 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1509 microversion: 2.1 time: 1.291879 Aug 27 21:06:11.107615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2066/4027] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:09 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1509 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:11.515874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:11.516608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:11.532794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:11.534874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:11.536678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:11.537763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:11.538853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:11.539588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:11.899642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:11.908734 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d37aa6da-51db-42d0-b805-e04ad37d5262 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 1.397414 Aug 27 21:06:11.914255 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1962/4028] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:10 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:12.132612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:12.133902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:12.151033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:12.151810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:12.152572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:12.154003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:12.157396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:12.158041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:13.108427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:13.125993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ea27c585-9bcd-4a36-880e-51baef8a0aa9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.615493 Aug 27 21:06:13.128179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2067/4029] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:11 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:13.145645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:13.160563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:13.179387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:13.179934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:13.180690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:13.182021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:13.182913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:13.183627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:13.526178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:13.535231 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d38b75d-782d-4687-b9fb-01b2fdff921f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1515 microversion: 2.1 time: 1.410542 Aug 27 21:06:13.546503 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1963/4030] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:12 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1515 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:14.065352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:14.082451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-410e5ccf-62c8-4e69-b7b5-27de7fba3357 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.952089 Aug 27 21:06:14.084865 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2068/4031] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:13 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:14.161415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:14.163290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:14.184116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:14.195397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:14.196935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:14.197946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:14.199237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:14.199896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:14.520053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-plugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:14.542710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:14.549702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:14.550544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:14.578110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] Creating event network-vif-plugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:06:14.591835 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6e1dcd9c-7cdb-4a72-b3eb-7ac4be6cc8cf req-27e57e92-b5bd-4873-8960-99e2ddf15338 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075742 Aug 27 21:06:14.592459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2069/4032] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:06:14.862983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:14.883199 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce7da617-080d-4a3c-bee8-34fbe2773c63 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.724692 Aug 27 21:06:14.884215 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1964/4033] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:14 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:15.111265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:15.112242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:15.126836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:15.128169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:15.133291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:15.145360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:15.146027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:15.146510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:15.413177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34de7e6e-b4fc-4aae-b650-2c2245774c86 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: .version_select at 0x7ff84e0addc0>, body: {"keypair": {"name": "tempest-keypair-1311781983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+Ys6KWY3jk9C/FoFGLHOXdhCrPb+8n9wldGyTXsP3iGKQsOximEFutGW3anxusaAJVX9hnjaRRaYPXHT/rr1ETi5FyD0wRb649XRdy+ojNtse/UJ0DFjgwVeYK+PNZFQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:15.430859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:15.441071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eba89061-f33b-49ac-9f01-225f58442371 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.339465 Aug 27 21:06:15.455879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2070/4034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:15 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:15.469102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-34de7e6e-b4fc-4aae-b650-2c2245774c86 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:15.477098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-34de7e6e-b4fc-4aae-b650-2c2245774c86 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for user 5d8126f174f5424ebdcc1f062ffb9b69 and project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:15.518354 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34de7e6e-b4fc-4aae-b650-2c2245774c86 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109360 Aug 27 21:06:15.519416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1965/4035] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:06:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:06:15.905752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:15.906450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:15.924054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:15.924859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:15.925468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:15.926762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:15.927971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:15.929195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:16.475646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:16.476612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:16.506445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:16.507436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:16.510732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:16.513966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:16.517459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:16.522580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:16.593828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:16.607599 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04e39c04-7b96-4dfc-95d6-be29e74f255f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.705297 Aug 27 21:06:16.612089 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2071/4036] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:15 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:17.038412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:17.053372 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-18ede2de-1e38-42ae-9e6c-c75ddc48db8e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.583168 Aug 27 21:06:17.056380 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1966/4037] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:16 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:17.632294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:17.633306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:17.646112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:17.653068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:17.659238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:17.660325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:17.661037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:17.662277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:17.975115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:17.988395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2cdb7fd1-2336-4252-9f68-0bb9ed12c9ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 0.360082 Aug 27 21:06:17.995769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2072/4038] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:17 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:18.078951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:18.081312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:18.109312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:18.114437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:18.115046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:18.117512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:18.119120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:18.119866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:18.747870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:18.767561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b4625cf-3fe1-4182-a46e-9a7120a23db8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.686563 Aug 27 21:06:18.771104 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1967/4039] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:18 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:19.018063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:19.019292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:19.038382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:19.043774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:19.052126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:19.054363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:19.054864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:19.055313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:19.793097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:19.793994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:19.809723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:19.810229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:19.810703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:19.816486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:19.817239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:19.819755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:20.321846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:20.330680 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0ea2f52-3625-410a-aa4d-1c4067159005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.316530 Aug 27 21:06:20.341612 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2073/4040] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:19 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:20.554770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:20.573587 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4d540e4-927e-4491-9422-6b84f4747d6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.785927 Aug 27 21:06:20.587619 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1968/4041] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:19 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:21.412760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:21.414182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:21.446812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:21.450075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:21.453423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:21.457282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:21.460007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:21.499970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:21.600882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:21.601823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:21.616126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:21.636016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:21.639692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:21.642770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:21.643896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:21.645586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:23.184460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:23.212637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-edb87dec-01ac-4cdf-bbf2-e61a7e38343a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 1.607821 Aug 27 21:06:23.213804 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1969/4042] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:21 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:23.241688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-255316646", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13aa375b-8d4e-4b5e-890e-fb0d2980573c"}], "security_groups": [{"name": "tempest-securitygroup--53066555"}], "key_name": "tempest-keypair-1311781983", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:24.782207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:24.794495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f52f8dea-b907-45be-bdf7-92a99f5f51d1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 3.435991 Aug 27 21:06:24.796043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2074/4043] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:21 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 3438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:24.813567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:24.814502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:24.830151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:24.838532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:24.841184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:24.841941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:24.843222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:24.844411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:24.846924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:25.382446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] validate_networks() for [('13aa375b-8d4e-4b5e-890e-fb0d2980573c', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:06:25.486801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:25.841947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:25.869222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-12accd92-7a61-4d6a-a5ba-1237643f072a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 1.064109 Aug 27 21:06:25.888964 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2075/4044] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:24 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:25.908224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:25.909534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:25.932554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:25.933648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:25.935975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:25.938718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:25.941073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:25.943318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:27.370856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:27.386256 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c3220a8-a345-4a12-ac04-ce8fc2560226 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1525 microversion: 2.1 time: 1.494227 Aug 27 21:06:27.389621 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2076/4045] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:25 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1525 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:27.399827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:27.401274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:27.410899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:27.411712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:27.413258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:27.414371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:27.415202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:27.415873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:28.893909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:28.905579 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf5082d5-b602-4a60-8758-caf13353f59b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 1.514576 Aug 27 21:06:28.918943 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2077/4046] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:27 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:28.918943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:28.918943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:28.919656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:28.920504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:28.921146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:28.922707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:28.923521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:28.924176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:29.835904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:06:29.836450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:06:29.837010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:06:29.838530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:06:29.839088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:06:29.881560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:29.882162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:29.887930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:29.889147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:29.889838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:29.890722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:29.949735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:29.952158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:29.968097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Getting quotas for user 5d8126f174f5424ebdcc1f062ffb9b69 and project e4ebee97f90d4fafbcadeb4e8279c8f8. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:29.972384 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63f70729-0c12-4fff-8b22-44988b13c6cf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1507 microversion: 2.1 time: 1.063800 Aug 27 21:06:29.976259 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2078/4047] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:28 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1507 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:29.984041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1750bd7e-c490-4129-b9b8-0f8079470e2d", "name": "network-vif-plugged", "status": "completed", "tag": "bf96bdab-d107-4833-9746-ea8907b4977d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:29.998273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:06:30.003111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:06:30.008512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:30.009542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:30.010240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:30.040344 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] Creating event network-vif-plugged:bf96bdab-d107-4833-9746-ea8907b4977d for instance 1750bd7e-c490-4129-b9b8-0f8079470e2d on nch1-master-1 Aug 27 21:06:30.053672 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d76cf9d0-4e30-4b3c-9b71-0f967803f51a req-c2ea04d6-fac5-488e-8033-821c156c9aa3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075839 Aug 27 21:06:30.055482 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2079/4048] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:30.079263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:30.081046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:30.091795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:30.092692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:30.094866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:30.096004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:30.096928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:30.128730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:30.135324 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a4d137a-1779-4354-a8ff-1593279c50b0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 6.918219 Aug 27 21:06:30.137004 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1970/4049] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:06:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 6922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:06:30.152165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-346f3f2e-0723-4f5a-a0e9-38e1d2d417d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:30.164222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-346f3f2e-0723-4f5a-a0e9-38e1d2d417d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:30.734268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-346f3f2e-0723-4f5a-a0e9-38e1d2d417d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:30.741894 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-346f3f2e-0723-4f5a-a0e9-38e1d2d417d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1245 microversion: 2.1 time: 0.597320 Aug 27 21:06:30.747663 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1971/4050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:30 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1245 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:30.909945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:30.924459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21167813-1170-46fe-ab10-4db4c9c667ca tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.867338 Aug 27 21:06:30.925090 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2080/4051] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:30 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:30.994617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f62a20c-6639-479b-8197-f46522cb10d5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Action: 'create', calling method: .version_select at 0x7ff84f69b3a0>, body: {"keypair": {"name": "tempest-keypair-2025754348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgh1o0ZI4k/gDEqMzQwjj9UGiGNYCUrzfMleL4c/dSiKW84tqKekwG5/3B8x0UXtS2M1GuD1rYWgBs4Pi7BGKo22w4sfFvE+d/KnsZzSkw89P1l9iahH82hUQLRDKIqmw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:31.014556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:31.017074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:31.051156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.052810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.054298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:31.056884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.058345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.060162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:31.066727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1f62a20c-6639-479b-8197-f46522cb10d5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Getting quotas for project f9abfa1d159f4e2cb2ddbbcd80f3615e. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:31.096902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1f62a20c-6639-479b-8197-f46522cb10d5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Getting quotas for user 1eb7e6ff68c14b3f8f6ce22a6926920b and project f9abfa1d159f4e2cb2ddbbcd80f3615e. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:31.262717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f62a20c-6639-479b-8197-f46522cb10d5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.273002 Aug 27 21:06:31.263659 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1972/4052] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 21:06:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 21:06:31.571051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:31.582736 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39bc55fa-9867-4906-af84-ba2ddef48348 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1507 microversion: 2.1 time: 0.574022 Aug 27 21:06:31.585808 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2081/4053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:31 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:31.766988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:31.767690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:31.783300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.783847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.784308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:31.785043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.785525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.785947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:31.954839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:31.955601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:31.977726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.978388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.980008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:31.981507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:31.983079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:31.992190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:32.174326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:32.194519 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66885708-37e2-4243-899b-c42ac1eee048 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1249 microversion: 2.1 time: 0.424217 Aug 27 21:06:32.213392 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1973/4054] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:31 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1249 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:32.301066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8cc0de-cc27-4f8d-8b5c-610432b437c7", "name": "network-vif-unplugged", "status": "completed", "tag": "5b75cf02-3db6-4088-bc87-a3bdb3bf2b63"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:32.345410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:32.348118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:32.349310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:32.397077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] Creating event network-vif-unplugged:5b75cf02-3db6-4088-bc87-a3bdb3bf2b63 for instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 on nch2-master-1 Aug 27 21:06:32.418092 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4fd694dd-8a51-4c1f-b5fb-026ccdea38cc req-f8fc6368-ac68-4fad-9ce0-f144100ea45d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116567 Aug 27 21:06:32.422847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1974/4055] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:32.474970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:32.497673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ab6fbf9-77df-45a9-9b40-deca84fb2c2d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1367 microversion: 2.1 time: 0.554532 Aug 27 21:06:32.502116 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2082/4056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:31 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:32.608238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:32.609171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:32.619384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:32.627223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:32.628085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:32.629270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:32.635064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:32.635834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.116770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:33.136374 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ca66f86-f826-4168-a64d-9f0272aea9f8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 200 len: 1450 microversion: 2.1 time: 0.532609 Aug 27 21:06:33.155100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1975/4057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:32 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 1450 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:33.161489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:33.162718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:33.189198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.189878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.190462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.191411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.192015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.192586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.220949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:33.244927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:33.246260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:33.268348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.270070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.272144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.274331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.275511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.281110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.323521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:06:33.341085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Working on deleting snapshot 5cee5e2c-d133-4aec-8f80-3d0f9e204070 from shelved instance... Aug 27 21:06:33.407921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:33.420195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4dabde53-c515-42ea-98e5-e4ab4dec131c tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1297 microversion: 2.1 time: 0.199313 Aug 27 21:06:33.421461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1976/4058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:33 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:33.523974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:33.524884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:33.538637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.545970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.549009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.553134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:33.560128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:33.566650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:33.979884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:33.990143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6070174c-2bdb-46a5-b8cc-c5b18e65243b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1556 microversion: 2.1 time: 0.472417 Aug 27 21:06:34.000702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1977/4059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:33 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1556 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:34.025722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:34.026325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:34.051523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:34.052035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:34.052550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:34.053284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:34.053747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:34.054181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:34.364528 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf623133-cb85-4dac-82fc-3b58a7850089 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.347664 Aug 27 21:06:34.365618 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1978/4060] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:06:34 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/os-interface => generated 284 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:34.443235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:34.443969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:34.456239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:34.464108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:34.468276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:34.469298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:34.470042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:34.471368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:34.793527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:34.812295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab595f3f-2f6a-4e88-8265-1ffb25b1087f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1303 microversion: 2.1 time: 0.374101 Aug 27 21:06:34.815657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1979/4061] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:34 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:35.011358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Doing local delete in cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140434) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 21:06:35.014703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:35.015497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:35.016185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:35.016972 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 21:06:35.037439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] deallocate_for_instance() {{(pid=140434) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 21:06:35.838410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:35.839696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:35.848190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:35.858103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:35.859020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:35.861654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:35.862509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:35.863137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:35.865045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:36.056769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:36.073003 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fa180a1-58d6-4a26-94bd-1546454c41af tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1303 microversion: 2.1 time: 0.234727 Aug 27 21:06:36.074068 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1980/4062] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:35 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:37.095544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:37.097209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:37.112747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:37.113516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:37.117004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:37.118364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:37.123246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:37.126838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:38.786344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Updating instance_info_cache with network_info: [] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 21:06:39.098868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:39.118437 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05bb5340-751b-4b1e-a668-a800c0dcfbc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 2.027798 Aug 27 21:06:39.121513 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1981/4063] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:37 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:39.223187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f443d2b-d63b-402e-a4e8-b7c188131d86 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 204 len: 0 microversion: 2.1 time: 6.066572 Aug 27 21:06:39.224530 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2083/4064] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:06:33 2022] DELETE /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 0 bytes in 6069 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:06:39.245044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:39.245752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:39.261753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:39.262267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:39.262720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:39.267569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:39.268175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:39.268800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:39.306467 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 HTTP/1.1 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '2b8cc0de-cc27-4f8d-8b5c-610432b437c7'} Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:06:39.308463 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:06:39.312405 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:06:39.315975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:06:39.317034 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8557aa90-9eb4-420e-b73b-7d00a303e62c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 404 len: 111 microversion: 2.1 time: 0.086583 Aug 27 21:06:39.332093 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2084/4065] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:39 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:06:39.546413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8cc0de-cc27-4f8d-8b5c-610432b437c7", "name": "network-vif-deleted", "tag": "5b75cf02-3db6-4088-bc87-a3bdb3bf2b63"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:39.551443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1634253872", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:39.583533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:39.584422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:39.584872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:39.633177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.compute.server_external_events [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] Unable to find a host for instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7. Dropping event network-vif-deleted {{(pid=140433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 21:06:39.634175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8a2a9607-d9cb-418b-8f2b-90e4824133fc req-2214d785-5cb9-489c-9b94-8f920ef7b3ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.511473 Aug 27 21:06:39.634806 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1982/4066] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 513 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 21:06:39.635444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:06:39.851733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:39.862429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:39.863176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:39.863780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:39.868813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:39.877454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] Creating event network-changed:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:06:39.884411 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-64fd234c-a1d3-4dca-bf2a-5ab74e11c936 req-512988c0-2596-4fab-9511-c18ec932859d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037009 Aug 27 21:06:39.885585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1983/4067] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:06:40.139534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:40.145629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:40.147046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:40.162774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:40.164539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:40.165084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:40.168494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:40.169116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:40.169659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:41.112133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:41.128564 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0077918-36f0-4adb-b527-fc53be9519b9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 0.986758 Aug 27 21:06:41.129245 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1984/4068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:40 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:42.156066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:42.156700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:42.177125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:42.185334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:42.188556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:42.189121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:42.193966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:42.194775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:42.195245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:43.070213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:06:43.070770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:06:43.071318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:06:43.071988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:06:43.072798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:06:43.096020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:43.096905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:43.099908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:43.100833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:43.101418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:43.101971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:43.147969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:43.161348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:43.194398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:06:43.198477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:06:43.316938 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3644a7e-f3f1-4e04-904f-e2f4835fcb36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.769536 Aug 27 21:06:43.328896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2085/4069] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:06:43.348581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-913450d9-1880-4163-b9fd-c67f27c071a2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:43.351175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-913450d9-1880-4163-b9fd-c67f27c071a2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:43.431002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:43.444541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8ac50b0-d27c-4001-b2ed-32b8ddb24000 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 1.291729 Aug 27 21:06:43.464276 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1985/4070] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:42 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:43.601326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-879901796", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9d421850-b206-46c3-af15-95d3ee5bb875"}, {"port": "7dc90f8a-6c03-4fad-b767-d78d9192a901", "tag": "port-1"}, {"port": "3e9fb118-6067-45ee-8c69-915038ed9866", "tag": "port-2"}, {"uuid": "ad1626fd-51fe-42e7-999b-df436b8033ae", "tag": "net-1"}, {"uuid": "ad1626fd-51fe-42e7-999b-df436b8033ae"}, {"uuid": "b224b46b-2a1a-4294-800e-5e8c8855bfe9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b224b46b-2a1a-4294-800e-5e8c8855bfe9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4e2488ca-6bf7-4eec-90ad-0aee15955f29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7bb09a2e-9d97-407e-a8bf-817e7b438724", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "80f8feb0-5bbf-4857-8078-a818ff55caea", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1881743989"}], "key_name": "tempest-keypair-2025754348", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:43.770517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-913450d9-1880-4163-b9fd-c67f27c071a2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:43.779895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-913450d9-1880-4163-b9fd-c67f27c071a2 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1215 microversion: 2.1 time: 0.449399 Aug 27 21:06:43.799849 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2086/4071] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:43 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1215 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:43.810181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1750bd7e-c490-4129-b9b8-0f8079470e2d", "tag": "bf96bdab-d107-4833-9746-ea8907b4977d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:43.843796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:43.850690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:43.851897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:43.916285 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] Creating event network-changed:bf96bdab-d107-4833-9746-ea8907b4977d for instance 1750bd7e-c490-4129-b9b8-0f8079470e2d on nch1-master-1 Aug 27 21:06:43.956360 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-17293ad6-aa0a-4d02-8d67-c497797e3424 req-f2518ee8-432f-41b3-9b25-ece197bfd78d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154582 Aug 27 21:06:43.972308 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2087/4072] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:44.168223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] validate_networks() for [('9d421850-b206-46c3-af15-95d3ee5bb875', None, None, None, None, None), (None, None, '7dc90f8a-6c03-4fad-b767-d78d9192a901', None, None, None), (None, None, '3e9fb118-6067-45ee-8c69-915038ed9866', None, None, None), ('ad1626fd-51fe-42e7-999b-df436b8033ae', None, None, None, None, None), ('ad1626fd-51fe-42e7-999b-df436b8033ae', None, None, None, None, None), ('b224b46b-2a1a-4294-800e-5e8c8855bfe9', '10.2.2.100', None, None, None, None), ('b224b46b-2a1a-4294-800e-5e8c8855bfe9', '10.2.2.200', None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:06:44.489225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:44.508448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:44.559965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:44.572428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:44.574951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:44.580581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:44.592537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:44.604556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:46.061562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:46.078422 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b780fac-5c30-40ab-9b47-5c1cf47b629f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 1.609054 Aug 27 21:06:46.084144 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2088/4073] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:44 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:46.098201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:46.099645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:46.112398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:46.114636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:46.116259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:46.118240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:46.118899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:46.121041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:46.353791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:46.409282 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b23b7c7-5107-497e-8a1c-dfc35d0ce2a0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1267 microversion: 2.1 time: 0.312838 Aug 27 21:06:46.411504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2089/4074] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:46 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:47.110200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:47.110903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:47.125275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:47.125829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:47.126282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:47.127048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:47.127654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:47.128124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:47.568117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:47.594266 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78a8ceb6-66e0-42c8-9793-2218c9e0f082 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 0.487662 Aug 27 21:06:47.608470 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2090/4075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:47 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:47.634020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:47.635163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:47.651400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:47.652483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:47.653156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:47.654075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:47.654666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:47.655289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:47.815125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:47.831717 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18afdadf-eac4-40cb-b0db-b45a1b716ab8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1273 microversion: 2.1 time: 0.216805 Aug 27 21:06:47.836139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2091/4076] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:47 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:48.622648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:48.623370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:48.637986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:48.638954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:48.639626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:48.642060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:48.642564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:48.645587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:49.183638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:49.199979 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-31f1c7b9-b64a-4f15-bdd8-22a20b121dcc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 0.583457 Aug 27 21:06:49.214501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2092/4077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:48 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:49.225055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:49.225954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:49.233805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:49.234565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:49.235123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:49.236058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:49.236687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:49.237762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:49.353783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:49.362017 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8565a776-5df5-4723-bd95-fc19ad5952d4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1273 microversion: 2.1 time: 0.142706 Aug 27 21:06:49.371000 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2093/4078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:49 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:49.376467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "name": "network-vif-plugged", "status": "completed", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:49.398251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:49.403123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:49.403728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:49.419238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] Creating event network-vif-plugged:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:06:49.426191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ed1df5fa-1aa8-4dde-87b6-aa8855d9eeeb req-1e36901c-9633-490f-b650-6375a4d62b65 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053152 Aug 27 21:06:49.427401 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2094/4079] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:50.023433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:50.025362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:50.052545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.055571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.056511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.058076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.059206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.060988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.399706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:50.412645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7105f375-ca0c-409b-ba4a-0091a2abdf65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.402928 Aug 27 21:06:50.430099 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2095/4080] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:50 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:50.438251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:50.439095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:50.447849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.449252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.450480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.452326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.452962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.453548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.728069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:50.740298 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b74da11-a8d6-4bcc-90bd-9a2c3b14e4fa tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 0.307585 Aug 27 21:06:50.747812 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2096/4081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:50 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:50.752856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:50.757294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:50.769237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.770086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.770806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.771775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:50.772462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:50.773098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:50.812777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:51.075225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:51.087821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69c2f738-f9b2-4170-bfda-7536e9a38e08 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.335775 Aug 27 21:06:51.088552 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2097/4082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:50 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:51.098101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-433134130"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:51.101612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:51.108482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.109130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.109830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.110639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.111605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.112136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.224234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:06:51.225979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:06:51.226885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:06:51.227501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:06:51.228213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:06:51.247731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.248527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.249128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.261399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.262250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.266485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.308845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Getting quotas for project f9abfa1d159f4e2cb2ddbbcd80f3615e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:51.316110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Getting quotas for user 1eb7e6ff68c14b3f8f6ce22a6926920b and project f9abfa1d159f4e2cb2ddbbcd80f3615e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:51.383840 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-594f861b-be04-4e37-815a-410523446f8a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.293052 Aug 27 21:06:51.385759 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2098/4083] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:06:51 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 21:06:51.400428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:51.401378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:51.409357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.410149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.411107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.412587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.413431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.414145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.530792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:06:51.534136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4e2488ca-6bf7-4eec-90ad-0aee15955f29',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7bb09a2e-9d97-407e-a8bf-817e7b438724',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80f8feb0-5bbf-4857-8078-a818ff55caea',volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:06:51.796551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:51.808441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c920e0d-652c-4a5d-96d6-5201380f9e08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.415493 Aug 27 21:06:51.811035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2099/4084] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:51 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:51.815994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:51.816807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:51.825260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.825868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.826450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:51.827302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:51.827895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:51.829440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.150670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-947ac93e-01e0-447e-a7d4-1bc9745f7747 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.555550 Aug 27 21:06:52.152020 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1986/4085] 10.222.0.40 () {62 vars in 1189 bytes} [Sat Aug 27 21:06:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 8558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:06:52.157471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:52.157746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:52.158688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:52.167649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:52.168341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:52.168946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.169968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:52.170635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:52.172277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.181309 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c883553c-fa2c-4fe7-a010-53f45252337b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1369 microversion: 2.1 time: 0.367375 Aug 27 21:06:52.182028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2100/4086] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:51 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1369 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:52.192838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:52.193635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:52.344349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:52.353791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:52.356329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:52.358116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb4b1a68-de42-428a-b507-62beef784b9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1285 microversion: 2.42 time: 0.172251 Aug 27 21:06:52.359133 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2101/4087] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:52 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:06:52.550146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:52.564993 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a250bb52-1912-4aec-9414-6c591494f4cb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.411389 Aug 27 21:06:52.565698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1987/4088] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:52 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:52.834345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:52.835908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:52.844838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:52.847550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:52.848261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.849766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:52.850457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:52.851469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.938420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08af7293-d682-4778-b885-31467d65e8fa", "tag": "c76783dd-7fc4-44ce-852f-8b2893e4579e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:52.967742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:52.968704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:52.969280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:52.992117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] Creating event network-changed:c76783dd-7fc4-44ce-852f-8b2893e4579e for instance 08af7293-d682-4778-b885-31467d65e8fa on nch2-master-1 Aug 27 21:06:53.000593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0404f873-d70a-47c9-be42-de12726e6aff req-5c180dd0-71ed-4ad2-adf8-12110cf0d098 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074677 Aug 27 21:06:53.001997 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1988/4089] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:06:53.078885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.090697 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2d92b35-e408-4946-bfb0-fea05021e60e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.261366 Aug 27 21:06:53.106046 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2102/4090] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:52 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:53.204484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:53.205392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:53.217042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.217954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.218712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.219710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.220367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.221242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.386316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:53.387114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:53.390585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:53.407262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.408150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.409360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.410279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.412408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.414784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.463252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.475593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e3bd1ab-20de-4b99-84f6-0de6e3508c76 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1562 microversion: 2.1 time: 0.276798 Aug 27 21:06:53.476506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1989/4091] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:53 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1562 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:53.513810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:53.515464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:53.527812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.540541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.554396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.555570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.556405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.556733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.558332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.558611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.559309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.560217 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-042a0161-5811-4945-9afe-b28568c40987 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1519 microversion: 2.42 time: 0.179471 Aug 27 21:06:53.561180 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2103/4092] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:53 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:06:53.586862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:53.587568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:53.604578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.606075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.610469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.613028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:53.617386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:53.618076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:53.678295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d273595d-b676-4189-9a1c-b887c0efa417 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179047 Aug 27 21:06:53.680442 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1990/4093] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:06:53 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:53.971797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:53.997669 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e0c0cc1-37ed-47ed-9dae-a84a73510d38 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.414425 Aug 27 21:06:53.999063 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2104/4094] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:53 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:54.121763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:54.122422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:54.133212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:54.134271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:54.134927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:54.135882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:54.136491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:54.137116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:54.559615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:54.571544 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e8b59d8-8d9c-4487-a633-5c4e29fb8eea tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.456026 Aug 27 21:06:54.584915 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1991/4095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:54 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:54.591863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:54.593368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:54.602837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:54.604634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:54.605059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:54.606342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:54.607110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:54.607858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:54.742898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:54.770919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-unplugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:54.799413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:54.814171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:54.817323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:54.818577 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-17986792-a5b2-4968-857f-57dbfbcad05e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1593 microversion: 2.42 time: 0.232256 Aug 27 21:06:54.819496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:54.822759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:54.824499 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2105/4096] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:54 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1593 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:06:54.845154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] Creating event network-vif-unplugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:06:54.853166 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0ae00757-93a3-47a8-8881-6bd1f18fa43b req-61100cd6-70df-47cc-b675-d12cce54fc5d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089901 Aug 27 21:06:54.854405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1992/4097] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:55.022377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:55.023273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:55.026130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:06:55.032738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.033655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.034938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:55.035219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.035854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.036782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:55.570457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:55.582851 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3acbe5f6-8792-4dea-b2ee-94b650f1d305 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.564875 Aug 27 21:06:55.590479 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2106/4098] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:55 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:55.600398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:55.603189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:55.614051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.615032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.615848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:55.617024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.617823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.620580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:55.857115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:55.868465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:55.883081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.884004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.884654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:55.885418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:55.885889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:55.886323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:56.062529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:56.078761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:56.081485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:56.084708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4109c5b3-d686-4a4a-a2b9-54fc5136d25d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1593 microversion: 2.42 time: 0.238822 Aug 27 21:06:56.088580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2107/4099] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:55 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1593 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:06:56.106786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:56.117532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-09b6f6a4-f7eb-46f7-94fd-68ab9e400409 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1686 microversion: 2.1 time: 0.525065 Aug 27 21:06:56.128251 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1993/4100] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:55 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1686 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:56.319979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:56.337581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:56.338357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:56.338921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:56.354065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] Creating event network-changed:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:06:56.362482 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-cb8ea8b7-004f-4efe-a126-195f7b9092fc req-9876d0e1-1d73-4fac-863b-07d48666a3c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066188 Aug 27 21:06:56.369833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2108/4101] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:06:56.613674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:56.614493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:56.631276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:56.632377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:56.635957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:56.636935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:56.637641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:56.639470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:56.941463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:56.959524 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6185c42-af32-4739-969e-20fdc0abe0c3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.353192 Aug 27 21:06:56.964569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1994/4102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:56 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:57.118404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:57.119111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:57.136556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:57.139492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:57.140044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:57.140812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:57.141489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:57.142948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:57.155007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:57.155668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:57.166485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:57.167025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:57.172665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:57.173571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:57.180263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:57.180865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:57.324536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:57.340926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:57.342407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:57.347706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b09eaf6-f2aa-4cd2-89e6-a8be3486cee7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1593 microversion: 2.42 time: 0.231932 Aug 27 21:06:57.348969 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2109/4103] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:57 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1593 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:06:57.794124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:57.811269 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae2d8240-7b2f-44b2-8a56-9fb41f3d8f25 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1686 microversion: 2.1 time: 0.656059 Aug 27 21:06:57.826927 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1995/4104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:57 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1686 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:57.987120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:57.988009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:58.000986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.001527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.001966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:58.002674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.006368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.006887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:58.374510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:58.375732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:58.388752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.389575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.390230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:58.391212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.391964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.392602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:58.448463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:58.460590 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8e5b12b-5c78-4dbb-b806-e480b4b555c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.478189 Aug 27 21:06:58.463876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2110/4105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:57 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:58.525493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:58.541566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:58.545524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:58.547572 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4862194f-f196-4742-9045-075c45581a7d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1593 microversion: 2.42 time: 0.177157 Aug 27 21:06:58.562029 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1996/4106] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:58 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1593 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:06:58.834926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:58.835953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:58.855405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.855960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.859024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:58.861959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:58.862457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:58.862906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:59.444399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:59.455273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f862a93a-e0b7-4e77-929f-4c2539dd8ae2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1686 microversion: 2.1 time: 0.624514 Aug 27 21:06:59.488744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:59.491294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:59.498008 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2111/4107] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:58 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1686 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:06:59.513969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:59.514603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:59.518271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:59.519330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:59.519906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:59.520592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:59.577456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:06:59.578401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:06:59.591794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:59.592675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:59.593671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:59.601821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:06:59.604029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:06:59.606371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:06:59.798328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:59.808957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:59.810445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:59.811664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ed742cc-5d8d-4540-993e-8536bb87cb23 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1593 microversion: 2.42 time: 0.238981 Aug 27 21:06:59.820745 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2112/4108] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:06:59 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1593 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:06:59.826489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0b3da73-6e5f-4602-b07c-af43e66149f1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Action: 'create', calling method: .version_select at 0x7ff84df2fc10>, body: {"keypair": {"name": "tempest-keypair-38747942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNNwPH0ZrnK6dsdyKMm3zd5HGccbdN+9E529Wpv8LneogenSX9aDblKgO0HPRv5Fl6mgX3VaL8Aa8cxYLBdSU2yE98DCbMEaaj4/k8oShpRwxkuq2SFdG7okOm3JSza+w=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:06:59.866059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d0b3da73-6e5f-4602-b07c-af43e66149f1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Getting quotas for project 366653ab581f4c23aa632fe3253100cf. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:06:59.869429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:06:59.882388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d0b3da73-6e5f-4602-b07c-af43e66149f1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Getting quotas for user c82ae6511f2443888af3d79a6a40d7d6 and project 366653ab581f4c23aa632fe3253100cf. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:06:59.883009 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd7fdef8-3a7a-44cd-a4d5-e5fa8fb2ad16 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.397560 Aug 27 21:06:59.886149 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1997/4109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:06:59 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:06:59.933085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0b3da73-6e5f-4602-b07c-af43e66149f1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.110177 Aug 27 21:06:59.933864 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2113/4110] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 21:06:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 21:07:00.523468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:00.524240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:00.540606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.542507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.543888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:00.545687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.547961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.549503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:00.822298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:00.840656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7aeb9d32-6a63-4842-82c0-5bc6272c918c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1686 microversion: 2.1 time: 0.323311 Aug 27 21:07:00.841310 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1998/4111] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:00 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1686 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:00.859948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:00.860570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:00.870022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.870460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.870903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:00.871767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.872252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.872790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:00.906438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:00.907333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:00.913889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.914797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.915428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:00.916290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:00.916924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:00.917606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:01.054588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:01.073687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:01.075843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:01.078200 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72c03862-7105-4c49-b5e4-407ea438c487 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1661 microversion: 2.42 time: 0.223670 Aug 27 21:07:01.080727 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2114/4112] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:00 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1661 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:01.248826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:01.259629 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a65613c-d54c-4c85-ba5c-5dae62048bb8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.357193 Aug 27 21:07:01.261118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 1999/4113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:00 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:01.865967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:01.868570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:01.897305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:01.898944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:01.899751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:01.900778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:01.904886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:01.906392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:01.919273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:02.109000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:02.110241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:02.118698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:02.120367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:02.131161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:02.132112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:02.132789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:02.138019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:02.141211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:02.141800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:02.274458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:02.283964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71b9d6f0-a1d1-450b-b3c5-6eccf3384ff0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1686 microversion: 2.1 time: 0.423693 Aug 27 21:07:02.303776 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2115/4114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:01 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1686 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:02.331906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:02.342947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:02.360128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:02.367168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:02.368140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:02.370220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:02.371540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:02.375478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:02.577723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:02.592730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:02.595923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:02.598609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d85e9816-f916-44c0-b920-deed4baa3521 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1661 microversion: 2.42 time: 0.493545 Aug 27 21:07:02.615822 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2000/4115] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:02 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1661 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:07:02.761881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:02.777927 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1518aded-1e2a-4966-ace4-35e8b4d84b42 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.470863 Aug 27 21:07:02.779801 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2116/4116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:02 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:03.313512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:03.316389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:03.337154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.337758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.338277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:03.339088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.339697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.340699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:03.626271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:03.627678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:03.640319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.646860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.647874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:03.648799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.652114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.657034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:03.657196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:03.685551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15919620-76fe-4876-9fe3-743ccb393ca2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.379405 Aug 27 21:07:03.703612 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2001/4117] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:03 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:03.800637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:03.801268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:03.815372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.816056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.816377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:03.817430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:03.817690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:03.818329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:04.048929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:04.071107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:04.072911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:04.074479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6186ee5f-6f00-4e19-999b-6ce46bf71566 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1649 microversion: 2.42 time: 0.452904 Aug 27 21:07:04.075676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2117/4118] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:03 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1649 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:04.092954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-plugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:04.120976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:04.121821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:04.122404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:04.146530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] Creating event network-vif-plugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:07:04.163862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1a42e2b7-87d7-4f30-ae24-7858605e21f7 req-520ae03b-050a-42fb-980b-1b8c8b4fef70 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083729 Aug 27 21:07:04.167965 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2118/4119] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:04.191364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:04.199057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:04.206177 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-af294898-539e-4e1b-a93a-644a1a5f5166 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.409839 Aug 27 21:07:04.213216 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2002/4120] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:03 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:04.746610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:04.748866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:04.790136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:04.790951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:04.796164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:04.797140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:04.801118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:04.801918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:05.082295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:05.093985 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6cf60304-641e-4c98-9669-699ea2e9a30c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.387199 Aug 27 21:07:05.094816 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2119/4121] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:04 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:05.114452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:05.115611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:05.137165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:05.145499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:05.154073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:05.156454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:05.157073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:05.159872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:05.243723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:05.244555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:05.257071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:05.257957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:05.258706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:05.260352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:05.261212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:05.261902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:05.547016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:05.556127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8706a07-632a-47fe-9d3e-5133fe26f3ed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.319377 Aug 27 21:07:05.562562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2120/4122] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:05 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:05.565280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:05.603465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:05.605318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:05.606709 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3aee71d-78a6-40cd-932b-1a4f01ba7328 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1696 microversion: 2.42 time: 0.511980 Aug 27 21:07:05.609619 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2003/4123] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:05 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1696 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:07:06.125305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:06.126227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:06.158665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.162024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.162742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.163744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.166110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.168226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.327457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7293-d682-4778-b885-31467d65e8fa", "name": "network-vif-plugged", "status": "completed", "tag": "c76783dd-7fc4-44ce-852f-8b2893e4579e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:06.359686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:06.380716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.381241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.381634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.450029 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] Creating event network-vif-plugged:c76783dd-7fc4-44ce-852f-8b2893e4579e for instance 08af7293-d682-4778-b885-31467d65e8fa on nch2-master-1 Aug 27 21:07:06.483530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-770607fc-9973-46bf-ab44-c0c61fa859fd req-9b9ec8c8-31e7-4a87-8d30-b6361c9d5259 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164839 Aug 27 21:07:06.486111 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2004/4124] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:07:06.586496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:06.588534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:06.606749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.611574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.613387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.619602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.621612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.636035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.849497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:06.881461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d8c0ce5c-d0bc-4631-9a37-2fb73e788591 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.769452 Aug 27 21:07:06.897068 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2121/4125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:06 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:06.905922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:06.906829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:06.914079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.915455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.916100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:06.916979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:06.917629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:06.918250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:07.460549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:07.476113 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-520a0be0-2572-4532-bf4c-c15b50c5d1d7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.894717 Aug 27 21:07:07.478272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2005/4126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:06 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:07.539512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:07.562639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:07.566178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:07.568202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f57d006-907f-4fde-9f4b-7a215b942aa8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1696 microversion: 2.42 time: 0.669397 Aug 27 21:07:07.569591 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2122/4127] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:06 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1696 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:07.905750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:07.906869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:07.917923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:07.921118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:07.925819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:07.928376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:07.931881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:07.933931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:08.219070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:08.234182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-890f90a2-67ba-4efa-9e5e-990a843f449b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.333494 Aug 27 21:07:08.236417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2006/4128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:07 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:08.501868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:08.502593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:08.520103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:08.520612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:08.524277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:08.527752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:08.530290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:08.532354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:08.606434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:08.608219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:08.624203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:08.625206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:08.627816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:08.628763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:08.629380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:08.631198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:09.130487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:09.163212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d1cdea3-922d-43e0-8115-576bc1ceb7c9 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1315 microversion: 2.1 time: 0.666468 Aug 27 21:07:09.174000 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2123/4129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:08 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:09.260388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:09.261198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:09.274598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:09.275426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:09.276071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:09.277296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:09.279911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:09.282506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:09.290498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:09.306270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:09.311365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:09.318021 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7f8298c-0d0f-4ead-9f15-a239716f232e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1743 microversion: 2.42 time: 0.726243 Aug 27 21:07:09.334490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2007/4130] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:08 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1743 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:09.584177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:09.598834 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fab0027e-01d8-4854-bd06-fb6d0a46cadc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.338173 Aug 27 21:07:09.599822 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2124/4131] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:09 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:10.153562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1488476310", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9e1cbc69-bcb3-4f4c-a3d5-44efa6efd8f5"}, {"port": "2a4186d6-29e8-478d-abea-bf22cee0b380", "tag": "port-1"}, {"port": "67f19a86-603d-4bab-a4a6-423eff11c128", "tag": "port-2"}, {"uuid": "39720ff8-f596-4c22-ad43-8d40599e5a7e", "tag": "net-1"}, {"uuid": "39720ff8-f596-4c22-ad43-8d40599e5a7e"}, {"uuid": "6b5911e3-5df5-40ca-ab4b-ab50165344b6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6b5911e3-5df5-40ca-ab4b-ab50165344b6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ff8fefeb-4f39-4b64-911f-d2ce862755c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "31351cef-5982-4d71-9c5e-aa314e882454", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a8c2b98b-2f95-421a-96ce-82bbd3cabd81", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1101018844"}], "key_name": "tempest-keypair-38747942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:10.190652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:10.192223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:10.195228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:10.241497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:10.242777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:10.255313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:10.259869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:10.261023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:10.262617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:10.531098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:10.541530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93cc4be3-ebe3-414b-8b66-986d359a2d6b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1502 microversion: 2.1 time: 0.355269 Aug 27 21:07:10.544024 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2125/4132] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:10 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:10.548833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] validate_networks() for [('9e1cbc69-bcb3-4f4c-a3d5-44efa6efd8f5', None, None, None, None, None), (None, None, '2a4186d6-29e8-478d-abea-bf22cee0b380', None, None, None), (None, None, '67f19a86-603d-4bab-a4a6-423eff11c128', None, None, None), ('39720ff8-f596-4c22-ad43-8d40599e5a7e', None, None, None, None, None), ('39720ff8-f596-4c22-ad43-8d40599e5a7e', None, None, None, None, None), ('6b5911e3-5df5-40ca-ab4b-ab50165344b6', '10.2.2.100', None, None, None, None), ('6b5911e3-5df5-40ca-ab4b-ab50165344b6', '10.2.2.200', None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:07:10.571545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:10.573168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:10.581056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:10.582103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:10.582779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:10.583928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:10.584590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:10.585211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:11.928436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:11.946784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:11.951985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:11.955408 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05ff3d9c-cc24-4cee-a21b-21f7c2fb1e66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1743 microversion: 2.42 time: 1.405541 Aug 27 21:07:11.958867 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2126/4133] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:10 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1743 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:11.969696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:11.992676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:11.993510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:11.994183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:12.061178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:07:12.178299 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5875761-713e-4dd4-a01c-531d35d0e03b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa/action" status: 202 len: 0 microversion: 2.1 time: 0.214792 Aug 27 21:07:12.182105 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2127/4134] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:07:11 2022] POST /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:07:12.202039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:12.205840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:12.229168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:12.229953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:12.232074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:12.235645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:12.236352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:12.237766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:12.632559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:12.648832 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38484c3a-c133-442e-9053-77f7b3faea40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.463377 Aug 27 21:07:12.652543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2128/4135] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:12 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:12.669796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:12.673551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:12.696021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:12.698068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:12.698703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:12.700396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:12.704241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:12.704894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:13.192864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:13.223674 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cce249de-7205-41ed-8aae-28725675cdc3 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.566828 Aug 27 21:07:13.225483 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2129/4136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:12 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:13.238164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:13.241377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:13.257811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:13.261152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:13.271941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:13.274217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:13.276441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:13.277083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:13.618345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:13.632993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:13.636803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:13.640137 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-48f390a1-b37a-4030-933e-910dc3cda90f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1837 microversion: 2.42 time: 0.411134 Aug 27 21:07:13.642715 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2130/4137] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:13 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1837 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:13.651815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84c53b1c-efce-47d4-8367-0e2f550121a6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: .version_select at 0x7ff84e65e310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1755604470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUgTiI33ctXV9xH+2KgCQJHUpM1+Rk/xG5T9yGZqM5DxCdCvQTmqGi/BhSAmUfZ7LzpKhQsRpqEI6+Tswh6HYIYf2ArnjxSMBlINaPeoi2eof+VcQC/k9ksRm+obRDFpQ=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:13.710164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-84c53b1c-efce-47d4-8367-0e2f550121a6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:07:13.716536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-84c53b1c-efce-47d4-8367-0e2f550121a6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:07:13.762440 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84c53b1c-efce-47d4-8367-0e2f550121a6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.118425 Aug 27 21:07:13.763159 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2131/4138] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:07:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:13.772539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:13.774676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:13.788428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:13.789155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:13.789767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:13.790644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:13.791279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:13.791871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:13.832732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:14.487216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:14.504645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a71179f6-7eb5-45d9-8ffb-b7d33f8a22a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.740165 Aug 27 21:07:14.505548 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2132/4139] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:13 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:14.512419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:14.513557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:14.531476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:14.538318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:14.539103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:14.540098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:14.540794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:14.541468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:15.210835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:15.224619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e11194e-e4c5-4df6-8c3c-486db4137d3e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.717694 Aug 27 21:07:15.252282 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2133/4140] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:14 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:15.256857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:15.257494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:15.267823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:15.268336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:15.268777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:15.269494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:15.270392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:15.270842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:15.824808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:15.834823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:15.844957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:15.856359 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93568ae5-c90f-409f-8a4c-f00ded5cf4f1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1837 microversion: 2.42 time: 0.601032 Aug 27 21:07:15.857551 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2134/4141] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:15 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1837 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:15.863059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:15.863800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:15.906956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:15.912997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:15.913525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:15.916121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:15.916518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:15.916961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:16.411722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:16.421056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ed7c141-3ef7-4ec7-b7ff-c56c03c5e3bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.562274 Aug 27 21:07:16.434571 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2135/4142] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:15 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:16.466525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:16.467464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:16.495608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:16.498885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:16.499615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:16.502877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:16.503591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:16.506044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.029021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:17.042954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41fd482e-9eb9-4f2a-8fb5-9860da0c6ae8 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.600972 Aug 27 21:07:17.043994 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2136/4143] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:16 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:17.054449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "b5414c2c-a41b-4574-bbaa-f52411d09c65"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:17.091051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.095311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.095991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.111279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] Creating event network-changed:b5414c2c-a41b-4574-bbaa-f52411d09c65 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:17.121881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3358e367-f6a3-4548-b063-8eb4370010ea req-4b9b0b71-a1d4-4c81-b669-9ae6aa97d393 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073204 Aug 27 21:07:17.123744 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2137/4144] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:17.146783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:17.148004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:17.191713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.193433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.199239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.200372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.201940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.203206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.775936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:17.798349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:17.802873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:17.807969 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08345788-04f7-46c3-b79c-0f8900a21471 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1837 microversion: 2.42 time: 0.679270 Aug 27 21:07:17.809795 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2138/4145] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:17 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1837 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:17.822745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:17.826427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:17.846369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.847180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.849961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.850860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.852295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.855957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:17.951188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:07:17.951779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:07:17.952721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:07:17.956400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:07:17.957952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:07:17.993441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:17.998387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:17.999311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:18.005569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:18.015927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:18.016300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:18.059000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Getting quotas for project 366653ab581f4c23aa632fe3253100cf. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:07:18.081489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Getting quotas for user c82ae6511f2443888af3d79a6a40d7d6 and project 366653ab581f4c23aa632fe3253100cf. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:07:18.360788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:18.374776 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e2a9a7d-b16c-469b-a136-353a2d00d77b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.563586 Aug 27 21:07:18.400485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2139/4146] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:17 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:18.413277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:18.419284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:07:18.422355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ff8fefeb-4f39-4b64-911f-d2ce862755c0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='31351cef-5982-4d71-9c5e-aa314e882454',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8c2b98b-2f95-421a-96ce-82bbd3cabd81',volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:07:18.424221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:18.436453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:18.437168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:18.437614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:18.438330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:18.438930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:18.439433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:18.984372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:18.998906 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4171da85-0c6c-417b-8712-1f1383bc6996 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.596688 Aug 27 21:07:19.000121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2140/4147] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:18 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:19.006794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:19.007602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:19.014829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:19.015601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:19.016338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:19.017117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:19.017726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:19.035138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:19.112320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.967159 Aug 27 21:07:19.114439 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2008/4148] 10.222.0.40 () {62 vars in 1189 bytes} [Sat Aug 27 21:07:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 8971 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:07:19.132512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:19.138520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:19.351169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:19.360139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:19.365565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:19.367215 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f41f90d1-97e4-4c21-abc5-b0a56b202bc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1284 microversion: 2.32 time: 0.245397 Aug 27 21:07:19.372246 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2009/4149] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:19 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:19.381808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1657688687", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "8081808e-0d9e-45a8-b235-8548d57ae311"}], "key_name": "tempest-TestNetworkBasicOps-1755604470", "security_groups": [{"name": "tempest-secgroup-smoke-1013316448"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:20.469942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:20.487269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] validate_networks() for [('8081808e-0d9e-45a8-b235-8548d57ae311', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:07:20.490918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:20.494066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:20.498912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-710dbe08-5884-4314-869f-caa03e5e65dc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1858 microversion: 2.42 time: 1.496962 Aug 27 21:07:20.499689 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2141/4150] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:19 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1858 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:20.533295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:20.535482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:20.550299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:20.552282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:20.553238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:20.556237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:20.557447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:20.558033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:21.312274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:21.326954 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb4c4137-e221-4d02-8515-4ae4d9093de8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.804662 Aug 27 21:07:21.328629 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2142/4151] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:20 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:21.339441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "7dc90f8a-6c03-4fad-b767-d78d9192a901"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:21.380832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:21.382538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:21.383928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:21.409567 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] Creating event network-changed:7dc90f8a-6c03-4fad-b767-d78d9192a901 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:21.424396 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-49d23a5f-1d2d-4d1d-9264-57e6ed9827d2 req-a31a8225-5c7a-4255-91da-be4eb7d6d6a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094449 Aug 27 21:07:21.426686 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2143/4152] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:21.439370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:21.443704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:21.481556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:21.486854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:21.487600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:21.489374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:21.490441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:21.493735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.135372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:22.157883 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c3d5a50-3ae9-44e4-8a87-1cf700a0b005 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.729527 Aug 27 21:07:22.160018 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2144/4153] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:21 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:22.169979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:22.175134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:22.187162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.191649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.193556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.194335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.194819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.195260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.369950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:22.387467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:07:22.388524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:07:22.389341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:07:22.390045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:07:22.390627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:07:22.391248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:22.396401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:22.401145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb79e1b2-cb18-4a04-bbe2-2a7fdd97ed79 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1582 microversion: 2.32 time: 0.239107 Aug 27 21:07:22.402182 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2145/4154] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:22 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1582 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:22.411875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.412362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.412961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.413704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:22.414481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:22.415270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.415776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.416206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.427868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:22.432793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.433533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.434121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.435367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.437516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.437961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.476637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:07:22.491199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:07:22.544662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:07:22.556214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:07:22.686460 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ffad03c-e40b-482e-9e2f-b77b15a66882 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.312641 Aug 27 21:07:22.694497 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2010/4155] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:07:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 3321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:07:22.713598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:22.716887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:22.753624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.756695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.759298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:22.764602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:22.766595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:22.770196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:23.335936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:23.355054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:23.357297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:23.370799 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1932dc92-881d-45f1-87f0-5553c003711f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.963840 Aug 27 21:07:23.371852 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2146/4156] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:22 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:23.382303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-426a28d5-8674-408f-9812-1e10b6cecdf0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:23.382956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-426a28d5-8674-408f-9812-1e10b6cecdf0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:23.542542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-426a28d5-8674-408f-9812-1e10b6cecdf0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:23.549951 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-426a28d5-8674-408f-9812-1e10b6cecdf0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1249 microversion: 2.1 time: 0.176830 Aug 27 21:07:23.560166 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2147/4157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:23 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1249 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:23.565744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:23.566625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:23.583827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:23.588104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:23.589079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:23.592746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:23.593472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:23.594100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:23.671416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:23.713059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c293f02e-516f-46ab-8c62-e29b9ee3f113 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 1.016686 Aug 27 21:07:23.725106 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2011/4158] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:22 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:23.737469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:23.738886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:23.750977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:23.751991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:23.752675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:23.753640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:23.754873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:23.757108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:24.007707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:24.030164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:24.035157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:24.038386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-38cb256c-53fa-497f-91cf-0bf3b49d27ff tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1592 microversion: 2.32 time: 0.306246 Aug 27 21:07:24.040013 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2012/4159] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:23 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1592 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:24.050461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "3e9fb118-6067-45ee-8c69-915038ed9866"}, {"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "601119b8-282e-401e-9557-ba5c8dda2531"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:24.109087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:24.118970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:24.126871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:24.154289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:24.167697 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c4d75c0-d04c-46b0-a748-20cbcb27f389 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.605601 Aug 27 21:07:24.168340 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2148/4160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:23 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:24.224699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Creating event network-changed:3e9fb118-6067-45ee-8c69-915038ed9866 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:24.226167 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] Creating event network-changed:601119b8-282e-401e-9557-ba5c8dda2531 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:24.266865 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-06cbb11e-bd13-46ed-b6bd-0f8b81424655 req-4367230d-204f-477f-ba40-708867f5f05e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.215264 Aug 27 21:07:24.272946 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2013/4161] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:24.400674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:24.401608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:24.440404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:24.445263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:24.447594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:24.452151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:24.453482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:24.456217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:24.585770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:24.587563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:24.615893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:24.617124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:24.620184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:24.623368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:24.624975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:24.626862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.066061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.082043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3729e7a8-8e24-4b38-b26b-a2558fd28283 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1301 microversion: 2.1 time: 0.499271 Aug 27 21:07:25.085600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2014/4162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:24 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1301 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:25.097501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:25.099366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:25.118764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.120323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.121479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.123493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.125388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.126690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.401038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.421286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.423118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.428536 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab4904d0-5c6d-43b3-80d8-84601bf9a061 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 1.033255 Aug 27 21:07:25.450529 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2149/4163] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:24 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:25.469280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:25.471628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:25.496562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.498952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.499550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.503267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.506442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.510472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.617969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.631367 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a134f14-e65b-4228-8683-807423b4aa5e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.544233 Aug 27 21:07:25.632263 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2015/4164] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:25 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:25.655210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:25.656121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:25.665648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.666619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.667476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.668555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:25.669582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:25.670235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:25.787069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.815333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.823096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:25.824530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbab08cd-2924-4d1b-9f8b-fcb421263896 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1592 microversion: 2.32 time: 0.372483 Aug 27 21:07:25.827472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2150/4165] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:25 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1592 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:26.109641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:26.110390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:26.121457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.128178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.132253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:26.136174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.139434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.140131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:26.185713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:26.477700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:26.520053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ccc060ba-fa24-4865-93ac-1ba071a1cc04 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1307 microversion: 2.1 time: 0.413085 Aug 27 21:07:26.541955 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2151/4166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:26 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1307 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:26.571774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:26.572397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:26.579616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.579945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.580388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:26.581105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.581600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.589613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:26.657985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:26.667670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e39637c5-3faa-4605-921e-0984e40c9312 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 1.017401 Aug 27 21:07:26.668274 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2016/4167] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:25 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:26.683688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:26.684253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:26.708082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.708565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.709013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:26.709743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:26.710209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:26.710641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.392138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.400824 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca9b2257-aafe-478c-a61b-8dea58d755c4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.731547 Aug 27 21:07:27.419376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.421712 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2017/4168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:26 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:27.426127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.428758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:27.429597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:27.436840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.437653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.438295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.439309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.439646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.440314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.440933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.443757 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-26e7f336-d8ae-423c-b03f-1e9598a243e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.900128 Aug 27 21:07:27.448230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2152/4169] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:26 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:27.463031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "ec94104a-dc15-401c-896b-ab4bc36c4c52"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:27.491709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.492998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.493668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.525382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] Creating event network-changed:ec94104a-dc15-401c-896b-ab4bc36c4c52 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:27.534327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6a518eb2-1475-427e-aaac-c973a02ec5d6 req-b3ba00c7-0bf9-4818-b26e-991955829775 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082270 Aug 27 21:07:27.537417 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2153/4170] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:27.563886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.583541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.598596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.602137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:27.603156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:27.604399 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fbb14ec6-d14c-417c-af11-2bf36f3eaaa8 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1592 microversion: 2.32 time: 0.179188 Aug 27 21:07:27.606936 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2018/4171] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:27 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1592 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:27.640405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.647151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.647765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.648632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.651075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.651621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.692321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:27.693944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:27.706949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.709776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.710530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.713770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:27.715246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:27.717450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:27.804619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:27.817499 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-117ca1d4-1eb1-4df7-afad-010bac486fa6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1307 microversion: 2.1 time: 0.219522 Aug 27 21:07:27.822744 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2154/4172] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:27 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:28.061003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:28.087657 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d1980e9-2b5c-48eb-9fcc-e9a3cf29870d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.402132 Aug 27 21:07:28.089455 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2019/4173] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:27 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:28.429551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:28.430466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:28.443714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:28.444455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:28.445032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:28.445899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:28.446512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:28.447075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:28.478263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:28.479144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:28.495441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:28.496130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:28.498057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:28.499051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:28.500039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:28.501295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.107436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.123310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.125217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.131006 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed49e14e-156b-485f-bfd7-a2a1ba27c8d1 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.656565 Aug 27 21:07:29.132294 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2020/4174] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:28 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:29.140296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.157132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-080cf803-5145-4e2c-8911-90f2c4835100 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1681 microversion: 2.1 time: 0.731989 Aug 27 21:07:29.158045 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2155/4175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:28 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1681 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:29.163971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:29.165081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:29.177244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:29.178629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:29.184345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.184345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.184891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.185480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.185940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.191140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.192246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.193007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.195442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.208549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.209297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.209889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.376686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.385252 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d1646b2-28bc-4fac-a067-d32dabc28cfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1307 microversion: 2.1 time: 0.225949 Aug 27 21:07:29.386474 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2156/4176] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:29 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:29.391383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:29.392212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:29.399792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.400477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.401108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.402011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.402656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.403269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.793815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.798278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.814531 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b290eeb-c390-4961-b7a0-42ce11790bd7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.426772 Aug 27 21:07:29.816311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.820203 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2157/4177] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:29 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:29.826462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "e990918c-a7ca-438e-b9e8-4610424b6cc4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:29.840472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:29.843658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c470ef1-e3b5-4c21-8646-adc6eba6ff8e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1660 microversion: 2.32 time: 0.709833 Aug 27 21:07:29.847940 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2021/4178] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:29 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1660 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:29.892371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:29.895129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:29.895838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:29.913984 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] Creating event network-changed:e990918c-a7ca-438e-b9e8-4610424b6cc4 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:29.920099 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4c3ef55e-ba40-47bb-b4b2-7474915b2d10 req-9703c571-a675-4e14-8e90-4376e6678175 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098425 Aug 27 21:07:29.922350 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2158/4179] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:30.163678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:30.165363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:30.181010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:30.181525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:30.182453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:30.185981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:30.186504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:30.186833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:30.188612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:30.189329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:30.208596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:30.211444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:30.212798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:30.214061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:30.215931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:30.216968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:30.928860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:30.943970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:30.955825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:30.956979 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e859f21-63e4-4197-84ab-083821283bc3 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.804129 Aug 27 21:07:30.960111 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2022/4180] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:30 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:30.970537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:30.976185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:30.992894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:30.993681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:30.994282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:30.999059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.000007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.000602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.030362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:31.047156 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c2291db-8fe5-4a2f-8189-bb6822680690 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.867762 Aug 27 21:07:31.061660 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2159/4181] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:30 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:31.066565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:31.067311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:31.097184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.097452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.097953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.101193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.102426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:31.103784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.104464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.677374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:31.694424 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-331a9cce-d10b-40e2-842b-47ccd62eb505 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.638329 Aug 27 21:07:31.698044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2160/4182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:31 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:31.701532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:31.712467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:31.712721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f881b20a-8668-450e-9d8b-8f25faeff78c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.750534 Aug 27 21:07:31.713899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2023/4183] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:30 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:31.719485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:31.720664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:31.724243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:31.727903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.728612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.729227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.730130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.731095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.731586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.742211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.742826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.744603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:31.747312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:31.753603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:31.754405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.126563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.138984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.153383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.155129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e522c9ba-9bc2-4d76-ba09-f418753d27c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1648 microversion: 2.32 time: 0.455192 Aug 27 21:07:32.167749 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2161/4184] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:31 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1648 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:32.178305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "6fdea988-e8fe-4f45-b392-b55477b33feb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:32.189061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.190450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.191158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.191845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.201941 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e18642e-5eaa-4bf4-8efc-cbf3683b4acd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.485178 Aug 27 21:07:32.205311 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] Creating event network-changed:6fdea988-e8fe-4f45-b392-b55477b33feb for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:07:32.217390 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2024/4185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:31 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:32.218987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-94f5ba40-5d10-442b-a9b9-52cbcd2fae00 req-f5d35721-784d-4ff1-9416-47ecd108a79e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049641 Aug 27 21:07:32.226246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:32.227763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:32.228269 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2162/4186] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:32.235266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.236342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.236962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.240576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.241324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.241938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.453329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:32.524607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=14 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:32.689823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.702192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.718540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:32.720089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:32.720568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d2e2480-f887-441d-8b76-11d71a211a9a tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.501281 Aug 27 21:07:32.720798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:32.739103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2025/4187] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:32 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:32.746452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:32.748074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:32.752774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.754290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.754900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.755851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.756519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.759507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.760315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.761443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.762533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:32.763854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:32.764656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:32.765355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:33.489810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:33.501097 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b194d53-52d6-4d08-8ec1-bf8fca71e119 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.757730 Aug 27 21:07:33.515828 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2026/4188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:32 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:33.521697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-unplugged", "status": "completed", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:33.536220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:33.536957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:33.537590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:33.549861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:33.556134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] Creating event network-vif-unplugged:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:07:33.562842 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c093fbef-f043-480f-9b2d-2c69b9be6363 req-0272555f-79d3-4e24-ac5f-f0404debd1c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045085 Aug 27 21:07:33.563682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2027/4189] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:33.570804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:33.571750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:33.582817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:33.584230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:33.586115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:33.588343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:33.589572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:33.590765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:33.601858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:33.620291 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19117138-02b2-475d-8d2a-ba2909137d65 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.906720 Aug 27 21:07:33.623225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2163/4190] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:32 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:33.753061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:33.753687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:33.765450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:33.767846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:33.770231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:33.771331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:33.772053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:33.773008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.077540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.104671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.107065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.110041 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29103461-5c19-4006-b2d5-b5a296039f65 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.362717 Aug 27 21:07:34.111423 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2164/4191] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:33 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:34.119491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:34.120388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:34.127824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.128548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.129391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.130271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.130923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.131547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.199439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.217862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.220453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.221970 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-18d56327-8e9d-4f77-b67e-8771613072c2 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1695 microversion: 2.32 time: 0.656976 Aug 27 21:07:34.223563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2028/4192] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:33 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1695 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:34.282257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d060e67-e252-4b42-b7b9-619e689beff1", "tag": "a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:34.299073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.299850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.300544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.329084 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] Creating event network-changed:a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b for instance 9d060e67-e252-4b42-b7b9-619e689beff1 on nch2-master-1 Aug 27 21:07:34.337327 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a06978c9-e142-401f-968f-08f9c35c77bc req-5c6f8de2-72be-4365-abb6-fce5fa389249 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061139 Aug 27 21:07:34.338729 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2029/4193] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:07:34.428631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.438199 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3937fad7-fc9c-4587-8714-848af1a55bf2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.324180 Aug 27 21:07:34.439243 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2165/4194] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:34.460916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:34.461932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:34.469018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.469811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.470398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.471288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.471923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.472541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.536376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:34.537217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:34.544638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.546455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.547132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.548110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.548780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.549400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.808880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.820063 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9a379e7-df31-4683-a003-c189829cb095 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.364102 Aug 27 21:07:34.820647 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2030/4195] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:34.826655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:34.827517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:34.834936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.835587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.836020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.836732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.837189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.837914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.850016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:34.861405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad76990f-3a2a-4a72-8051-eee4c811e5cc tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.342579 Aug 27 21:07:34.883420 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2166/4196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:34 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:34.895859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:34.897934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:34.918171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.918861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.919642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:34.921435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:34.922023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:34.922776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.189311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.203662 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f70ffdf9-3a25-4675-8a29-7e7a62cc4545 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.381519 Aug 27 21:07:35.219875 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2031/4197] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:34 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:35.227462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:35.228460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:35.238735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.247881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-532a27b6-0ec5-49f7-bb3b-e8f1ba2c6916 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.363201 Aug 27 21:07:35.249254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.250111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.250772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.251725 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2167/4198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:35.252710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.254992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.256445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.274924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:35.279580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:35.321116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.323992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.329699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.332847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.339446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.340203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.842569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.852208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.853652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.865768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d3d2b37-7e3e-4e8f-98aa-7e7e50767080 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1742 microversion: 2.32 time: 0.611591 Aug 27 21:07:35.866539 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2168/4199] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:35 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1742 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:35.868041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.874562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:35.879289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:35.881867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.883719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:35.885182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fa67241-bec0-4c62-a0ba-e158b25be8ba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.663991 Aug 27 21:07:35.886613 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2032/4200] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:35 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:35.891407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:35.892289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:35.894286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.895066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.899727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.900568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.901219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.901858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.902391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.902620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:35.903103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.903522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:35.903628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:35.904310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.010856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:36.052685 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-53b712bf-af69-483c-b7e0-83d2e9a9738f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.184227 Aug 27 21:07:36.055545 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2169/4201] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:07:35 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:07:36.063863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:36.064657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:36.072281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.072887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.073408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.074236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.074705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.075191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.339587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:36.366765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-825dcf3e-b52d-4efc-96f3-f1d8de918cda tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.478765 Aug 27 21:07:36.381215 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2033/4202] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:35 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:36.381215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:36.381215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:36.394192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.394948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.395666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.396520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.397227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.398019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.405725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:36.414405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa198ed6-608c-4efc-ad71-eff06bcae31b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1670 microversion: 2.1 time: 0.354981 Aug 27 21:07:36.415015 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2170/4203] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1670 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:36.893322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:36.894966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:36.908972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.910592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.911255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:36.912654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:36.916265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:36.916727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.150811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.168731 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce002128-3c61-4abe-aad6-12641ee4a869 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1512 microversion: 2.1 time: 0.798820 Aug 27 21:07:37.169838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2034/4204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:36 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1512 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:37.177233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:37.178432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:37.193935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:37.204044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.205000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.205688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.220928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.221440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.221885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.537376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.559397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.560847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.563811 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ea4dc972-28a2-4434-a432-048b92adfa1b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1789 microversion: 2.32 time: 0.674455 Aug 27 21:07:37.564623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2171/4205] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:36 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1789 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:07:37.577158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:37.577803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:37.587275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.592958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.593754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.594587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.595220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.595685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.841674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.852832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.858999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:37.860881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-982009e4-7233-4fe6-a227-a04fbce77b0e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.689288 Aug 27 21:07:37.871700 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2035/4206] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:37 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:37.884286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:37.893464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:37.916272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.919109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.920880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:37.922739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:37.924284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:37.924747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.125425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.145202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e0fda93-5cda-40cd-acb9-2a8ef17ba82d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.578059 Aug 27 21:07:38.155519 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2172/4207] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:37 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:38.190212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:38.190824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:38.201176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.201492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.201952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.202648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.212110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.212594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.378543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.387517 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5496cd37-ce17-4f72-bf9b-698b9c2c46c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1675 microversion: 2.1 time: 0.514148 Aug 27 21:07:38.388118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2036/4208] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1675 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:38.588327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:38.588943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:38.600222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.601215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.601835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.603330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.604314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.605194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.625247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.637916 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-828f8998-ada3-4a8a-a339-4e6e1a3aa661 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1489 microversion: 2.1 time: 0.451561 Aug 27 21:07:38.651663 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2173/4209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:38 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1489 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:38.666488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:38.669151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:38.677813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.678543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.679577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.680476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.681085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.681661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.722097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:07:38.844545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.858517 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e47df5d5-e72a-4872-8fb6-71c547455eed tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 204 len: 0 microversion: 2.1 time: 0.198871 Aug 27 21:07:38.860022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2174/4210] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:07:38 2022] DELETE /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:07:38.867608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.871138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:38.872553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:38.874660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:38.876194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75c8fc4b-b43e-4ba1-b8c0-82a7c859c4d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1836 microversion: 2.32 time: 0.292318 Aug 27 21:07:38.881178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.883144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.884094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.884959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.886253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.887292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.893174 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2037/4211] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:38 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1836 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:38.905524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:38.906443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:38.914968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.918126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.918773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:38.921904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:38.923997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:38.926157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:39.280646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:39.297250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-217b5e6c-a46a-49e1-a485-7b04121b7489 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1495 microversion: 2.1 time: 0.432320 Aug 27 21:07:39.298608 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2175/4212] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:38 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1495 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:39.305615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:39.306957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:39.317606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:39.318341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:39.319595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:39.320577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:39.321242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:39.321887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:39.357768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:39.373932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:39.385236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:39.387332 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d191ff79-16f1-476b-8873-2f9caac30b88 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.493065 Aug 27 21:07:39.388183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2038/4213] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:38 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:39.411265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:39.411926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:39.431600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:39.432341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:39.432971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:39.434319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:39.440555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:39.441371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.056957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.065814 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc821ca0-0cb4-4810-a27e-21e5750abbcd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.765964 Aug 27 21:07:40.066768 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2176/4214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:39 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:40.077987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "8920ecf1-3b0c-468b-b59b-00b35de15f40"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:40.087297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.092954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.093448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.093868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.105978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-129d585a-bd26-414f-93cf-3f8d4bdf90f4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.699222 Aug 27 21:07:40.107756 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2039/4215] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:39 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:40.110184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] Creating event network-changed:8920ecf1-3b0c-468b-b59b-00b35de15f40 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:40.114352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:40.115064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:40.119898 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fdbd9884-1bf9-474c-b56c-c3de59ba9fe1 req-7fd03d10-e10a-42cd-8a9e-3f9c09042a02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 Aug 27 21:07:40.122641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.123201 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2177/4216] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:40.124375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.125023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.125995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.126887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.128127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.136112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:40.138808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:40.147088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.147628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.148061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.148760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.149213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.149770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.231331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b0fa8d3-938a-4620-a881-d12cf83cade3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 200 len: 324 microversion: 2.1 time: 0.106637 Aug 27 21:07:40.232286 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2178/4217] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:07:40 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 324 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:40.242755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:40.244150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:40.251243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.251758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.252377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.253233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.254077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.254647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.575413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.587988 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c938eb5e-fdf2-4aaa-87e8-c43abc1ee508 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.349313 Aug 27 21:07:40.589021 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2179/4218] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:40 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:40.593550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.601294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:40.602146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:40.613158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.614988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.617158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:40.619613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.620338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.621188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce29bedd-82f3-454d-93b1-c2afdc78e815 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1836 microversion: 2.32 time: 0.512091 Aug 27 21:07:40.622804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.624690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.625313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.625951 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2040/4219] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:40 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1836 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:40.652939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:40.656026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:40.667881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.677929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.678766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.679898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:40.681222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:40.681872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:40.735252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:41.064811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.074405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc224c7f-ddef-42cd-a810-932da3423b11 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1495 microversion: 2.1 time: 0.483116 Aug 27 21:07:41.088196 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2180/4220] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:40 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1495 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:41.095323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:41.096203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:41.104218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.104997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.105582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.106451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.107049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.107660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.141278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.158016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.159520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.161238 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-beaad12c-dcb1-4f62-941e-4142c8e85a87 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.520135 Aug 27 21:07:41.176045 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2041/4221] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:40 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:41.183077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d060e67-e252-4b42-b7b9-619e689beff1", "name": "network-vif-plugged", "status": "completed", "tag": "a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:41.194946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.198270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.198880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.215557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] Creating event network-vif-plugged:a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b for instance 9d060e67-e252-4b42-b7b9-619e689beff1 on nch2-master-1 Aug 27 21:07:41.229463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8f2226f6-7e33-4aea-8ba3-135f0e0798a0 req-678e9ced-2a9e-4728-86cb-cee0a91537f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051537 Aug 27 21:07:41.230264 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2042/4222] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:41.235255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:41.236011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:41.248914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.249683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.250402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.251263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.251904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.254435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.463718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.472595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d79bb2ab-0477-4469-a4bb-d6d3be68c6b8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.382921 Aug 27 21:07:41.483406 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2181/4223] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:41.494072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:41.494800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:41.502352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.502885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.503427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.504618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.505132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.505605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.633214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.642687 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03845b29-20b9-42be-b9c2-138ca21f6742 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.411338 Aug 27 21:07:41.653288 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2043/4224] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:41 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:41.664209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:41.664838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:41.671839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.672311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.672736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.673837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.674378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.675047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.791701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:41.800143 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9090c96d-8426-4442-8b7f-409e4064ef6f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.309859 Aug 27 21:07:41.801238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2182/4225] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:41.822006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:41.822836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:41.829525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.830115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.830756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:41.832048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:41.832048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:41.832561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.048140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:42.073616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:42.076588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:42.083604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d433f1d8-75a9-4629-97de-bf1b345002cf tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1857 microversion: 2.32 time: 0.428910 Aug 27 21:07:42.102531 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2044/4226] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:41 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1857 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:42.102702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:42.107529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:42.118078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-510f107f-2edd-405e-becf-65689211d14c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.300306 Aug 27 21:07:42.123063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:42.129868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:42.130388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:42.130835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.130940 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2183/4227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:42.131585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:42.132049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:42.132527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.183840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "2a4186d6-29e8-478d-abea-bf22cee0b380"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:42.204362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:42.204849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:42.205282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.227630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] Creating event network-changed:2a4186d6-29e8-478d-abea-bf22cee0b380 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:42.232645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1cbcfeb5-78f9-400f-9578-3f85d6c69930 req-3d5cfb8b-d5c8-4dc1-b573-9540670b44a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053274 Aug 27 21:07:42.233565 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2184/4228] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:07:42.237564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:42.245988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56cbc58a-5d83-49cc-aece-ad3e29342057 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1453 microversion: 2.1 time: 0.142279 Aug 27 21:07:42.246584 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2045/4229] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:42 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:42.250809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:42.251556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:42.265589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:42.265589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:42.265753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.266461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:42.266913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:42.267372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:42.292811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1944186086", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "f75aad2c-a76e-4365-abfb-15744ff8d972"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:42.383901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] validate_networks() for [('f75aad2c-a76e-4365-abfb-15744ff8d972', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:07:42.994366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.004388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:43.008932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.011305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.013129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42417218-8e36-4389-8629-9fb041ad54d8 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.778324 Aug 27 21:07:43.014371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2185/4230] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:42 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:43.019249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:43.020184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:43.028395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.029216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.029816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.030998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.031786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.032383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.439738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.452293 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62eedbec-48b9-4bce-9329-473cee7f3a24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1375 microversion: 2.1 time: 0.436329 Aug 27 21:07:43.464008 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2186/4231] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:43 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1375 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:43.470536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:43.471543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:43.478474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.479277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.479955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.480874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.481582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.482211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.783625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:07:43.784448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:07:43.784589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:07:43.785583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:07:43.786643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:07:43.800930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.801672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.804519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.806505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.807193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.807860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.829366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:07:43.836434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:07:43.842165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.853103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:07:43.855862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:07:43.856962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.858491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:43.859930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc38edb8-b3fa-44f3-9970-a3afa78ce957 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.394135 Aug 27 21:07:43.875076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2187/4232] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:43 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:43.885664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:43.886591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:43.895376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.896144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.896850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.897926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.898774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.899475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.935086 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae192198-5548-4557-8d97-1b1aa9a09c27 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646140 Aug 27 21:07:43.945657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2046/4233] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:07:43.945902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:43.946210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:43.946653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:43.947479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lazy-loading 'fault' on Instance uuid 08af7293-d682-4778-b885-31467d65e8fa {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:07:43.963783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24bedc5a-2efd-4150-ac4f-bbeb71da4499 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:43.965266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24bedc5a-2efd-4150-ac4f-bbeb71da4499 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:44.080421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24bedc5a-2efd-4150-ac4f-bbeb71da4499 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.083836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.091743 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24bedc5a-2efd-4150-ac4f-bbeb71da4499 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1215 microversion: 2.1 time: 0.141840 Aug 27 21:07:44.107064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b6e54c5-cc24-4863-99f4-c5285df86bf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 200 len: 1305 microversion: 2.1 time: 0.217733 Aug 27 21:07:44.107064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2188/4234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:43 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 1305 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:44.109748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2047/4235] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:43 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:44.111998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:44.112619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:44.126430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.126940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.127451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.128115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.128703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.129763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.470738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08af7293-d682-4778-b885-31467d65e8fa", "name": "network-vif-deleted", "tag": "c76783dd-7fc4-44ce-852f-8b2893e4579e"}, {"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "67f19a86-603d-4bab-a4a6-423eff11c128"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:44.508663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.510255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.510757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.549636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.562567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.564607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Creating event network-vif-deleted:c76783dd-7fc4-44ce-852f-8b2893e4579e for instance 08af7293-d682-4778-b885-31467d65e8fa on nch2-master-1 Aug 27 21:07:44.565136 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] Creating event network-changed:67f19a86-603d-4bab-a4a6-423eff11c128 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:44.568353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.572537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1e69e1e-0a56-4661-9182-a6150bf8bd66 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.464945 Aug 27 21:07:44.575265 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2189/4236] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:44 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:44.594189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:44.595585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:44.609564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.613090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.613997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.614969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.615886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.617199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.624041 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bc52f4bb-3c37-4814-97e7-6349c9348a80 req-45e9b01a-5c5f-4551-94b8-7b8825517ab7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.163991 Aug 27 21:07:44.625743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2048/4237] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:07:44.911232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:44.919400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:44.925037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2614f04-c6fd-48ad-9dad-95740cf18d68 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1546 microversion: 2.1 time: 0.342097 Aug 27 21:07:44.926301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:44.926574 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2190/4238] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:44 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:44.944805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.945680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.950635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:44.951282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:44.953322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.954100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.954575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.958122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.960107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:44.964332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.968814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.969530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:44.970716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:44.971650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:44.975547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.394105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:45.403045 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92ee6a67-fc73-4ebb-83f4-2f9937bf7291 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1546 microversion: 2.1 time: 0.457187 Aug 27 21:07:45.407804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2191/4239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:44 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1546 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:45.412782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:45.417279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:45.432228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.433046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.433760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.434737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.436150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.436753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.506576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:45.526369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:45.527873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:45.529064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d868f3b5-5107-4722-bf9e-c94e849d2589 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.646170 Aug 27 21:07:45.529631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2049/4240] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:44 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:45.544047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:45.544047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:45.547056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.547577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.548008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.548776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.549237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.549585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.590682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa HTTP/1.1 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '08af7293-d682-4778-b885-31467d65e8fa'} Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:07:45.594280 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:07:45.598884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:07:45.600830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:45.617181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afaedbd5-a534-4a3c-85a1-606026efa7df tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 404 len: 111 microversion: 2.1 time: 0.065197 Aug 27 21:07:45.617822 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2050/4241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:45 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:07:45.618119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a49d0aa-4c1d-419d-b9b6-59325a4d3a0b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1267 microversion: 2.1 time: 0.207448 Aug 27 21:07:45.618884 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2192/4242] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:45 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:45.632176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:45.635530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:45.648275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.650543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.651208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.652534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:45.654143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:45.655857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:45.809330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-815181635", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "5538b041-76e2-4d8d-b5cc-5d8571e350b4"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:45.885561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] validate_networks() for [('5538b041-76e2-4d8d-b5cc-5d8571e350b4', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:07:46.568452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:46.581163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:46.583307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:46.584933 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62881f6a-47bb-400d-bb01-f03494c76fc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.964867 Aug 27 21:07:46.600028 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2051/4243] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:45 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:46.608224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:46.608783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:46.615230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:46.615746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:46.616389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:46.617314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:46.617769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:46.618225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.166291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:47.180616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:47.182309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:47.183621 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8907767c-2fb7-42ab-abcf-c189a241e26b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.581706 Aug 27 21:07:47.184460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2052/4244] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:46 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:47.197250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:47.198730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:47.207727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.208591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.209233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.210058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.210726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.211594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.317104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:47.327248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9bd7a8ec-e8b9-42ff-be7e-a26871903068 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1273 microversion: 2.1 time: 0.141563 Aug 27 21:07:47.328243 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2053/4245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:47 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:47.336173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "05231cba-c36e-4c03-a60c-8cf5d1759c75"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:47.352698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.353524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.354309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.366773 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] Creating event network-changed:05231cba-c36e-4c03-a60c-8cf5d1759c75 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:47.372263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8a7aaf44-24e2-4d62-b69e-2ba4192cc9a5 req-74fd0f3c-81f8-4220-bbdd-2249c14ad102 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041690 Aug 27 21:07:47.373302 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2054/4246] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:47.397515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:07:47.398676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:07:47.399315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:07:47.399892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:07:47.400507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:07:47.410812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.411424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.412025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.422022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.423192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.423861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.444153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:07:47.449963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Getting quotas for user 7169b8b3279c43c9a4097d6e42d2f1eb and project 1fff748616a34a7db41745e7d9340353. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:07:47.465092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:07:47.467835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:07:47.528390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be58bc6c-6ac2-40d7-a6fb-51d8c41e056b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722918 Aug 27 21:07:47.529407 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2193/4247] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:07:47.544826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e6f65c1-f659-4f8b-b8bb-5eee0d09384a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:47.544826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e6f65c1-f659-4f8b-b8bb-5eee0d09384a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:47.614295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:47.614922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:47.625054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.626028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.632560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.633529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:47.634162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:47.636147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:47.838104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e6f65c1-f659-4f8b-b8bb-5eee0d09384a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:47.846306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e6f65c1-f659-4f8b-b8bb-5eee0d09384a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1214 microversion: 2.1 time: 0.306720 Aug 27 21:07:47.846903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2055/4248] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:47 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:48.213112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:48.214010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:48.223880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.224603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.225171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:48.225980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.226433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.226882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:48.260745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.272694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.274526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.275974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73ec4c65-59e6-48fe-9be1-064c09ce78fe tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.666780 Aug 27 21:07:48.276647 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2194/4249] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:47 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:48.354846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:48.356096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:48.367967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.368673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.369314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:48.370877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.372873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.373410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:48.629266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.642461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.644920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:48.646625 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a1cb04a-6878-44a6-83ac-fce81e31e257 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.440144 Aug 27 21:07:48.660343 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2056/4250] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:48 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:48.867609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:48.868250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:48.883311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.884706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.885375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:48.886509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:48.887194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:48.888276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.020209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:49.029450 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-45fdeefa-a406-4ca7-8833-e6a3c8d5fa37 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1210 microversion: 2.1 time: 0.166352 Aug 27 21:07:49.030339 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2057/4251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:48 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:49.040026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:49.048538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f80b527-6eed-4468-b93b-0fd239794f0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.698192 Aug 27 21:07:49.049821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2195/4252] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:48 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:49.302262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:49.302862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:49.312802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:49.313369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:49.314364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.315583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:49.316910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:49.317541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.453195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "bf58ee0e-25fd-4e17-aed4-84919edde433"}, {"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "1928081a-e18a-40a9-8c32-f6a165d48e48"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:49.464430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:49.465371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:49.465994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.477913 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Creating event network-changed:bf58ee0e-25fd-4e17-aed4-84919edde433 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:49.478497 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] Creating event network-changed:1928081a-e18a-40a9-8c32-f6a165d48e48 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:49.484215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-0ce7ffb8-f9dd-40c3-baa8-975c378d51c9 req-10478c88-3fb7-482b-867e-2e2dee1376f8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035032 Aug 27 21:07:49.485019 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2196/4253] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:07:49.672248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:49.674344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:49.675569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:49.684993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:49.686115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:49.686786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.688237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:49.689426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:49.689786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:49.690723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:49.692422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:49.694636 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2f13009-004f-4463-8e16-93405dff16fd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.396722 Aug 27 21:07:49.696205 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2058/4254] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:49 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:50.057322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:50.058177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:50.068390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.069546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.070150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.071049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.071766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.072512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.185749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:50.201978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:50.204318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:50.205704 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37758c58-d9c9-419f-91c8-c50b1285010a tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.537233 Aug 27 21:07:50.212578 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2197/4255] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:49 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:07:50.219574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:50.220604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:50.235479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.236339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.236831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.239097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.240171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.240636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.243245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:50.254364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-53565889-0db8-453c-83c1-36711eef89ca tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1274 microversion: 2.1 time: 0.200784 Aug 27 21:07:50.255645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2059/4256] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:50 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:50.528702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:50.540742 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f2fcdc5-8796-4f03-9351-68809767893e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.325441 Aug 27 21:07:50.554692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2198/4257] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:50 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:50.695889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d060e67-e252-4b42-b7b9-619e689beff1", "tag": "a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:50.710055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.710964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.711606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.720143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:50.721051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:50.737796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.739564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.742106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.743207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:50.743872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:50.746902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:50.773964 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] Creating event network-changed:a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b for instance 9d060e67-e252-4b42-b7b9-619e689beff1 on nch2-master-1 Aug 27 21:07:50.783480 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8323aacb-f4ff-4bf9-b447-f41449670ba1 req-4876afea-05eb-4aef-8382-1f912189f655 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094924 Aug 27 21:07:50.784778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2060/4258] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:51.028130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.041676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.043200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.044486 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7528fe64-6955-47d5-b1a7-c92a3d845bca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.330284 Aug 27 21:07:51.045162 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2199/4259] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:50 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:51.234421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:51.236628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:51.249648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.250604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.251214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.253916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.254648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.256186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.276692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:51.277314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:51.283989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.288000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.288463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.289201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.289662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.291502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.425343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.438562 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db870815-8d0f-4711-a43c-1562b36c2d2a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1274 microversion: 2.1 time: 0.166411 Aug 27 21:07:51.452207 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2200/4260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:51 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:51.564098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:51.565251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:51.587830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.591537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.592478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.595737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.596466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.600590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.708633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.726482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.731277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:51.749132 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7406e418-6035-4612-960e-2a530fb3e326 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.519697 Aug 27 21:07:51.762420 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2061/4261] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:51 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:51.808588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d96fe773-6577-4b0d-880b-aaf09a1b551f", "tag": "032f81cf-50f5-4613-ac38-b95fdb811a08"}, {"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "ba8c1011-8a54-4d65-b018-67dd534862a4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:51.826590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:51.828203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:51.830247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:51.848392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Creating event network-changed:032f81cf-50f5-4613-ac38-b95fdb811a08 for instance d96fe773-6577-4b0d-880b-aaf09a1b551f on nch1-master-1 Aug 27 21:07:51.849249 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] Creating event network-changed:ba8c1011-8a54-4d65-b018-67dd534862a4 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:07:51.859271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7d09ba15-2b50-4031-a7e3-721cfccc4465 req-d1feb60b-7302-4ebd-b03e-b498cf4debca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054213 Aug 27 21:07:51.860851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2062/4262] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:52.074927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:52.076651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:52.087735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.090420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.093541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.094419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.095920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.100302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.298975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:52.321254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86edfc74-0620-436c-80f4-296e0c25de44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.759946 Aug 27 21:07:52.325549 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2201/4263] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:51 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:52.465975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:52.467180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:52.486143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.488009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.488670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.491005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.491799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.492392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.883137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:52.901867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:52.903672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:52.905093 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-994694e4-4376-46a5-8fa8-4f4876e2c50b tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.835276 Aug 27 21:07:52.919924 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2063/4264] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:52 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:52.933881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:52.940165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:52.942092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:52.949780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.950536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.951126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.952066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:52.952680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:52.953260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:52.979899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:52.982040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb3cfd26-095e-42b5-a749-a139bf69eaa7 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1272 microversion: 2.1 time: 0.521354 Aug 27 21:07:52.989076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2202/4265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:52 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1272 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:53.345785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:53.346605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:53.359688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:53.361765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:53.362354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:53.365270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:53.366017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:53.367800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:53.422874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:53.456053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:53.470862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:53.472759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:53.474201 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfc68cbc-ba03-4dc2-bbf4-45a6d6e6d4a3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.553270 Aug 27 21:07:53.475599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2064/4266] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:52 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:53.722028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:53.732938 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85d7ee61-ab76-4357-8a5a-3068be91d4a0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.390630 Aug 27 21:07:53.747562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2203/4267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:53 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:53.935635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:53.936433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:53.938977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:53.944944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:53.945583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:53.946150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:53.947859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:53.948510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:53.949738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.008259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:54.009139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:54.016976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.017637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.018230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.019437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.019997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.020587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.246060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.260746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.271820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.282067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.285680 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-69512d01-7b82-4fc6-bd9b-f91f27320604 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.355024 Aug 27 21:07:54.286789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3cc34a6-64d4-409e-9a1f-14e20e132400 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.282514 Aug 27 21:07:54.295421 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2065/4268] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:53 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:54.295421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d257e17-bbd3-4bb6-88df-61528caa2563", "tag": "1ddf6b67-2cb2-4120-b82e-409cd4f4e849"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:54.297177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2204/4269] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:54 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:54.305311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.305872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.306400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.324716 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] Creating event network-changed:1ddf6b67-2cb2-4120-b82e-409cd4f4e849 for instance 0d257e17-bbd3-4bb6-88df-61528caa2563 on nch2-master-1 Aug 27 21:07:54.332065 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-864a375d-c476-4c25-872f-a21b5d0c5d4a req-90631307-4624-4685-9ee4-2574c32b9638 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041787 Aug 27 21:07:54.333199 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2066/4270] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:54.498992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:54.499829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:54.506842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.507802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.508718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.509434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.509931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.510463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.725451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.734914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.736561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.737783 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c01a01e9-3e07-4c98-b49c-757a1f25fa29 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.242877 Aug 27 21:07:54.738364 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2205/4271] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:54 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:54.756398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:54.758137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:54.765861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.766574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.767012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.767735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:54.768199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:54.768606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:54.909263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:54.917558 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bae6da26-b509-4645-8b63-47e906adf7b4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.166563 Aug 27 21:07:54.918142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2067/4272] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:54 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:55.319075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:55.319717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:55.322147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:55.323050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:55.327836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.328515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.329090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.329965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.330564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.331127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.334321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.334827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.335272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.336320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.336813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.338888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.679981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:55.686351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:55.694147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06a13e06-c69c-46cf-8154-0feb4c80cb5f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.376855 Aug 27 21:07:55.699679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:55.701535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:55.702876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2bef8ca6-d718-4d41-87c4-9f47f4cd3796 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.392905 Aug 27 21:07:55.707571 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2068/4273] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:55 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:55.720061 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2206/4274] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:55 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:55.761410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:55.762164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:55.770724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.771660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.772320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.773035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.773488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.773916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.942699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:55.943712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:55.951416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.952151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.952598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:55.953471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:55.953951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:55.954408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.118819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:56.138488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:56.140384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:56.142085 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36bd2e98-9a38-4f8e-8415-f806fda78581 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.385307 Aug 27 21:07:56.153636 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2069/4275] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:55 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:56.241767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:56.250410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e74992f2-e746-41ac-844d-4fdf0d439678 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.316031 Aug 27 21:07:56.251105 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2207/4276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:55 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:56.541391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:56.542501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:56.551660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.552391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.552976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.553844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.554438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.555007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.583846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd18c46a-758a-475a-9eec-11df1267440a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/ips" status: 200 len: 149 microversion: 2.1 time: 0.046317 Aug 27 21:07:56.584362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2070/4277] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:07:56 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:07:56.599894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:07:56.602633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:56.614970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.617672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.618205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.619004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.621875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.622400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.725514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:56.725847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:56.735727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.737435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.737985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.738740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.739216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.740192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.837296 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/os-volume_attachments HTTP/1.1 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 74 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: {"volumeAttachment": {"volumeId": "6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495"}} Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': '1750bd7e-c490-4129-b9b8-0f8079470e2d', 'body': {'volumeAttachment': {'volumeId': '6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495'}}} Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:07:56.841974 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 400 to user: Invalid volume: volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is already attached to instances: 1bce13ff-c933-4dfa-8b52-c61a97a61491 {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-884134e3-08cd-4294-ba74-63b710a56e46 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.250649 Aug 27 21:07:56.846021 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2208/4278] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:07:56 2022] POST /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d/os-volume_attachments => generated 174 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:07:56.853024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:56.853654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:56.864285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.864784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.865224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:56.865928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:56.866554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:56.867132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.179637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.194223 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a6cb772-5cf0-4395-a0e7-552e15de31b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.475037 Aug 27 21:07:57.201185 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2071/4279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:56 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:07:57.206900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:57.212496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:57.227742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.228660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.229328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.230409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.231324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.232548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.267782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:07:57.354269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.369562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.371477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.373317 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3203b5cf-bb7b-45af-bfe2-8bde303e4716 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.527604 Aug 27 21:07:57.376515 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2209/4280] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:56 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:57.388196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:57.390806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:57.397093 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d59fa5a7-fb41-499b-9baf-0ba75c0de1b3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 204 len: 0 microversion: 2.1 time: 0.193775 Aug 27 21:07:57.397865 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2072/4281] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:07:57 2022] DELETE /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:07:57.404378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:57.405021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.405538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.405755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:57.406018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.411614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.412310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.412907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.413411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:57.415065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.415759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.416777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.417321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.417925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.418508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.463675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:57.471222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:57.712917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.721543 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9cc4d9c-edb0-4485-b2ea-145f32c757b6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.321428 Aug 27 21:07:57.736351 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2073/4282] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:57 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:57.741917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:57.742112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:57.749012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.750047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.750047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.750667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:57.751124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:57.751643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:57.772881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.790681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.792170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:57.793364 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-671211f9-132f-48c2-8e1c-62c43d5498e9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.413515 Aug 27 21:07:57.793944 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2210/4283] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:57 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:57.845604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:07:58.044821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:58.055480 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d6fde8c-90d7-4b86-ac48-ff9f12ec0f57 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1681 microversion: 2.1 time: 0.318301 Aug 27 21:07:58.056082 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2074/4284] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:57 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:58.216860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:58.218118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:58.224584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:58.225457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:58.225600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:58.231611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:58.232732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:58.233458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:58.401559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:58.402581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:58.410116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:58.412683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:58.413530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:58.414507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:58.415170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:58.415824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:58.969567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:58.980784 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6adea242-0a1f-4a84-8c7b-d04c7e541903 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.767182 Aug 27 21:07:58.995451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2211/4285] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:58 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:59.000802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:59.001636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:59.006896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.009122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.009608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.010208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.011160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.011784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.012345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.016834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.018306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.022493 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-31edb26a-1d45-4285-9c6c-0bcd95c209a5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.624989 Aug 27 21:07:59.023425 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2075/4286] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:58 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:59.028767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:59.029580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:59.043392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.044033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.044551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.045379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.045949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.046742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.373878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.385273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76018e97-50ff-48ae-bceb-6dc3ddc44ae5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.388275 Aug 27 21:07:59.386201 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2212/4287] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:58 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:07:59.391021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:07:59.392232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:07:59.399500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.400283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.400904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.401970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:07:59.402598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:07:59.403032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:07:59.473707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.483143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.484741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.485914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0931959-11f9-40c6-a79e-ca3916c5ad21 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.460975 Aug 27 21:07:59.486778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2076/4288] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:07:59 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:07:59.687700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:07:59.696928 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8802ea5f-cadd-43ef-b0b4-9982710462ee tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1681 microversion: 2.1 time: 0.309452 Aug 27 21:07:59.698242 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2213/4289] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:59 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:00.005041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:00.005671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:00.013106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.014344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.014970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.015935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.016579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.017212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.049552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:00.051804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:00.060598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.061234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.061936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.062729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.063260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.063809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.453825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.462877 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f6713d52-d9ab-48f8-a65f-eb11cca5d66c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.464416 Aug 27 21:08:00.463901 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2077/4290] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:07:59 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:00.471474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1750bd7e-c490-4129-b9b8-0f8079470e2d", "name": "network-vif-deleted", "tag": "bf96bdab-d107-4833-9746-ea8907b4977d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:00.483062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.483923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.484599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.497802 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] Creating event network-vif-deleted:bf96bdab-d107-4833-9746-ea8907b4977d for instance 1750bd7e-c490-4129-b9b8-0f8079470e2d on nch1-master-1 Aug 27 21:08:00.500033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.504253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6d7dc49e-a08b-4bdf-a94e-1f376c11b3e1 req-6017bb1d-5a19-4de4-a8dc-d2897ffdb197 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038307 Aug 27 21:08:00.505267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2078/4291] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:00.512244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:00.514327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.515280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:00.516550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.517945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9551ec7a-7e70-4134-b46d-760ad3653704 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.472984 Aug 27 21:08:00.519365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2214/4292] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:00 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:00.524640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:00.525870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:00.533205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.533976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.534754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.536351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.536844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.536983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.537269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.537630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.538123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.550070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.550589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.551043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.851133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.854380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.863236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd78f0aa-7bba-42ef-acea-92bdaa3fac65 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.353259 Aug 27 21:08:00.864296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2079/4293] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:00 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:00.865191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.868212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:00.869600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38d36b9a-fc4e-4700-b208-3a32181fb64b tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.348661 Aug 27 21:08:00.879768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:00.882830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:00.884051 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2215/4294] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:00 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:00.894721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.895215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.895675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.896390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:00.896839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:00.897259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:00.999096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:01.012330 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61aaa256-6f98-45b6-bed3-ad4fd0f83d39 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1613 microversion: 2.1 time: 0.144000 Aug 27 21:08:01.013046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2080/4295] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:00 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:01.487888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:01.488513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:01.500719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:01.504740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:01.506296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:01.507285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:01.507998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:01.511719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:01.543645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:01.544957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:01.555799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:01.556343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:01.564423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:01.566414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:01.567072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:01.570555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:01.614859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:02.088595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.101895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d486723-2719-4498-9e59-bef2c9684d36 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.618106 Aug 27 21:08:02.103109 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2216/4296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:01 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:02.108776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96fe773-6577-4b0d-880b-aaf09a1b551f", "name": "network-vif-plugged", "status": "completed", "tag": "032f81cf-50f5-4613-ac38-b95fdb811a08"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:02.121133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.121611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.122065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.136117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] Creating event network-vif-plugged:032f81cf-50f5-4613-ac38-b95fdb811a08 for instance d96fe773-6577-4b0d-880b-aaf09a1b551f on nch1-master-1 Aug 27 21:08:02.141715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9df5265e-6cb2-4915-89e2-72060bee033f req-9ef02c45-4045-43c3-9286-61aff7d88eae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037961 Aug 27 21:08:02.142292 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2217/4297] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:02.150140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:02.150835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:02.157693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.158182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.158777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.159670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.160314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.160744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.169308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.181264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.182774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.184249 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a78c619-5194-4eb4-8793-b574acb228ca tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.645571 Aug 27 21:08:02.195425 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2081/4298] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:01 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:02.203131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:02.207415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:02.214479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.215433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.216179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.216997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.217752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.218651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.935281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.943829 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4005afe9-3633-4e40-8288-efc8d3af0058 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.800127 Aug 27 21:08:02.944732 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2218/4299] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:02 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:02.949404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:02.950078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:02.956441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.956936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.957384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.958225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.958801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.959244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.976255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.985997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.987739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:02.989669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d64b8d22-a1bb-4016-aeed-3a17f6000203 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.799861 Aug 27 21:08:02.990341 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2082/4300] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:02 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:02.995879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:02.996383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:02.996827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:02.997288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'fault' on Instance uuid 1750bd7e-c490-4129-b9b8-0f8079470e2d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:03.044145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:03.052805 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e38d0867-ef55-4ffd-905e-8717e2dd0ef8 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 200 len: 1331 microversion: 2.1 time: 0.107182 Aug 27 21:08:03.053390 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2219/4301] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:02 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:03.124918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:03.125743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:03.133431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.134021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.134531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:03.135322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.135832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.136263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:03.208613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:03.209465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:03.216945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.217464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.218000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:03.218921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.219648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.220293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:03.267742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:03.431896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:03.442553 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8c714950-1fe9-4fc7-a2a9-9c21a0c6d1b0 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.321630 Aug 27 21:08:03.457949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2083/4302] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:03 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:03.555666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:03.565843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:03.567821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:03.569434 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5e9704d-edcb-43a7-8ded-a6c1e5467894 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.365467 Aug 27 21:08:03.570072 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2220/4303] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:03 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:03.967326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:03.967982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:03.974711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.975222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.975674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:03.976388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:03.976965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:03.977253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.012575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:04.013379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:04.021316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.021816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.022257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.022974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.023573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.024008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.211876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.222903 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87b993d4-08c0-4c73-90da-c89629ef50e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.260134 Aug 27 21:08:04.223880 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2084/4304] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:03 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:04.229028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:04.229675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:04.235963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.236452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.237062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.238048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.238528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.238957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.253532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d HTTP/1.1 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1750bd7e-c490-4129-b9b8-0f8079470e2d'} Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:04.255464 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-adcf0da0-8f93-4f78-b8e4-70ae1d2fc25d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 404 len: 111 microversion: 2.1 time: 0.031663 Aug 27 21:08:04.260062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2085/4305] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:04 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:04.265641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ab21702-ec8c-4594-a3bf-a415aacf43cd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '.version_select at 0x7ff84e835b80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:04.275976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.286541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.288261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ab21702-ec8c-4594-a3bf-a415aacf43cd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050780874" status: 202 len: 0 microversion: 2.1 time: 0.026245 Aug 27 21:08:04.288407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.289157 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2086/4306] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:08:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050780874 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:08:04.290126 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36e4d0d3-98f7-4704-a4f7-27557e7b8c7c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.281501 Aug 27 21:08:04.290699 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2221/4307] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:04 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:04.465305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:04.465931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:04.491825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.492350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.492793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.497503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.498728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.499752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.597591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:04.598219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:04.605590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.606387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.606980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.607908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:04.608517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:04.609176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:04.927377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.949472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e78ff2bc-47b7-400e-b9f4-96da53c8b511 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.480810 Aug 27 21:08:04.950244 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2087/4308] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:04 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:04.961511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.975089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.976685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:04.977902 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3109bb67-9077-4483-afc0-cba5c4fb904e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.384880 Aug 27 21:08:04.978451 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2222/4309] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:04 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:05.245926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:05.247035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:05.255222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.255222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.255442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.256305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.256828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.257324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.310457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:05.312081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:05.329311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.331746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.336031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.336826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.337287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.337724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.424908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:05.433298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'services' on Instance uuid 1bce13ff-c933-4dfa-8b52-c61a97a61491 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:05.433489 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1223f430-81be-430f-ab42-e4ad26bd36c9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1315 microversion: 2.1 time: 0.189954 Aug 27 21:08:05.433931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2088/4310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:05 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:05.446511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:05.448133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:05.458297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.458297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.458297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.471215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.471847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.472408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.554019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments/6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495" status: 202 len: 0 microversion: 2.1 time: 0.247422 Aug 27 21:08:05.555097 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2223/4311] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:08:05 2022] DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments/6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:08:05.569041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:05.572422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:05.579802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.580544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.581439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.582237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.582697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.583292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.616184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8aab4f50-572a-4f5a-829e-281d62f72300 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056545 Aug 27 21:08:05.616813 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2224/4312] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:08:05 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:05.730154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:05.740853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:05.742535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:05.743749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4e174d7-6f0b-4388-be3f-5982299a0243 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.307150 Aug 27 21:08:05.744839 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2089/4313] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:05 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:05.973759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:05.976673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:05.986757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.988609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.989292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:05.990401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:05.991008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:05.991849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.005393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:06.006421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:06.027285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.031750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.032983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.039772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.040533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.041234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.334847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:06.351985 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8c74300-ca8f-4e64-aa7b-178a177ab559 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.382429 Aug 27 21:08:06.353742 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2225/4314] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:05 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:06.363631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "e990918c-a7ca-438e-b9e8-4610424b6cc4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:06.374506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:06.383603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.384438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.385188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.387412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:06.388879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:06.390263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39334629-c1ca-431c-8b02-1fd5c82a0dc9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.392107 Aug 27 21:08:06.391484 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2090/4315] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:05 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:06.411315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] Creating event network-vif-plugged:e990918c-a7ca-438e-b9e8-4610424b6cc4 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:06.417066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1a85ce75-7586-47ef-b8ed-95b6140975f3 req-37781613-94f0-4dde-ab7c-e46281e2aea3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061530 Aug 27 21:08:06.417723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2226/4316] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:06.455541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:06.456431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:06.463705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.464615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.465417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.466160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.466620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.467053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.629951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:06.632660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:06.638010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:06.646821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.647624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.648278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.648410 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b135576-8253-4d29-b9bb-c2aa629d2d10 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1501 microversion: 2.1 time: 0.197737 Aug 27 21:08:06.649368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.649479 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2091/4317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:06 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:06.650162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.650797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.672669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:06.683190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.683713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.684499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.709228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68aa8d76-5f83-4288-8d0f-1bb1dd2eb6bc tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084224 Aug 27 21:08:06.710121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2227/4318] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:08:06 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:08:06.740642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Going to try to stop instance {{(pid=140433) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:08:06.775616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:06.778943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:06.791273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.792975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.793446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.794151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.794622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.795049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.812072 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed848e46-53ad-462b-b353-7ccc4a761200 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f/action" status: 202 len: 0 microversion: 2.1 time: 0.144969 Aug 27 21:08:06.814561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2092/4319] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:06 2022] POST /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:08:06.841503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:06.842817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:06.852033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.853017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.853558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:06.854640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:06.855171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:06.855693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.073070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.084839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.087527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.089184 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8c75c90-5ada-4623-a83e-97785a231c57 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.322196 Aug 27 21:08:07.090270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2228/4320] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:06 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:07.097084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:07.097905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:07.109029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.109698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.110489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.111408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.112426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.113761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.124433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.133364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5a16538-e133-4a50-a7db-2c7741e2ee19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.313606 Aug 27 21:08:07.134492 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2093/4321] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:06 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:07.148578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:08:07.256241 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6bb3ec30-4820-4ab7-b9b8-be2a3b2bc4af tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 204 len: 0 microversion: 2.1 time: 0.164304 Aug 27 21:08:07.257207 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2229/4322] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:07 2022] DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:08:07.265839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:07.266786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:07.276188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.276916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.277366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.278094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.278555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.278991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.374609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:07.375551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:07.379362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:07.391665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.392146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.392629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.393371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.393883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.394327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.452042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.460843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4703258e-9c50-4dac-84b8-be6807d66d3e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1682 microversion: 2.1 time: 0.199033 Aug 27 21:08:07.461450 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2094/4323] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:07 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:07.468304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:07.469182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:07.476749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.477699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.478245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.479331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:07.479915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:07.480558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:07.669933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.680253 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-000c2fcb-3ac4-4a0b-aadb-2350346047c1 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.309798 Aug 27 21:08:07.680856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2230/4324] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:07 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:07.747927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.758717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.760363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:07.761751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbe69d6f-eb41-417b-8e3f-9ae30cdf8acb tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.299204 Aug 27 21:08:07.762501 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2095/4325] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:07 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:08.113609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:08.114230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:08.120491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.120998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.121438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.122152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.122610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.123047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.170765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:08.171930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:08.179317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.192250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.192830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.193875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.194697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.195296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.692160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.701953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.703649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.704815 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b10c165-6774-4739-a24c-6856305bf39d tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.595370 Aug 27 21:08:08.705383 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2231/4326] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:08 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:08.710529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "6fdea988-e8fe-4f45-b392-b55477b33feb"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "3e9fb118-6067-45ee-8c69-915038ed9866"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "601119b8-282e-401e-9557-ba5c8dda2531"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "7dc90f8a-6c03-4fad-b767-d78d9192a901"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "b5414c2c-a41b-4574-bbaa-f52411d09c65"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-plugged", "status": "completed", "tag": "ec94104a-dc15-401c-896b-ab4bc36c4c52"}, {"server_uuid": "0d257e17-bbd3-4bb6-88df-61528caa2563", "name": "network-vif-plugged", "status": "completed", "tag": "1ddf6b67-2cb2-4120-b82e-409cd4f4e849"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:08.715856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.722199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.722902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.723531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.725357 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42f667b2-4f80-419e-a891-b19fc608021f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.574402 Aug 27 21:08:08.726145 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2096/4327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:08 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:08.731022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:08.731430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:08.737187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.737718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.738166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.742087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.742866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.743945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.750729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:6fdea988-e8fe-4f45-b392-b55477b33feb for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.751233 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:3e9fb118-6067-45ee-8c69-915038ed9866 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.751971 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:601119b8-282e-401e-9557-ba5c8dda2531 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.754137 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:7dc90f8a-6c03-4fad-b767-d78d9192a901 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.754804 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:b5414c2c-a41b-4574-bbaa-f52411d09c65 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.755477 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:ec94104a-dc15-401c-896b-ab4bc36c4c52 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:08.756129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] Creating event network-vif-plugged:1ddf6b67-2cb2-4120-b82e-409cd4f4e849 for instance 0d257e17-bbd3-4bb6-88df-61528caa2563 on nch2-master-1 Aug 27 21:08:08.763880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-11b2e8e8-a7f6-4026-bfdf-fb16c69a1286 req-f1e8da7e-95f8-46b5-a045-fa2d3dc8bddf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.056700 Aug 27 21:08:08.764653 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2232/4328] 10.222.0.40 () {64 vars in 1318 bytes} [Sat Aug 27 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:08.769849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:08.770512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:08.776722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.777209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.777641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.778333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:08.778782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:08.779198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:08.984590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.993862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:08.998454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c775fc8-87fa-4ed6-8ab9-4b7fdf7fa44b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1682 microversion: 2.1 time: 0.271438 Aug 27 21:08:08.999088 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2097/4329] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:08 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:09.007861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:09.008479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:09.013790 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec9271ed-4d16-44ea-8d58-3a5385115d05 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.248050 Aug 27 21:08:09.014384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2233/4330] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:08 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:09.018239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.018799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.019546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:09.020243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.020875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.021128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:09.042670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:09.289224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:09.314755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:09.319146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:09.320603 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8b75f6e-78b3-4493-a652-63d79d1051e5 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.320523 Aug 27 21:08:09.329097 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2098/4331] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:08 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:09.732008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:09.733284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:09.750663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:09.752491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:09.754241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.754763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.755324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:09.761299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.761509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.761860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.762325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:09.762439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.762959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:09.764071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:09.764533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:09.765742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.122199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.134256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-963ab3ff-6f07-4003-a187-2b0030ee7f29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.391616 Aug 27 21:08:10.135931 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2099/4332] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:09 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:10.141007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954fbcb2-8e60-468a-8fb4-ab2f508f825d"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:10.145203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:10.152470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.153215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.153728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.154515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.155045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.155542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.171151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.192117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.193522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.195016 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f48cb9cc-1a4c-4e55-9320-7a1f0bc6c1d3 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.468646 Aug 27 21:08:10.195659 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2234/4333] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:09 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:10.215804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:10.216671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:10.226828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.227601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.228178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.229533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.230132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.230711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.387373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.397595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28c61784-da16-4a63-99e6-2bfec3afb106 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1682 microversion: 2.1 time: 0.185881 Aug 27 21:08:10.398440 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2235/4334] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:10 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:10.405117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:10.406004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:10.418187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.419692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.420623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.422228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.423260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.423891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.430200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:10.509182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-14c5a6b2-32ce-4b4c-9a50-186751457bdc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371658 Aug 27 21:08:10.515469 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2100/4335] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:08:10 2022] POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:10.521998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:10.522952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:10.530249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.531048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.531717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.532706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.533193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.533781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.802583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.820192 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bac4d685-1e1a-4b88-b760-f55522fd242e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1314 microversion: 2.1 time: 0.419803 Aug 27 21:08:10.820821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2236/4336] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:10 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:10.835929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bce13ff-c933-4dfa-8b52-c61a97a61491", "name": "network-vif-deleted", "tag": "3f71a397-ab40-42f8-9253-da058ad73f44"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:10.865143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.871233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:10.871750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:10.872187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:10.878338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.893475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:10.895122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd7f8d89-3e24-4fbe-918f-d5eed5328f6c tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.378224 Aug 27 21:08:10.895923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2101/4337] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:10 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:10.912334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] Creating event network-vif-deleted:3f71a397-ab40-42f8-9253-da058ad73f44 for instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 on nch2-master-1 Aug 27 21:08:10.926401 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-14448b2e-fa0c-4c89-84fc-7f05e1526a64 req-481affee-4100-4387-ac03-67678ada57f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104060 Aug 27 21:08:10.927828 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2237/4338] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:11.162980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:11.163973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:11.171886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.172606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.173250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.173974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.174748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.174831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.227534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:11.230580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:11.247308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.247869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.248321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.250623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.251095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.252947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.460087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:11.470527 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b345c90e-28be-4ece-9392-35d6505ab4e0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.313975 Aug 27 21:08:11.474013 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2102/4339] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:11 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:11.496404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:11.496985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:11.512991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.513498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.513950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.514664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.527165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.527838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.636867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:11.647272 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d21f882c-6da1-44ff-92b6-370cbe34dd5f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1327 microversion: 2.1 time: 0.171989 Aug 27 21:08:11.651551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2103/4340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:11 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:11.658056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:11.670092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:11.672926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:11.674545 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a90fd57e-f9c0-4b9b-a0cd-d7aa77928c72 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.456413 Aug 27 21:08:11.675680 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2238/4341] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:11 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:08:11.843074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:11.844080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:11.854109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.854697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.855376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.856335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.856914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.857707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.942155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:11.947754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:11.969473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.971002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.972638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:11.976637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:11.977439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:11.978184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.126302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.136624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db1831e2-75e2-451e-b2de-0644cf9d2838 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1501 microversion: 2.1 time: 0.298604 Aug 27 21:08:12.139831 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2104/4342] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:11 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:12.171043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:12.172912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:12.191851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.193133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.193877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.195210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.196092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.209604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.271085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lazy-loading 'flavor' on Instance uuid 0d257e17-bbd3-4bb6-88df-61528caa2563 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:12.394808 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0834f28-fa2f-46f6-b7a7-0d0152dc020b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "POST /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563/action" status: 202 len: 0 microversion: 2.1 time: 0.233077 Aug 27 21:08:12.398525 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2105/4343] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:12 2022] POST /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:08:12.404945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:12.405651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:12.418029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.419493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.420117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.421009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.422076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.422677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.432126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.456453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.465043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.475103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d6f2a07-585e-48f4-92a2-847ca285edc7 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1879 microversion: 2.42 time: 0.550632 Aug 27 21:08:12.476345 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2239/4344] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:11 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1879 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:12.496950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:12.497917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:12.511815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.512559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.513399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.514405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.515261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.515852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.804350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.819592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b030fc0-5358-4678-8850-64e0e4939a0e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1509 microversion: 2.1 time: 0.419175 Aug 27 21:08:12.820199 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2106/4345] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:12 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:12.825034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:12.825536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:12.844865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.846165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.850526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.850526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.853710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.854174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.898577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:12.899203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.899742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.900564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.901205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'fault' on Instance uuid 1bce13ff-c933-4dfa-8b52-c61a97a61491 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:12.918886 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f57b4d76-64b3-438c-8087-345eb9b168a7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.426103 Aug 27 21:08:12.920849 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2240/4346] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:12 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:12.929398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:12.930487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:12.946611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.947966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.949034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.950512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:12.951212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:12.951880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:12.986158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.006368 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c42771f-8dfc-4d7b-936e-bcf86e37b367 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 200 len: 1332 microversion: 2.1 time: 0.185069 Aug 27 21:08:13.007425 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2107/4347] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:12 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 1332 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:13.297459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.315060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.317157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.318848 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a9c3ee9-77bf-47b7-b6f5-33ab7e518877 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.396047 Aug 27 21:08:13.319558 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2241/4348] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:12 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:13.499701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:13.500533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:13.509427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.510262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.511091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.511868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.512292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.512939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.719880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.730413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.732230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:13.734388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72a82000-0698-495f-90fe-69a617734636 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2837 microversion: 2.42 time: 0.238925 Aug 27 21:08:13.747378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2108/4349] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:13 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2837 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:13.761957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:13.762576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:13.771491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.772021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.772466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.773312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.773759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.774218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.844881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:13.845811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:13.856804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.857938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.858567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.859670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.860342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.861100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.946770 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2283b0d2-d5cc-4b9b-b96f-cdd1fae9583e tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.188903 Aug 27 21:08:13.947405 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2242/4350] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:08:13 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1/os-interface => generated 1830 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:13.952475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:13.953303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:13.962365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.963314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.963884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:13.970586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:13.971077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:13.971601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.198678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:14.207952 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd24dc0d-0851-40cd-a8df-22e6bc85b987 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1492 microversion: 2.1 time: 0.369599 Aug 27 21:08:14.208896 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2109/4351] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:13 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1492 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:14.219591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:14.223389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:14.231473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.232102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.232588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.233311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.233741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.234557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.262663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'flavor' on Instance uuid 652b2888-c2e3-425c-afdc-0d209b09f16c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:14.263152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:14.289789 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-230cc312-6da0-4a61-86a3-1e1489a7985e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.341136 Aug 27 21:08:14.305580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2243/4352] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:13 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:14.318679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:14.320505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:14.349562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.350170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.350511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.351228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.351794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.352126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.370052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 HTTP/1.1 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1bce13ff-c933-4dfa-8b52-c61a97a61491'} Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:14.372608 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc76326a-042e-49fc-bccc-cfd1fcc718d2 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 404 len: 111 microversion: 2.1 time: 0.067377 Aug 27 21:08:14.376366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2244/4353] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:14 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:14.381827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:14.382340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:14.391766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.392849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.394423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.395575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.396392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.397112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.408575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:14.444427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:08:14.486366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70d523ed-2d12-4d3f-9730-943f784b8344 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/action" status: 200 len: 32 microversion: 2.1 time: 0.275651 Aug 27 21:08:14.487493 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2110/4354] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:14 2022] POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:08:14.497325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:14.498048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:14.507527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.508440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.508891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.509745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.510158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.510852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.592320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2827fb93-9df6-4c91-988c-6ab7ae408713 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 204 len: 0 microversion: 2.1 time: 0.214737 Aug 27 21:08:14.592977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2245/4355] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:14 2022] DELETE /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:08:14.599537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4844258-0aac-4f08-9567-7103744b764f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '.version_select at 0x7ff84e57bca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:14.630233 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4844258-0aac-4f08-9567-7103744b764f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730367766" status: 202 len: 0 microversion: 2.1 time: 0.035486 Aug 27 21:08:14.631039 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2246/4356] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730367766 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:08:14.635673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:14.636271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:14.643591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.644489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.644489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:14.645198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:14.645820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:14.646421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.107704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.117071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.125872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.127943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.129470 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3730f04d-00e9-4843-a347-426ea75dba71 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.640783 Aug 27 21:08:15.131967 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6456fdd-b6b1-457d-bb60-d8898f903b3a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.499617 Aug 27 21:08:15.132806 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2247/4357] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:14 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:15.143746 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2111/4358] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:14 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:15.150828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:15.151477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:15.157838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:15.158329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:15.158762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.159791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:15.160251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:15.160674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.328475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:15.329263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:15.343934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:15.344543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:15.345366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.346314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:15.347032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:15.347672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.583451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.599392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5dc9977d-2a88-4d0d-8d0c-44a36fa05dba tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1498 microversion: 2.1 time: 0.454173 Aug 27 21:08:15.600247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2112/4359] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:15 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1498 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:15.605588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "tag": "b5414c2c-a41b-4574-bbaa-f52411d09c65"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:15.631280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:15.636026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:15.636530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:15.636974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:15.649411 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-832be01b-9581-460c-ab6e-11ade67699ba tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.331193 Aug 27 21:08:15.650031 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2248/4360] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:15 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:15.677214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] Creating event network-changed:b5414c2c-a41b-4574-bbaa-f52411d09c65 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:08:15.689569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-47f8cbfc-40b8-4fc7-bdbc-3d0fa1c9a304 req-4b33d724-5436-4e6e-9c32-27d2fdd69428 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086851 Aug 27 21:08:15.691646 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2113/4361] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:16.158355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:16.159468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:16.160064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:16.161467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:16.171409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.172043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.173617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.173998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.176865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.177541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.178525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.179240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.179894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.180697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.181247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.181694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.495560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:16.512624 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2678a7aa-cd1f-47c7-9758-759e7f485d35 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.360202 Aug 27 21:08:16.513420 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2249/4362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:16 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:16.536853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44e45e2f-b6a4-4296-8faf-bd39b447a849 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: .version_select at 0x7ff84e57bca0>, body: {"keypair": {"name": "tempest-keypair-223556278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIhpBLMKnUwYZvDxNTS0nHWIARztV+sRYtCBWgl2LpR5oaYlsRpfNbfqIBNHJ6D+f8m2drNKJKBTVKv5Uk9UgpshqCU2SYfRUOWld146+IxRaHV7j74QlY58eyD8uEurQ=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:16.543728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:16.555180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-44e45e2f-b6a4-4296-8faf-bd39b447a849 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:08:16.555385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:16.557052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:16.558428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23756d35-e57b-427c-b16d-8a58b91fd6c0 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.405180 Aug 27 21:08:16.559036 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2114/4363] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:16 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:16.566439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-44e45e2f-b6a4-4296-8faf-bd39b447a849 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:08:16.600492 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44e45e2f-b6a4-4296-8faf-bd39b447a849 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067612 Aug 27 21:08:16.601225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2250/4364] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:08:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:08:16.623527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:16.624725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:16.640027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.640804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.643141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.644570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.645195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.646187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.672973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:16.674035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:16.686765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.690918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.691761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.692814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:16.693665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:16.695303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:16.957392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:16.969397 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-212d2fb2-1539-43ab-a107-cc3147b68793 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1498 microversion: 2.1 time: 0.349921 Aug 27 21:08:16.970235 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2115/4365] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:16 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:17.079870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:17.107941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7b85d9b-75b0-4a0a-9d08-f6fb29b599cd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.439252 Aug 27 21:08:17.108754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2251/4366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:16 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:17.543829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:17.545068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:17.561470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:17.562041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:17.563379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:17.564378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:17.565074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:17.565977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:17.584786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:17.585721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:17.599834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:17.600347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:17.600802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:17.601522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:17.602191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:17.602393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:17.842718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:17.851968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4efff3e-e923-4f4c-8420-cbdeb35b18ed tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.319136 Aug 27 21:08:17.866575 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2116/4367] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:17 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:17.866575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d257e17-bbd3-4bb6-88df-61528caa2563", "name": "network-vif-deleted", "tag": "1ddf6b67-2cb2-4120-b82e-409cd4f4e849"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:17.899606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:17.900824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:17.902138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:17.919584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] Creating event network-vif-deleted:1ddf6b67-2cb2-4120-b82e-409cd4f4e849 for instance 0d257e17-bbd3-4bb6-88df-61528caa2563 on nch2-master-1 Aug 27 21:08:17.926752 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bd85c05c-73b2-4a59-a94e-04709273ea50 req-6b8efa13-74c7-4483-8a03-099923b0c518 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069079 Aug 27 21:08:17.927817 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2117/4368] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:17.991690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:17.998280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:18.007527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.008269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.008904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.009925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.010382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.010826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.034054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:18.049253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:18.051391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:18.053493 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0caa748-cde3-4ac6-9352-c5c49a916b38 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.475097 Aug 27 21:08:18.054599 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2252/4369] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:17 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:08:18.069438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.070516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.070983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.071580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lazy-loading 'fault' on Instance uuid 0d257e17-bbd3-4bb6-88df-61528caa2563 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:08:18.131887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:18.132516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:18.140941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.141451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.141927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.142614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.143070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.144200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.162936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7169b8b3279c43c9a4097d6e42d2f1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fff748616a34a7db41745e7d9340353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:18.179671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e04865b-d220-4f5a-be77-71d2baefefcf tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 200 len: 1304 microversion: 2.1 time: 0.192866 Aug 27 21:08:18.193952 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2118/4370] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:17 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:18.665077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:18.674468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a134deee-908f-4e27-9a8a-80e3b44facc0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.548529 Aug 27 21:08:18.675306 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2253/4371] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:18 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:18.873094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:18.873725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:18.880867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.881558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.882149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.882994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:18.883620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:18.884046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:18.915214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-428997555", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b51e83b-3888-45e9-b028-18277f96139f"}], "security_groups": [{"name": "tempest-securitygroup--1025339388"}], "key_name": "tempest-keypair-223556278", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:19.077924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] validate_networks() for [('3b51e83b-3888-45e9-b028-18277f96139f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:08:19.079458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:19.099411 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c83710f1-c80f-48ee-8e7a-f725dc82a772 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.230070 Aug 27 21:08:19.112686 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2119/4372] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:18 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:19.122547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:19.123381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:19.127901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:19.132772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.133934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.134725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.135738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.136374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.136953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.510080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:19.525646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:19.527088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:19.528290 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-449e9b77-5831-42af-94b7-24699ddc6665 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.414095 Aug 27 21:08:19.528862 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2120/4373] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:19 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:19.533789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "bf58ee0e-25fd-4e17-aed4-84919edde433"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:19.543726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.544443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.545038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.562593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] Creating event network-vif-plugged:bf58ee0e-25fd-4e17-aed4-84919edde433 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:19.571224 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-48228946-2c2f-49a1-b388-dab459ba3dd0 req-4fc42f97-7e07-47e7-ac52-7f2a9f35c681 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040334 Aug 27 21:08:19.572241 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2121/4374] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:19.706823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:08:19.707409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:08:19.708071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:08:19.708484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:08:19.708898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:08:19.723685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.725485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.726015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.727718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.728400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.728867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.750194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:08:19.756104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:08:19.772382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:08:19.775414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:08:19.827725 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aed8ce8b-36c3-4efd-9c12-5684b8bd2132 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917343 Aug 27 21:08:19.829023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2254/4375] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:08:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:08:19.834225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:19.835010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:19.842788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.843589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.844172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.845053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.845815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.846478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.873839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:19.956667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:19.957404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:19.980581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.981039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.981511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:19.982235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:19.986570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:19.987209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.022860 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 HTTP/1.1 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '0d257e17-bbd3-4bb6-88df-61528caa2563'} Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.025299 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.030014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.035183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.035994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6941b3e-4656-4c51-a2e3-bf2e73d0445c tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 404 len: 111 microversion: 2.1 time: 0.459361 Aug 27 21:08:20.044836 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2122/4376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:19 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 111 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.054789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d81738a-41f2-48f3-b6d8-3d6eb18709d9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.057905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d81738a-41f2-48f3-b6d8-3d6eb18709d9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.116876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.130750 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-543b8a14-d292-4c05-9fcd-1998436efe86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.300459 Aug 27 21:08:20.132623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2255/4377] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:19 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:20.138413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.139150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.146781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.147615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.148330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.149998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.150659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.151963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.162119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d81738a-41f2-48f3-b6d8-3d6eb18709d9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.173505 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d81738a-41f2-48f3-b6d8-3d6eb18709d9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1240 microversion: 2.1 time: 0.127499 Aug 27 21:08:20.176208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2123/4378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:20.186820 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.194245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.195275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 HTTP/1.1 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0d257e17-bbd3-4bb6-88df-61528caa2563'} Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.206835 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.211215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.212077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.212077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.212077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.212077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.212400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.212483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.212483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.215990 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6789e30-9332-428e-a407-99f9bc8415bb tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 404 len: 111 microversion: 2.1 time: 0.082043 Aug 27 21:08:20.223670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2256/4379] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:20 2022] DELETE /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.233551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.234176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 0d257e17-bbd3-4bb6-88df-61528caa2563] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.241242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.241794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.242150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.242861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.243321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.243794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.262445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 HTTP/1.1 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0d257e17-bbd3-4bb6-88df-61528caa2563'} Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.264244 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. Aug 27 21:08:20.268815 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.270139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 0d257e17-bbd3-4bb6-88df-61528caa2563 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.271263 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6838dd4f-7292-4e90-a0ee-eed6c4451d1d tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563" status: 404 len: 111 microversion: 2.1 time: 0.043122 Aug 27 21:08:20.272365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2257/4380] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/0d257e17-bbd3-4bb6-88df-61528caa2563 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.281042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.281998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.290916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.291733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.292366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.293284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.323905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.324402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.359201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa HTTP/1.1 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '08af7293-d682-4778-b885-31467d65e8fa'} Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.364670 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.368158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.369560 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-00db895e-70fd-49fb-a0e5-132fca073b14 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 404 len: 111 microversion: 2.1 time: 0.093001 Aug 27 21:08:20.373536 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2258/4381] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:20 2022] DELETE /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.390442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.391138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 08af7293-d682-4778-b885-31467d65e8fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.403068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.403595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.404035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.409609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.410114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.410541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.443069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa HTTP/1.1 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '08af7293-d682-4778-b885-31467d65e8fa'} Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.446916 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. Aug 27 21:08:20.452274 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.453395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.453799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 08af7293-d682-4778-b885-31467d65e8fa could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.455104 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6889908-0678-45fc-ae7b-677c6f17d746 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa" status: 404 len: 111 microversion: 2.1 time: 0.076163 Aug 27 21:08:20.456071 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2259/4382] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/08af7293-d682-4778-b885-31467d65e8fa => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.466881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.467604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.468386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-83db7136-1b87-446b-bf45-885bc930507e tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.289346 Aug 27 21:08:20.471444 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2124/4383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:20.499185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.501120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.501700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.502616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.503289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.503829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.525049 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 HTTP/1.1 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '2b8cc0de-cc27-4f8d-8b5c-610432b437c7'} Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.526629 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c927998-7a88-4d6e-96eb-f24bb5e2c51e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 404 len: 111 microversion: 2.1 time: 0.067911 Aug 27 21:08:20.530117 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2260/4384] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:20 2022] DELETE /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:08:20.538457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.539464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 2b8cc0de-cc27-4f8d-8b5c-610432b437c7] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.547544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.547544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.547544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.548001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.548663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.549391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.555591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.555688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.566949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.567602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.568179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.569079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.569725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.570781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.574257 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 HTTP/1.1 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '2b8cc0de-cc27-4f8d-8b5c-610432b437c7'} Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.576195 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. Aug 27 21:08:20.579718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.582399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 2b8cc0de-cc27-4f8d-8b5c-610432b437c7 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.583582 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f49c856-5a58-46cf-aa88-a82cfc6eff3a tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7" status: 404 len: 111 microversion: 2.1 time: 0.050300 Aug 27 21:08:20.586168 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2125/4385] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/2b8cc0de-cc27-4f8d-8b5c-610432b437c7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.603326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.603737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.621592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.625420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.626120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.627831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.628790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.630024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.660143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 HTTP/1.1 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4a807372-5608-40dd-aaac-1a93480a4911'} Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.661739 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8bc6923-bcd7-4daa-92b2-786b187aec89 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 404 len: 111 microversion: 2.1 time: 0.069206 Aug 27 21:08:20.669490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2126/4386] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:20 2022] DELETE /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.671667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.672299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 4a807372-5608-40dd-aaac-1a93480a4911] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.679006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.679548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.680176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.681037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:20.681668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:20.682105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:20.698250 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 HTTP/1.1 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4a807372-5608-40dd-aaac-1a93480a4911'} Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.700008 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 4a807372-5608-40dd-aaac-1a93480a4911 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d6bc38b-ae61-4482-af65-06714ce0abf4 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911" status: 404 len: 111 microversion: 2.1 time: 0.033568 Aug 27 21:08:20.704585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2127/4387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/4a807372-5608-40dd-aaac-1a93480a4911 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.720405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.721062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.729637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae HTTP/1.1 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '72bdbb8c-8d8c-463a-b92a-efa874daaeae'} Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.731318 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.736003 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-53902f9d-fe02-48f8-9aaf-8f91bd5e0e99 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae" status: 404 len: 111 microversion: 2.1 time: 0.020021 Aug 27 21:08:20.737500 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2128/4388] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:20 2022] DELETE /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.748223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:20.748859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 72bdbb8c-8d8c-463a-b92a-efa874daaeae] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:20.759179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae HTTP/1.1 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '72bdbb8c-8d8c-463a-b92a-efa874daaeae'} Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:20.761199 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:20.765497 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:20.765497 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:20.765497 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:20.765497 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. Aug 27 21:08:20.765497 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:20.767676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 72bdbb8c-8d8c-463a-b92a-efa874daaeae could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:20.769500 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62e42bb6-f1e8-47e4-9b0b-9325f9da251b tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae" status: 404 len: 111 microversion: 2.1 time: 0.028163 Aug 27 21:08:20.771150 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2129/4389] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/72bdbb8c-8d8c-463a-b92a-efa874daaeae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:20.810117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.823716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.825179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:20.826389 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14a37ead-1922-41b0-8aaa-dce9a008e227 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.277324 Aug 27 21:08:20.826960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2261/4390] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:20 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:21.197142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:21.197945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.205923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.207018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.207592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.209843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.210697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.211441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.298610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:21.308237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dee6030e-aae8-4629-a576-b21551a5de43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1292 microversion: 2.1 time: 0.115762 Aug 27 21:08:21.309603 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2262/4391] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:21 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:21.424892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:21.425524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.435680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.436189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.436638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.437357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.437823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.438259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.494864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:21.495517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.497843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:21.509461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.511287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.513840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.514825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.515549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.519525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.721475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:21.727697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:21.733994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a636bf2d-ba2d-46ca-80aa-573ad5598121 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.581988 Aug 27 21:08:21.734729 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2130/4392] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:21 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:21.740109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-23fc778e-f6fd-42a6-bc59-88b1564124b6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.249164 Aug 27 21:08:21.741235 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2263/4393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:21 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:21.741991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:21.744847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.746307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "67f19a86-603d-4bab-a4a6-423eff11c128"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "8920ecf1-3b0c-468b-b59b-00b35de15f40"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "05231cba-c36e-4c03-a60c-8cf5d1759c75"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "2a4186d6-29e8-478d-abea-bf22cee0b380"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:21.760338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.761132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.761685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.761822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.762174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.762439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.762615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.762887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.763887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.776487 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Creating event network-vif-plugged:67f19a86-603d-4bab-a4a6-423eff11c128 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:21.776994 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Creating event network-vif-plugged:8920ecf1-3b0c-468b-b59b-00b35de15f40 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:21.777491 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Creating event network-vif-plugged:05231cba-c36e-4c03-a60c-8cf5d1759c75 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:21.778011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] Creating event network-vif-plugged:2a4186d6-29e8-478d-abea-bf22cee0b380 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:21.784301 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-79d3c736-8ae0-4b80-88aa-f7d787cb2285 req-3a9f998b-0178-4a93-a3d8-5098fd11badf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041518 Aug 27 21:08:21.785190 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2264/4394] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:21.836554 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56de46d6-afe6-42f0-a396-159f69b5d25a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1/action" status: 200 len: 24571 microversion: 2.1 time: 0.100036 Aug 27 21:08:21.837504 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2131/4395] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:21 2022] POST /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1/action => generated 24571 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:08:21.853169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:21.854036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.863816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.864558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.864826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.865582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.866016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.866477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.969451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:21.970181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:21.977873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.978367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.979025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.979795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:21.980438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:21.980868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:21.998239 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e HTTP/1.1 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '32784941-4174-482b-87e3-c3b4addfb06e'} Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:21.999970 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20636d80-c922-4101-940d-bcfee46c896f tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 404 len: 111 microversion: 2.1 time: 0.036650 Aug 27 21:08:22.004170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2132/4396] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:21 2022] DELETE /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:08:22.013036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.013666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 32784941-4174-482b-87e3-c3b4addfb06e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.025472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.025979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.026401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.027816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.028412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.028841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.043927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e HTTP/1.1 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '32784941-4174-482b-87e3-c3b4addfb06e'} Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.045513 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 32784941-4174-482b-87e3-c3b4addfb06e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0a4cc369-af52-455e-90a3-9f6a58dd5c6e tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e" status: 404 len: 111 microversion: 2.1 time: 0.040533 Aug 27 21:08:22.048988 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2133/4397] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:22 2022] GET /compute/v2.1/servers/32784941-4174-482b-87e3-c3b4addfb06e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:22.056095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.056611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.063542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.064045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.064492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.065326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.065856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.066291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.078291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:22.081669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 HTTP/1.1 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '46927de4-b187-4263-a9f2-7dde0b552ac6'} Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:22.083308 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa5b55c1-f51f-4298-b73f-a1181f8f8e88 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "DELETE /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 404 len: 111 microversion: 2.1 time: 0.032566 Aug 27 21:08:22.086860 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2134/4398] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:22 2022] DELETE /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:22.092978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:22.093558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.094181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] [instance: 46927de4-b187-4263-a9f2-7dde0b552ac6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.094688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:22.096004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f600fcc6-6233-4b42-ac22-927279210645 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.247993 Aug 27 21:08:22.096674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2265/4399] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:21 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.103694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.117795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] HTTP exception thrown: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Request method failure captured: Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 HTTP/1.1 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaXl2sAXxoTQK9s3KEG-dL5n3QCddekVICklkuRcMlXXdiZZ__9IhuXE9yRJkbrDH5goRDkdmla01OzbJUnA3luRMQXtii6_jZiUZnvLyhzZm1l32RPuZ4-jiotnlGHPNcRlH60m0qqi44hsYZgL5xG5wsESvjZxKnwtiXaNvz4CD4 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1fff748616a34a7db41745e7d9340353"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1fff748616a34a7db41745e7d9340353", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1fff748616a34a7db41745e7d9340353"}]}] Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1fff748616a34a7db41745e7d9340353 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1482281639 Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7169b8b3279c43c9a4097d6e42d2f1eb Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1482281639-project Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '46927de4-b187-4263-a9f2-7dde0b552ac6'} Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:22.119383 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] Returning 404 to user: Instance 46927de4-b187-4263-a9f2-7dde0b552ac6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:22.123572 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f75d689-7640-43cc-973f-0f2070891185 tempest-DeleteServersTestJSON-1482281639 tempest-DeleteServersTestJSON-1482281639-project] 10.222.0.40 "GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6" status: 404 len: 111 microversion: 2.1 time: 0.031384 Aug 27 21:08:22.124956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2135/4400] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:22 2022] GET /compute/v2.1/servers/46927de4-b187-4263-a9f2-7dde0b552ac6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:08:22.330035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.331941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.342997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.343540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.343989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.348737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.349239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.351028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.701152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:22.710301 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2dc9d51a-9bd7-423e-8881-8c9d3d4b9152 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.384182 Aug 27 21:08:22.711790 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2266/4401] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:22 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:22.764892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.765558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:22.765673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.766621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:22.777669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.778601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.779571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.780023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.780400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.781420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.782392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.783621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:22.784278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.784734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:22.785008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:22.785610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.134715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.137466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:23.142898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.148076 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5e4a944-8df6-4c6f-909a-97b22cfa56fb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.388786 Aug 27 21:08:23.153553 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2136/4402] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:22 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:23.158901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:23.164913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:23.167307 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-635ccff7-520e-457f-9d67-0159c34e67cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.405068 Aug 27 21:08:23.168032 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2267/4403] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:22 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:23.175732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.176492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.177091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.177965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.178628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.179052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.253696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848c4479-c568-4e24-b2f0-692592658735", "tag": "1214c1e3-8b25-4a36-a919-a1388fb450a3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:23.267372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.268379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.269197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.298396 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] Creating event network-changed:1214c1e3-8b25-4a36-a919-a1388fb450a3 for instance 848c4479-c568-4e24-b2f0-692592658735 on nch2-master-1 Aug 27 21:08:23.317492 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d16bed2a-3496-4fbf-a5bd-3d11ec5d8840 req-9cdbf92f-7443-4cc9-a9f9-35b1940bf061 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068373 Aug 27 21:08:23.318551 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2268/4404] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:23.529418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.539953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.541636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.542825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68dbc762-4975-4dd8-b9a4-12c38ef2abc9 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.388205 Aug 27 21:08:23.553788 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2137/4405] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:23 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:23.734913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:23.735846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:23.748908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.749696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.750313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.751301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.752232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.752690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.803170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "1928081a-e18a-40a9-8c32-f6a165d48e48"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-plugged", "status": "completed", "tag": "ba8c1011-8a54-4d65-b018-67dd534862a4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:23.815533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:23.816120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:23.816630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:23.830031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Creating event network-vif-plugged:1928081a-e18a-40a9-8c32-f6a165d48e48 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:23.830861 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] Creating event network-vif-plugged:ba8c1011-8a54-4d65-b018-67dd534862a4 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:23.838512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b0b37ceb-f864-4915-b97b-fe1c559c3924 req-bceec12c-638b-4175-b524-e04efe9ba71e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039219 Aug 27 21:08:23.840109 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2138/4406] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:08:23.973935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:23.985268 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d21e8a81-98b0-4c92-a0ca-e34575afbf79 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.255206 Aug 27 21:08:23.986501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2269/4407] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:23 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:24.173280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:24.174041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:24.186283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.187156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.187869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.188942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.189928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.191261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.194131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:24.194753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:24.208154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.209550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.210293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.211423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.212324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.212993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.590637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:24.600684 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97581a81-0704-457c-8586-0bb616334360 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.410168 Aug 27 21:08:24.602272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2270/4408] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:24 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:24.606483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:24.618338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a81d73e8-ecca-4945-a098-b0f4bcde3285 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.449896 Aug 27 21:08:24.620288 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2139/4409] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:24 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:24.623460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:24.623568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:24.633664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.634210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.634805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.636199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:24.636673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:24.637308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:24.903323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:24.913705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:24.915146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:24.916353 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b01cff6-f61d-4544-9702-5bd6231d7398 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.304224 Aug 27 21:08:24.916935 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2271/4410] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:24 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:25.019846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:25.021097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:25.027820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.028288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.028989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.029713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.030153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.031009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.185478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:25.193969 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fbdec92e-dff2-4dde-8e63-12055ce9b6f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.179417 Aug 27 21:08:25.194550 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2140/4411] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:25 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:25.624308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:25.625490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:25.632729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.633438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.633654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.634354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.634813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.635333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.644559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:25.645179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:25.656033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.656536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.657182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.658199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.659392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.660007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.868230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:25.876265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c2b5224-2d4b-41d2-a7ae-86bbbec6619b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.236438 Aug 27 21:08:25.876265 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2141/4412] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:25 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:25.892634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:25.903172 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d109a14-803b-4f96-99a5-c15bc98903bc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.282849 Aug 27 21:08:25.903817 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2272/4413] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:25 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:25.944757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:25.945540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:25.951949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.952684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.953098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:25.961632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:25.967830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:25.968511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.216037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:26.216956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:26.226734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.227669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.228474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.229416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.230046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.230642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.257183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:26.272404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:26.275126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:26.280889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b67416a5-de86-4aa2-b8ee-395e0fce6aeb tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1878 microversion: 2.32 time: 0.342280 Aug 27 21:08:26.285957 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2142/4414] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:25 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1878 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:26.875723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:26.884756 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-69879f4f-cb03-4bb6-950d-381940fb9091 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.673460 Aug 27 21:08:26.896323 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2273/4415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:26 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:26.898497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:26.899126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:26.909402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.909913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.910364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.911142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.912016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.912608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.924695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:26.925575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:26.935223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.944146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.945234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:26.946432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:26.947112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:26.948286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.249405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:27.258742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f7f442cf-9210-4d82-a54e-5778be3a21b7 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.364537 Aug 27 21:08:27.263695 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2143/4416] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:26 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:27.278952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:27.294576 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b444cf58-3b86-418d-9ba0-d3139921c2af tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.373820 Aug 27 21:08:27.308147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:27.309308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:27.310206 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2274/4417] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:26 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:27.321024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.321663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.322424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.323155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.323656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.325175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.650051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:27.660888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:27.662335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:27.663609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7023b83-941c-4b25-a52f-98835169cd4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2831 microversion: 2.32 time: 0.361302 Aug 27 21:08:27.664239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2144/4418] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:08:27 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2831 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:27.695647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:27.696289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:27.703145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.703875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.704319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.705034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.706115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.706560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.853349 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05e4449a-1ab9-4982-b279-63bb95f5feac tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.161713 Aug 27 21:08:27.854083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2275/4419] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:08:27 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45/os-interface => generated 1832 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:08:27.908605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:27.909564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:27.918377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.918916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.919441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:27.920198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:27.921781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:27.922379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:28.189878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:28.198641 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9c38111-e55f-497c-b3ac-ed4ff97eae72 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.294730 Aug 27 21:08:28.199546 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2145/4420] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:27 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:28.283282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:28.286155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:28.299836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:28.301086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:28.301701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:28.302740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:28.303680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:28.304272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:28.318557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:28.320570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:28.337422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:28.338175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:28.338625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:28.339947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:28.340654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:28.341175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:28.604324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:28.632065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa58cec5-c3ca-4306-afc2-c9c7e12eb5bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.354290 Aug 27 21:08:28.632680 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2276/4421] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:28 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:28.743964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:28.769884 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-82b26161-5390-45e2-9fa2-1a5acdeac382 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.444228 Aug 27 21:08:28.773947 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2146/4422] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:28 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:29.222371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:29.223250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:29.235204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.240064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.240911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.242110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.248991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.249733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.255034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:29.344145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "tag": "8920ecf1-3b0c-468b-b59b-00b35de15f40"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:29.361923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.364542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.365247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.390818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] Creating event network-changed:8920ecf1-3b0c-468b-b59b-00b35de15f40 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:08:29.402163 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b7a7362c-9efc-43b1-9c5b-0be2e2ee979a req-653fbf7c-5f5c-46b1-bdbd-e67914d9c4c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061803 Aug 27 21:08:29.403411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2147/4423] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:08:29.596015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:29.605794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb10539c-fe09-4d47-903d-a4e97f621e1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.388718 Aug 27 21:08:29.624745 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2277/4424] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:29 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:29.658501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:29.659515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:29.667124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.667892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.668700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.669573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.670176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.670828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.794481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:29.795105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:29.802221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:29.803620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=10 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:29.805824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.806506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.807149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:29.808081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:29.809219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:29.809824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:30.033269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:30.045730 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c7265b3-bade-4b7a-919e-9ea548bfdfc4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.392902 Aug 27 21:08:30.046495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2148/4425] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:29 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:30.152849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:30.162564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27b39490-02fe-4a5f-8d14-c470ae705620 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.372016 Aug 27 21:08:30.163225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2278/4426] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:29 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:30.632447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:30.633088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:30.635459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:30.648934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:30.649442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:30.649895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:30.651321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:30.651810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:30.652253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:30.949373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:30.962020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27021505-d08f-49b8-94e6-8af466347cf0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.333403 Aug 27 21:08:30.963876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2149/4427] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:30 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:31.020733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848c4479-c568-4e24-b2f0-692592658735", "name": "network-vif-plugged", "status": "completed", "tag": "1214c1e3-8b25-4a36-a919-a1388fb450a3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:31.048374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.048910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:31.051088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:31.074987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] Creating event network-vif-plugged:1214c1e3-8b25-4a36-a919-a1388fb450a3 for instance 848c4479-c568-4e24-b2f0-692592658735 on nch2-master-1 Aug 27 21:08:31.077968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:31.079774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:31.081110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4210d7b6-250a-49e8-a9a1-901fb2c04afa req-b66b7dcd-af8e-4e75-abf9-219cd0730e02 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064642 Aug 27 21:08:31.082446 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2279/4428] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:31.091001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.091692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:31.092694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:31.093878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.094450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:31.095235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:31.186104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:31.186830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:31.201471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.201795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:31.203438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:31.204125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.204601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:31.207807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:31.403380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:31.424533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-69564aeb-0e78-465f-98fd-11fc68cf5ea6 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.348116 Aug 27 21:08:31.425870 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2150/4429] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:31 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:31.539142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:31.550895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95472ef6-311c-49f7-b452-1f1a1024d066 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.370415 Aug 27 21:08:31.552155 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2280/4430] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:31 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:31.985485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:31.987875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:31.998444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:31.999489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.000012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.001175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:32.002024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.002999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.449627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:32.451064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:32.469004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:32.469797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.470406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.471793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:32.472632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.473225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.750616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:32.761800 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f5b58e5-80b3-4195-a7fd-8abdf584889e tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1366 microversion: 2.1 time: 0.780447 Aug 27 21:08:32.765589 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2151/4431] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:31 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1366 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:32.771511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:32.772339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:32.790674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:32.794698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.800823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.807692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:32.808503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:32.809112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:32.857670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:32.870068 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e82d9460-eb7c-44b1-8bab-665a600aa22f tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.424300 Aug 27 21:08:32.871323 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2281/4432] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:32 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:33.100277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:33.111186 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8bd493d7-7c01-4a25-a124-92e01b2d3e6d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.344149 Aug 27 21:08:33.112311 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2152/4433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:32 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:33.789981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:33.791606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:33.799995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:33.802078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:33.806601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:33.810058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:33.811016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:33.812127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:33.894015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:33.897326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:33.919318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:33.920103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:33.920654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:33.921607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:33.924032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:33.925205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:34.125475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:34.140045 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e171acc1-5a15-4be4-9fd3-89f2692e6c09 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1555 microversion: 2.1 time: 0.359738 Aug 27 21:08:34.153621 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2282/4434] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:33 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1555 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:34.167446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:34.168754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:34.184948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:34.186589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:34.187627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:34.188903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:34.189627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:34.190323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:34.272903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:34.284447 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d27f0092-f74c-4d81-90a9-f5e5c282bed0 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1732 microversion: 2.1 time: 0.395459 Aug 27 21:08:34.303515 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2153/4435] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:33 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1732 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:34.313632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:34.328920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:34.344863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:34.346752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:34.349889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:34.350886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:34.351543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:34.353921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:34.536463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26e33d43-f580-4147-bc46-65a0ee0f532c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231447 Aug 27 21:08:34.537071 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2154/4436] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:08:34 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:34.574715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:34.604519 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2401cea-bd1f-4b47-9399-3617306ef90c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.449697 Aug 27 21:08:34.606039 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2283/4437] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:34 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:35.307461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:35.308852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:35.321985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.322736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.323154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:35.324096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.332282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.334002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:35.339477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:35.585438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:35.596983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb7f8017-4853-4d8b-800a-98830ff66395 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1712 microversion: 2.1 time: 0.293934 Aug 27 21:08:35.597812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2155/4438] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:35 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1712 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:35.636575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:35.638216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:35.662236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.663793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.666569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:35.669041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.671404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.672956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:35.818983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:35.819606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:35.827020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.827984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.828650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:35.829627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:35.830332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:35.830976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:36.021831 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Cannot 'detach_volume' instance 652b2888-c2e3-425c-afdc-0d209b09f16c while it is in vm_state rescued Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments/954fbcb2-8e60-468a-8fb4-ab2f508f825d HTTP/1.1 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'detach_volume' instance 652b2888-c2e3-425c-afdc-0d209b09f16c while it is in vm_state rescued Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': '652b2888-c2e3-425c-afdc-0d209b09f16c', 'id': '954fbcb2-8e60-468a-8fb4-ab2f508f825d'} Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 652b2888-c2e3-425c-afdc-0d209b09f16c while it is in vm_state rescued Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:36.023794 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 652b2888-c2e3-425c-afdc-0d209b09f16c while it is in vm_state rescued Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 409 to user: Cannot 'detach_volume' instance 652b2888-c2e3-425c-afdc-0d209b09f16c while it is in vm_state rescued {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:36.027457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7658ee84-b190-4855-bf07-5eab10403113 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments/954fbcb2-8e60-468a-8fb4-ab2f508f825d" status: 409 len: 152 microversion: 2.1 time: 0.211288 Aug 27 21:08:36.033394 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2156/4439] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:08:35 2022] DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments/954fbcb2-8e60-468a-8fb4-ab2f508f825d => generated 152 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:08:36.042882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:36.043485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:36.054532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:36.054532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:36.065750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:36.066578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:36.068044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:36.070311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:36.072800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:36.097992 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75e1bbd8-ec76-4d8d-9f7b-5f7d89dde35c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.474274 Aug 27 21:08:36.101780 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2284/4440] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:35 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:36.217419 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed6ceec4-c434-41ae-bb7f-5d76461b72b5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/action" status: 202 len: 0 microversion: 2.1 time: 0.182153 Aug 27 21:08:36.218096 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2157/4441] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:36 2022] POST /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:08:36.229275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:36.232358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:36.250379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:36.251586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:36.252101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:36.253217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:36.255647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:36.257004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:36.514149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:36.533383 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-993d0df8-b652-4149-a610-5b85ee3b8de4 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1720 microversion: 2.1 time: 0.310120 Aug 27 21:08:36.534115 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2285/4442] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:36 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:36.938779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1450329770", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "7011f3ea-b4c5-4328-b58c-77ff113168c5"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:37.008764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] validate_networks() for [('7011f3ea-b4c5-4328-b58c-77ff113168c5', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:08:37.125127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:37.128223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:37.141478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:37.146890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:37.148642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:37.149915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:37.151826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:37.152862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:37.529174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:37.554199 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-304f97f4-8441-4891-be51-5f313ad40c01 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.431889 Aug 27 21:08:37.556604 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2286/4443] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:37 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:37.577872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848c4479-c568-4e24-b2f0-692592658735", "tag": "1214c1e3-8b25-4a36-a919-a1388fb450a3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:37.609114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:37.609605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:37.610052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:37.651038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] Creating event network-changed:1214c1e3-8b25-4a36-a919-a1388fb450a3 for instance 848c4479-c568-4e24-b2f0-692592658735 on nch2-master-1 Aug 27 21:08:37.665020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-73fbeb2b-9fd4-4859-926b-706c24aa0799 req-af28665c-746b-49d3-b02f-2f44af598592 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096569 Aug 27 21:08:37.666692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2287/4444] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:37.676811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:37.684136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:37.694449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:37.695480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:37.696372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:37.697277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:37.697934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:37.698632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:38.069344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:38.085053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc71ffd3-b5e3-4c2f-a58f-aba50bf0614b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1720 microversion: 2.1 time: 0.416476 Aug 27 21:08:38.085662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2288/4445] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:37 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1720 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:38.148544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:08:38.149667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:08:38.150384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:08:38.150949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:08:38.152088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:08:38.195702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:38.196219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:38.196692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:38.197426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:38.197888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:38.198319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:38.260465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Getting quotas for project 05db9ac3826c4ec1aface1ab98b3d2bb. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:08:38.276145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Getting quotas for user a63319281f9e4cf9ba22673f25b42291 and project 05db9ac3826c4ec1aface1ab98b3d2bb. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:08:38.309525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:08:38.314100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:08:38.438663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92716b95-ef3a-4f06-9aca-f1eee1d81346 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670749 Aug 27 21:08:38.439377 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2158/4446] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:08:38.450864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-948f512c-fcbb-4abd-bc2e-4acf20410f15 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:38.452054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-948f512c-fcbb-4abd-bc2e-4acf20410f15 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:38.530402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-948f512c-fcbb-4abd-bc2e-4acf20410f15 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:38.543078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-948f512c-fcbb-4abd-bc2e-4acf20410f15 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1225 microversion: 2.1 time: 0.096446 Aug 27 21:08:38.544755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2289/4447] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:38 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:38.583551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:38.584522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:38.596401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:38.596958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:38.597509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:38.598696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:38.599798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:38.600448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:38.962084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:38.978756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6fa0026b-a24a-412e-acf8-6d726b389f1a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1511 microversion: 2.1 time: 0.401719 Aug 27 21:08:38.983575 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2159/4448] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:38 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:39.111712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:39.113187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:39.143016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:39.144020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:39.144221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:39.145061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:39.145670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:39.154819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:39.426001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:39.445671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b130ec71-6ca5-4bda-b2de-caea0d67639b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1720 microversion: 2.1 time: 0.338278 Aug 27 21:08:39.463104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2290/4449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:39 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1720 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:39.569142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:39.569802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:39.579673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:39.580562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:39.581132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:39.582638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:39.583378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:39.584017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:39.684644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:39.696316 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70b2528c-2096-4661-9dba-c83d5844d288 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1229 microversion: 2.1 time: 0.133621 Aug 27 21:08:39.704341 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2160/4450] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:39 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1229 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:40.007897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.008884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.017263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.018266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.018855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.019687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.020278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.021085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.203911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:40.216017 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4fcebf97-3309-4475-8ae3-64197b673927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1488 microversion: 2.1 time: 0.212820 Aug 27 21:08:40.216978 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2291/4451] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1488 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:40.241594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:40.256142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.264489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.265312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.265781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.266572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.267038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.269146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.469458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.470297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.478526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.479062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.479529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.480300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.480885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.481389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.493457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12e45697-dbd0-4bc8-b5a7-cc33cb3d604e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 200 len: 163 microversion: 2.1 time: 0.256068 Aug 27 21:08:40.501797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2161/4452] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:40 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 163 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:40.506808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.508018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.511070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:40.519376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.520012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.520554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.521416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.522030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.522637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.697027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:40.709537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e88589cf-5907-4c2a-9a02-95aa8670581a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1720 microversion: 2.1 time: 0.242468 Aug 27 21:08:40.716025 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2292/4453] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:40.721825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.723263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.731706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.732448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.733063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.733862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.734314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.734742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.736020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:40.744867 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e52e444c-8ac3-44e5-abac-f36c2811ae69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.244309 Aug 27 21:08:40.745587 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2162/4454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:40.773055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.774058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.780613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.781525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.782318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.783597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.784071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.784505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.808973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:40.820502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c0dc8ac-6303-47e2-821c-5d6b6fc399ba tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1221 microversion: 2.1 time: 0.102812 Aug 27 21:08:40.836220 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2293/4455] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:40.952381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:40.961723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78aa208d-d734-4683-b8b4-5b8ced27c192 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.192589 Aug 27 21:08:40.962363 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2163/4456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:40.983569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:40.984185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:40.990955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.991463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.991897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:40.992595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:40.993040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:40.993465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:41.234787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:41.247668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e932b9a-a9e7-4d49-ba06-473a5e2d6a33 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.268281 Aug 27 21:08:41.248273 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2294/4457] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:40 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:41.271733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:41.272365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:41.280490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:41.292446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:41.294687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:41.295648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:41.297614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:41.299604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:41.509351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:41.518866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0ab51da-9029-43e8-936c-7f34b892cc02 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.251821 Aug 27 21:08:41.520091 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2164/4458] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:41.660359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1224411056", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "f75aad2c-a76e-4365-abfb-15744ff8d972"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:41.734913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:41.735665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:41.739476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] validate_networks() for [('f75aad2c-a76e-4365-abfb-15744ff8d972', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:08:41.752216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:41.753804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:41.753804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:41.755425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:41.755968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:41.756933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.136562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:42.148803 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f0fcaef-805d-48c6-9d68-bd425f264996 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1726 microversion: 2.1 time: 0.418145 Aug 27 21:08:42.150990 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2165/4459] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:41 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1726 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:42.163788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:42.164737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:42.174961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.175876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.176670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.177860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.178599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.179116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.323049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:42.334871 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-31be0449-27fc-48dc-815e-663b8c3e8f90 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1283 microversion: 2.1 time: 0.182454 Aug 27 21:08:42.335945 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2166/4460] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:42 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:42.341345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:42.341917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:42.349783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.350916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.351625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.352660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.353382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.354000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.571385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7892c7b8-2158-4d5c-94e3-50036a51f729 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234092 Aug 27 21:08:42.573033 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2167/4461] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:08:42 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:42.921875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:08:42.922338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:08:42.923054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:08:42.923938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:08:42.924907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:08:42.939216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.940428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.941217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.942151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:42.942793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:42.943456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:42.968316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:08:42.976164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:08:42.995362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:08:42.999091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:08:43.074370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eed4a159-e644-42d9-8e74-b2bacebfef78 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418394 Aug 27 21:08:43.075717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2295/4462] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:08:43.087638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4efe98a0-3246-4c91-b9e8-3ae19b3aec08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:43.089039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4efe98a0-3246-4c91-b9e8-3ae19b3aec08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:43.206713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4efe98a0-3246-4c91-b9e8-3ae19b3aec08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:43.222654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4efe98a0-3246-4c91-b9e8-3ae19b3aec08 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1215 microversion: 2.1 time: 0.137841 Aug 27 21:08:43.241706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2168/4463] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:43 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:43.359950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:43.361183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:43.372252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:43.372766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:43.373266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:43.378709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:43.380389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:43.382031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:43.778598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:43.782860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:43.796120 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e2afa13-a5da-4caa-b3f0-780dea7178dd tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.441545 Aug 27 21:08:43.796949 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2296/4464] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:43 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:43.928521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:43.961819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:43.963615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:43.965146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:43.998404 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] Creating event network-changed:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:08:44.014382 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-55a424a7-703e-4e3d-bcd2-4c96cdc0d4b4 req-8c071209-fb4b-4d82-b297-46dad23355f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091382 Aug 27 21:08:44.019411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2169/4465] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:44.254061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:44.255606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:44.268943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:44.270008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:44.270649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:44.271763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:44.272556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:44.273994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:44.432412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:44.454882 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65934c8c-9e05-4bdf-9e42-ee1161ef5381 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1267 microversion: 2.1 time: 0.200753 Aug 27 21:08:44.455953 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2297/4466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:44 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:44.832651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:44.834390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:44.848398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:44.850184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:44.850843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:44.851908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:44.852705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:44.853322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:45.485021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:45.485860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:45.498039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:45.503606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:45.507521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:45.507521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:45.507521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:45.508536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:45.571571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:45.603968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f9d0518c-b2b3-42ec-8cbf-db1f9f37b942 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.781901 Aug 27 21:08:45.605514 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2170/4467] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:44 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:45.679698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc3276f-cdb5-4839-af5e-0d44a428779d", "tag": "639887e1-edf3-4f24-9d7c-7ecf40a2fccd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:45.707405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:45.708692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:45.713996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:45.716276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:45.720479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-144383c4-f325-4937-95a1-710fdfc92554 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1273 microversion: 2.1 time: 0.245217 Aug 27 21:08:45.722214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2298/4468] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:45 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:45.754709 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] Creating event network-changed:639887e1-edf3-4f24-9d7c-7ecf40a2fccd for instance fbc3276f-cdb5-4839-af5e-0d44a428779d on nch1-master-1 Aug 27 21:08:45.772795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2ecdb6e3-362a-4ff1-9aef-c1bba5757e58 req-aab4fb6d-0791-4b3a-b972-1bc2e8da9aa2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102391 Aug 27 21:08:45.774898 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2171/4469] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:46.044651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:46.062733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:46.063866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:46.065030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:46.089150 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] Creating event network-changed:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:08:46.103422 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8b53ca3e-bab5-4698-a9d5-0ec0d3b8c701 req-663344d2-4163-4c87-8738-fff357b79910 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066491 Aug 27 21:08:46.105457 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2299/4470] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:46.629046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:46.630468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:46.639228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:46.639826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:46.640469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:46.641176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:46.641795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:46.642406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:46.759952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:46.761692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:46.789555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:46.790583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:46.792333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:46.794941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:46.796422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:46.797139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:46.842799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:46.859639 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3f6846d-d3f8-4357-835b-0b664573d492 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.235867 Aug 27 21:08:46.860692 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2172/4471] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:46 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:46.985312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:46.995063 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8366f64e-eb55-4834-8074-35d7a5862479 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.252169 Aug 27 21:08:46.996164 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2300/4472] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:46 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:47.882733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:47.883468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:47.891871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:47.893181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:47.894061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:47.895008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:47.895521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:47.895955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:48.028634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:48.029248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:48.043318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:48.044159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:48.044965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:48.046006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:48.046747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:48.047475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:48.057756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:48.070306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d15a18a5-98f6-4529-820b-960942cf2a79 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.191596 Aug 27 21:08:48.070972 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2173/4473] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:47 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:48.148590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504bc862-6df4-47e1-a903-fb2d6a8c21b0", "tag": "85f316b0-706f-4175-99aa-bd7df7690ec3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:48.158811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:48.159047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:48.159490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:48.170799 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] Creating event network-changed:85f316b0-706f-4175-99aa-bd7df7690ec3 for instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 on nch2-master-1 Aug 27 21:08:48.176505 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3b3ecf72-197a-4dd0-8a18-cef92288eaf0 req-c68594a1-4ec0-477e-9b34-7360df477a9f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Aug 27 21:08:48.177135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2174/4474] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:08:48.207816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:48.216140 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-120157f6-3a3a-4ec3-9da8-aebfd5e8ce0e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.192980 Aug 27 21:08:48.216713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2301/4475] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:48 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:49.098328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:49.099040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:49.105222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:49.109289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:49.110244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:49.111056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:49.111833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:49.112299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:49.112879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:49.116813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:49.243887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:49.246677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:49.263133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:49.263765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:49.264239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:49.265146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:49.265767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:49.266419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:49.394450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:49.408084 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9718467c-9d19-4449-81a2-345c38069075 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.315047 Aug 27 21:08:49.409766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2175/4476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:49 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:49.447799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:49.455615 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09c2b6e0-d940-497b-8dbe-209ae796ccb2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.219641 Aug 27 21:08:49.456320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2302/4477] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:49 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:50.435243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:50.436012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:50.446526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:50.447378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:50.447733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:50.448404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:50.449054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:50.449593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:50.479852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:50.480576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:50.489190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:50.489753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:50.490175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:50.491096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:50.491643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:50.492087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:50.660723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:50.674389 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-85cda5a2-c967-4941-af0a-6672d7058ebe tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.243887 Aug 27 21:08:50.675175 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2176/4478] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:50 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:50.705803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:50.715990 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ef06571-998a-4f65-9952-e52bd75fdff3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.240582 Aug 27 21:08:50.716630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2303/4479] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:50 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:51.696353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:51.696978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:51.704104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:51.704583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:51.705023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:51.705702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:51.706200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:51.707139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:51.741415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:51.742053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:51.745157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:51.750695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:51.751122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:51.751595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:51.752319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:51.752757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:51.753962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:51.928781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:51.936675 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-afb724ea-8450-433f-8aa5-5e0d44b1e1a2 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.244570 Aug 27 21:08:51.937263 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2177/4480] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:51 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:51.953144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:51.961307 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4a9c300-385c-4aa2-8c5c-c30b0c32da55 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.225203 Aug 27 21:08:51.961940 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2304/4481] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:51 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:52.958855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:52.959423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:52.967984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:52.968527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:52.969037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:52.969789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:52.970398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:52.970887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:52.982542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:52.983767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:52.986926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:52.988273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:52.994973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:52.995790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:52.996238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:52.996948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:52.997777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:52.998316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:53.182815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:53.192570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07767a45-c310-4bb3-865f-c65198e0c444 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.238535 Aug 27 21:08:53.193591 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2178/4482] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:52 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:53.204805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:53.218515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bfc5ea75-7bdf-4cdb-b895-4beb1adf8e9e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.239524 Aug 27 21:08:53.218937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2305/4483] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:52 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:53.443601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc3276f-cdb5-4839-af5e-0d44a428779d", "name": "network-vif-plugged", "status": "completed", "tag": "639887e1-edf3-4f24-9d7c-7ecf40a2fccd"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:53.448967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:53.456020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:53.456471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:53.457247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:53.472473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] Creating event network-vif-plugged:639887e1-edf3-4f24-9d7c-7ecf40a2fccd for instance fbc3276f-cdb5-4839-af5e-0d44a428779d on nch1-master-1 Aug 27 21:08:53.478583 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-457cfa09-047b-43f3-8352-ff48a01b50a5 req-de8e79dd-1624-4a9c-8520-a1f0dc08abfa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039252 Aug 27 21:08:53.479704 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2179/4484] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:54.213697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:54.214370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:54.223227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:54.223816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:54.224332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:54.225171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:54.225682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:54.226256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:54.244261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:54.245128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:54.251997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:54.252611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:54.253191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:54.254109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:54.254700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:54.255310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:54.463383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:54.466966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:54.473332 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb505bf1-729b-48a7-837e-aac4f0d181c9 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1325 microversion: 2.1 time: 0.263571 Aug 27 21:08:54.474270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2306/4485] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:54 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:54.476565 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5c27e31-f510-4bc6-942d-7643198509d9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.238061 Aug 27 21:08:54.477232 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2180/4486] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:54 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:55.494843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:55.496356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:55.500800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:55.501494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:55.504599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.505168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.505616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.506345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.506804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.507461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.511378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.511843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.512490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.513237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.513700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.514210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.756940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:55.760546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:55.774116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d1d9bc1-3842-4e37-852b-8c918c3a6430 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1522 microversion: 2.1 time: 0.283324 Aug 27 21:08:55.777412 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17eb0607-c62c-4027-a1bd-7ee89a622b19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.281990 Aug 27 21:08:55.778854 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2181/4488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:55 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:55.781226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2307/4488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:55 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:55.783802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504bc862-6df4-47e1-a903-fb2d6a8c21b0", "name": "network-vif-plugged", "status": "completed", "tag": "85f316b0-706f-4175-99aa-bd7df7690ec3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:55.796403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:55.797168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:55.808121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.808588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.809067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.809781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.810233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.810660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.816907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.817421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.818117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.830728 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] Creating event network-vif-plugged:85f316b0-706f-4175-99aa-bd7df7690ec3 for instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 on nch2-master-1 Aug 27 21:08:55.840386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fbb95ce6-cf58-4b1e-9d1c-a16476e921ce req-3914c276-9efc-4219-a319-bfa7a2fe345e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059711 Aug 27 21:08:55.841000 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2182/4489] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:55.856707 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] HTTP exception thrown: Action 999 not found Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Request method failure captured: Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d/os-instance-actions/999 HTTP/1.1 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCofUcAiRtwvovlkKukyR2DuFsFwPz6KGRVp-oxK9lbAUbOgiX5ZgcBF_lyQOxeA1Qw7jZX2ADJSiS8zYDWl9R-VUfatqsbazvaCATpz8V1_gKF1wmumYayu8GOVjqwgExWhBAvY2LtCihYPaIKldP9O5YVOxQ-g_FJhkNzSTLhaiyhM Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_05db9ac3826c4ec1aface1ab98b3d2bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}] Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: a63319281f9e4cf9ba22673f25b42291 Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: exception: Action 999 not found Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'server_id': 'fbc3276f-cdb5-4839-af5e-0d44a428779d', 'id': '999'} Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 21:08:55.861152 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.865946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Returning 404 to user: Action 999 not found {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:55.866808 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25f2eb76-18b5-4704-857e-d21c9da7cbde tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.075749 Aug 27 21:08:55.867640 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2308/4490] 10.222.0.40 () {58 vars in 1308 bytes} [Sat Aug 27 21:08:55 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d/os-instance-actions/999 => generated 66 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:08:55.877935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '.version_select at 0x7ff857c7f8b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:55.878594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: 436a17be-5204-4049-83d0-a29252843481] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:55.885583 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] HTTP exception thrown: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Request method failure captured: Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/436a17be-5204-4049-83d0-a29252843481/os-instance-actions HTTP/1.1 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCofUcAiRtwvovlkKukyR2DuFsFwPz6KGRVp-oxK9lbAUbOgiX5ZgcBF_lyQOxeA1Qw7jZX2ADJSiS8zYDWl9R-VUfatqsbazvaCATpz8V1_gKF1wmumYayu8GOVjqwgExWhBAvY2LtCihYPaIKldP9O5YVOxQ-g_FJhkNzSTLhaiyhM Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_05db9ac3826c4ec1aface1ab98b3d2bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}] Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: a63319281f9e4cf9ba22673f25b42291 Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': '436a17be-5204-4049-83d0-a29252843481'} Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:55.887953 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. Aug 27 21:08:55.891649 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:08:55.893855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Returning 404 to user: Instance 436a17be-5204-4049-83d0-a29252843481 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:55.895004 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92cae91e-2bcd-46be-b86f-f6922ca25cbb tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/436a17be-5204-4049-83d0-a29252843481/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021579 Aug 27 21:08:55.895974 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2183/4491] 10.222.0.40 () {58 vars in 1296 bytes} [Sat Aug 27 21:08:55 2022] GET /compute/v2.1/servers/436a17be-5204-4049-83d0-a29252843481/os-instance-actions => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:08:55.907874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:55.908398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:55.916971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.917473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.917952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.918783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:55.919282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:55.919871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:55.952609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:08:56.063165 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39e2b057-1140-49e5-965e-0c20f7ab360e tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 204 len: 0 microversion: 2.1 time: 0.160402 Aug 27 21:08:56.067137 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2309/4492] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:08:55 2022] DELETE /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:08:56.075660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:56.076292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:56.088041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:56.089425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:56.095861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:56.097065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:56.097671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:56.098047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:56.257865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:56.266883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c27f6996-16ae-41d5-97eb-f588edbaee2b tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1528 microversion: 2.1 time: 0.195259 Aug 27 21:08:56.268208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2184/4493] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:56 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1528 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:56.802406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:56.804005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:56.812342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:56.812913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:56.813429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:56.814263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:56.814744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:56.815236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:56.979393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:56.988459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fb93850-504d-447f-b1af-4bf4c46af4c6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1315 microversion: 2.1 time: 0.190352 Aug 27 21:08:56.989038 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2310/4494] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:56 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:57.293953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:57.294622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:57.302049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:57.302738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:57.303237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:57.310723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:57.311485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:57.312125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:57.580234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:57.590771 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5709d673-ef79-4608-86c7-bae0924707fa tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1528 microversion: 2.1 time: 0.301673 Aug 27 21:08:57.591586 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2185/4495] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:57 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:58.011430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:58.012753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:58.022576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.023596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.024253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.025180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.025927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.026544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.297741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:58.307888 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-575af234-7c37-4d60-b1c9-1831ce264420 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1502 microversion: 2.1 time: 0.300842 Aug 27 21:08:58.309071 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2311/4496] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:58 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:08:58.334399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:58.338048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:58.349023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.349836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.351055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.352160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.352902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.353643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.426065 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9a7bfb9-0af4-4742-a7f7-9cc38a12dda6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.098274 Aug 27 21:08:58.430268 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2186/4497] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:58 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:08:58.558694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc3276f-cdb5-4839-af5e-0d44a428779d", "name": "network-vif-deleted", "tag": "639887e1-edf3-4f24-9d7c-7ecf40a2fccd"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:58.587182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.588933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.589838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.619040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] Creating event network-vif-deleted:639887e1-edf3-4f24-9d7c-7ecf40a2fccd for instance fbc3276f-cdb5-4839-af5e-0d44a428779d on nch1-master-1 Aug 27 21:08:58.619520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:58.619520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:58.625509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.627511 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d21a732c-6d90-4363-913a-ebbd4bcb9855 req-f5a9232f-0a0a-4b9f-b94a-d3f03c77ca8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073646 Aug 27 21:08:58.628220 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2312/4498] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:08:58.629473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.632040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.633415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:58.633959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:58.634474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:58.725092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a63319281f9e4cf9ba22673f25b42291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05db9ac3826c4ec1aface1ab98b3d2bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:08:58.737291 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72e4285e-e208-4c34-84ac-0d15c04ae3b8 tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 200 len: 1310 microversion: 2.1 time: 0.128020 Aug 27 21:08:58.738432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2187/4499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:58 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 1310 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:08:59.440522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:59.443075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:59.452270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:59.452915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:59.453408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:59.454326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:59.454835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:59.455661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:59.460549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:08:59.535237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa3331ea-bbce-452c-bf73-32e0c56b2b6a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.099858 Aug 27 21:08:59.536238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2313/4500] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:08:59 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:08:59.737909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-29048850", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "fc43b98b-bd94-42b3-8a8d-a4b66e2d7aca"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:08:59.759275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:08:59.760026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] [instance: fbc3276f-cdb5-4839-af5e-0d44a428779d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:08:59.769613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:59.770158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:59.770633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:59.771461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:08:59.772021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:08:59.772659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:08:59.790938 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] HTTP exception thrown: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Request method failure captured: Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d HTTP/1.1 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCofUcAiRtwvovlkKukyR2DuFsFwPz6KGRVp-oxK9lbAUbOgiX5ZgcBF_lyQOxeA1Qw7jZX2ADJSiS8zYDWl9R-VUfatqsbazvaCATpz8V1_gKF1wmumYayu8GOVjqwgExWhBAvY2LtCihYPaIKldP9O5YVOxQ-g_FJhkNzSTLhaiyhM Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/05db9ac3826c4ec1aface1ab98b3d2bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_05db9ac3826c4ec1aface1ab98b3d2bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/05db9ac3826c4ec1aface1ab98b3d2bb"}]}] Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 05db9ac3826c4ec1aface1ab98b3d2bb Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1207981750 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: a63319281f9e4cf9ba22673f25b42291 Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1207981750-project Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'fbc3276f-cdb5-4839-af5e-0d44a428779d'} Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:59.792532 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] Returning 404 to user: Instance fbc3276f-cdb5-4839-af5e-0d44a428779d could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4347a186-48ec-49d0-a01b-95bcf5b09c9c tempest-InstanceActionsNegativeTestJSON-1207981750 tempest-InstanceActionsNegativeTestJSON-1207981750-project] 10.222.0.40 "GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d" status: 404 len: 111 microversion: 2.1 time: 0.039506 Aug 27 21:08:59.797246 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2314/4501] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:08:59 2022] GET /compute/v2.1/servers/fbc3276f-cdb5-4839-af5e-0d44a428779d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:08:59.803120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] validate_networks() for [('fc43b98b-bd94-42b3-8a8d-a4b66e2d7aca', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:09:00.543264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:09:00.544129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:09:00.544886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:09:00.545319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:09:00.545731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:09:00.547266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:00.550648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:00.556854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:00.558304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:00.559312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:00.560054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:00.560684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:00.561015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:00.561400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:00.561530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:00.561869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:00.562672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:00.563141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:00.563878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:00.582188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Getting quotas for project f0224e49310e4b1ca2e9c8aa7999dda6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:00.590026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Getting quotas for user eaf9744f89fe4df9a10e9cb0297cc7d9 and project f0224e49310e4b1ca2e9c8aa7999dda6. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:00.604707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:09:00.607108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:09:00.633852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28b302cb-4f92-44bd-b85e-4bffc983f4b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.090923 Aug 27 21:09:00.634755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2315/4502] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:00 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:00.657835 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7693064-4c39-4b56-b1c6-e9922e88c398 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924520 Aug 27 21:09:00.665078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2188/4503] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:09:00.676652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f04a516-1abd-44f3-ad20-c271c26e96b7 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:00.679517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f04a516-1abd-44f3-ad20-c271c26e96b7 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:00.764311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f04a516-1abd-44f3-ad20-c271c26e96b7 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:00.777862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f04a516-1abd-44f3-ad20-c271c26e96b7 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1212 microversion: 2.1 time: 0.109475 Aug 27 21:09:00.779075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2316/4504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:00 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:01.646770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:01.650308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:01.658629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:01.659110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:01.659570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:01.660537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:01.661157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:01.661787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:01.750658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd468977-06e8-444b-a1ff-b0bbf61207e2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.107567 Aug 27 21:09:01.755026 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2189/4505] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:01 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:01.802857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:01.803597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:01.811368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:01.811995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:01.812446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:01.813233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:01.813710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:01.814177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:01.889073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:01.898804 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-147fa2ff-8de6-4cea-adcb-029053e845b1 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1264 microversion: 2.1 time: 0.100463 Aug 27 21:09:01.899982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2317/4506] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:01 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1264 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:02.764770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:02.769295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:02.779447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:02.780361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:02.782100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:02.783202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:02.783802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:02.784556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:02.861836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3997b9d3-0997-47a4-a0c5-6f825206795b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.101814 Aug 27 21:09:02.862947 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2190/4507] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:02 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:02.921924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:02.922800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:02.939082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:02.939805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:02.942305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:02.945772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:02.946592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:02.947249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:03.755496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:03.772527 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-936d6bd5-2957-4009-a914-5540e8d24003 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.854897 Aug 27 21:09:03.773790 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2318/4508] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:02 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:03.876420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:03.879495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:03.889619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:03.890094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:03.890532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:03.891251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:03.891716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:03.892154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:03.968266 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96d1a20f-110b-4e13-be71-65a74ae324d8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.097273 Aug 27 21:09:03.969616 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2191/4509] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:03 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:04.707359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b03c5d38-a9b7-43de-8035-db88b382242f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: .version_select at 0x7ff84de28c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-288527544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTcf9zHbxPhbYSnVGUqpGeI0ucLOpKO3Ixrae0D/Uj6JGTVnEcBoKP7cBPKyE44TlcTXJ1GXuT4jv44GK4Ea0hYX2K8/gwAB1I2zfR52ycrYm/U2NXdw1/kjKleQkQt4w=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:04.740753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b03c5d38-a9b7-43de-8035-db88b382242f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:04.747327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b03c5d38-a9b7-43de-8035-db88b382242f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:04.799169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:04.799485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b03c5d38-a9b7-43de-8035-db88b382242f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.095477 Aug 27 21:09:04.801624 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2319/4510] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:09:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:04.803823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:04.826298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:04.829405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:04.830181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:04.831392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:04.837352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:04.839902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:04.993050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:04.998535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:05.039316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:05.039870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:05.040325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:05.041048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:05.041514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:05.041951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:05.147330 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ef643b0-67ab-4d7b-b8a7-71cab94537c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.169652 Aug 27 21:09:05.148692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2320/4511] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:04 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:05.156293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89cddf5-c020-47f1-851d-7cacfec789fe", "tag": "053baeb5-0ce2-4523-a2bb-70d826d0b16b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:05.182943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:05.183938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:05.184603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:05.205587 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] Creating event network-changed:053baeb5-0ce2-4523-a2bb-70d826d0b16b for instance e89cddf5-c020-47f1-851d-7cacfec789fe on nch1-master-1 Aug 27 21:09:05.213377 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-978bee3f-d721-47d1-8b26-3fe2896a3991 req-1eaf6cd0-f2a7-4556-9cd7-236b9c538ea7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062931 Aug 27 21:09:05.215512 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2321/4512] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:05.376441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:05.395946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2aa4f1c1-39f2-40c6-a836-4cacfb9fe5ea tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.599310 Aug 27 21:09:05.397272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2192/4513] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:04 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:06.165605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:06.168780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:06.177196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:06.178312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:06.179202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:06.180157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:06.180848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:06.181490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:06.258141 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93f7e2c4-1de7-4b44-a751-dd2b4ba91d51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.098137 Aug 27 21:09:06.262588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2322/4514] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:06 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:06.421645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:06.422908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:06.430092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:06.430988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:06.431683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:06.432350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:06.432885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:06.433315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:06.586043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:06.599020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1358887494", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "75d4f12d-fd6d-415b-aa91-7cffdb625b72"}], "key_name": "tempest-TestNetworkBasicOps-288527544", "security_groups": [{"name": "tempest-secgroup-smoke-838262126"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:06.612174 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1fba1f56-a8c6-44ec-9152-e8437a65e4f0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.197145 Aug 27 21:09:06.613037 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2193/4515] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:06 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:06.741104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] validate_networks() for [('75d4f12d-fd6d-415b-aa91-7cffdb625b72', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:09:07.255504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:09:07.256672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:09:07.257423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:09:07.258210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:09:07.259472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:09:07.274016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:07.277145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:07.288179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.288810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.290554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.291248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.292518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.293311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.294134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.294584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.295738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.297935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.299329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.301530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.364714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:07.376144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:07.390370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f0e1188-418f-4a26-a1d3-8e6f25876cf8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.121244 Aug 27 21:09:07.391622 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2194/4516] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:07 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:07.403869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:09:07.406730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:09:07.490672 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5719e269-015d-494f-bdfe-66e0031f5f50 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.896231 Aug 27 21:09:07.491741 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2323/4517] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:09:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:09:07.504259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f7ff3459-6109-451a-ba0b-303f3d374a81 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:07.505708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f7ff3459-6109-451a-ba0b-303f3d374a81 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:07.599666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f7ff3459-6109-451a-ba0b-303f3d374a81 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:07.610491 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f7ff3459-6109-451a-ba0b-303f3d374a81 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1248 microversion: 2.1 time: 0.110506 Aug 27 21:09:07.628868 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2195/4518] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:07 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1248 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:07.634757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:07.635476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:07.642614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.643110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.643582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.644292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:07.644905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:07.645335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:07.890583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:07.900448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70f4c69b-5bc7-40a4-b56d-08840682a65c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.269966 Aug 27 21:09:07.913049 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2324/4519] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:07 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:08.403583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:08.407552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:08.416862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.417613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.418229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:08.419172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.419842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.420470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:08.500436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-346258fa-5a90-497a-9783-c3aa5c2b4103 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.100227 Aug 27 21:09:08.505316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2196/4520] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:08 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:09:08.634766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:08.635395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:08.645367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.645897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.646383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:08.659417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.660297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.661013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:08.796997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:08.805962 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-939354bd-2bca-4576-9aa8-2fca08b9ebc8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1244 microversion: 2.1 time: 0.177729 Aug 27 21:09:08.813480 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2325/4521] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:08 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:08.924310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:08.925407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:08.934530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.935253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.935923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:08.936879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:08.937710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:08.938301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:09.521151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:09.525474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:09.533144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:09.533865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:09.534539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:09.535397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:09.536004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:09.536603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:09.630453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a63c6779-b3c2-4431-88b4-91614727fd79 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.119354 Aug 27 21:09:09.631635 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2326/4522] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:09 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:09.817397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:09.829079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:09.835456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:09.837781 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e53fddb7-23be-42cd-80a2-d437f3277ca6 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.912008 Aug 27 21:09:09.838062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:09.840141 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2197/4523] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:08 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:09.856750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:09.866045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:09.866702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:09.867577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:09.868040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:09.868469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:09.981874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:09.992148 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a20a233-ed83-4dc0-a2c0-c6a853581349 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1306 microversion: 2.1 time: 0.162773 Aug 27 21:09:10.004310 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2327/4524] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:09 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:10.644225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:10.646713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:10.655359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:10.656484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:10.658977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:10.659609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:10.660408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:10.662313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:10.663230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:10.663920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:10.749727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4be84599-adb0-41e9-bdcb-34f72080a5c2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 14 microversion: 2.1 time: 0.110641 Aug 27 21:09:10.755038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2198/4525] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:10 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:09:10.861973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:10.862679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:10.873767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:10.874543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:10.875078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:10.877272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:10.877815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:10.878713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.015450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:11.016883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:11.025505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.026599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.027268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.028324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.029103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.029688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.095986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:11.107975 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0ccd85c-c1ba-465f-ab15-de833361b2ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.251563 Aug 27 21:09:11.118248 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2328/4526] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:10 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:11.130110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:11.144068 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a3e4857-7699-4e0e-aa7f-93e61b8a3170 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1306 microversion: 2.1 time: 0.132793 Aug 27 21:09:11.144960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2199/4527] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:11 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1306 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:11.763432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:11.766412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:11.782463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.782938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.783469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.788039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.796895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.798583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.921692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42e74b06-09bc-448b-9fc9-0e736a426aef tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action" status: 200 len: 8208 microversion: 2.1 time: 0.159788 Aug 27 21:09:11.924240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2329/4528] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:11 2022] POST /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0/action => generated 8208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:11.933468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:11.934367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:11.943640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.944773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.945289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:11.946296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:11.946913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:11.947770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.112777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89cddf5-c020-47f1-851d-7cacfec789fe", "name": "network-vif-plugged", "status": "completed", "tag": "053baeb5-0ce2-4523-a2bb-70d826d0b16b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:12.136434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.140591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.141368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.176496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] Creating event network-vif-plugged:053baeb5-0ce2-4523-a2bb-70d826d0b16b for instance e89cddf5-c020-47f1-851d-7cacfec789fe on nch1-master-1 Aug 27 21:09:12.183803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:12.192895 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-58a5312f-9fc7-4d84-bfac-f6bde27d28e6 req-22297bb2-f543-4986-8baa-0071633a05cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084116 Aug 27 21:09:12.193627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2330/4529] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:12.211989 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07303914-decf-4b0a-8767-27a1f631efd4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.282498 Aug 27 21:09:12.223692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:12.223692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:12.223980 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2200/4530] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:11 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:12.223980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:12.223980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:12.232842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.233579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.238137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.238905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.239545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.240143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.240718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.241324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.242035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.242862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.243379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.244323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.629630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:12.646598 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-797a2d7a-b09d-4146-98da-c236a927415b tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.428354 Aug 27 21:09:12.647870 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2201/4531] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:12 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:12.668468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:12.669525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:12.675662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:12.683308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.684894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.686130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.687558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.688263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.689064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.696565 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f9ee630-6a25-4fe0-84ae-5425291e20e5 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.499357 Aug 27 21:09:12.697214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2331/4532] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:12 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:12.877946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:12.895535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-43411ca0-aa61-4ffb-8233-e1213208f885 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.231460 Aug 27 21:09:12.896516 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2202/4533] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:12 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:12.921173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:12.922121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:12.931593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.932473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.932999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.933927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.934529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.934961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:12.957556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33f33b5-107e-47ad-8c0f-6b54acc6d1fa", "tag": "742c425f-91e0-4305-8530-eea040757a1c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:12.979100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:12.979740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:12.980203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.008752 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] Creating event network-changed:742c425f-91e0-4305-8530-eea040757a1c for instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa on nch1-master-1 Aug 27 21:09:13.017295 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-27bd8e93-c0ac-4299-b000-07a4a8961661 req-738858b3-d132-4709-876e-f28df06579ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063540 Aug 27 21:09:13.018584 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2203/4534] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:13.165667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:13.176748 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de88a2b1-baba-4cce-8487-0d81f00ed361 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.262412 Aug 27 21:09:13.177988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2332/4535] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:12 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:13.200350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:13.201101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:13.222853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.224471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.225821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.226891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.228752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.229598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.421885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:13.431991 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-306d0e80-499c-45b7-ace3-e85dc4a9a4ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.236230 Aug 27 21:09:13.446561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2204/4536] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:13 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:13.453971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:13.455226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:13.468520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.469271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.470643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.471419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.471939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.472364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.549039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Locking {{(pid=140434) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 21:09:13.635398 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-00c19817-0b61-4485-8730-90812333b4a4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.185429 Aug 27 21:09:13.636149 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2333/4537] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:13 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:13.646978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:13.649187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:13.660636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.661346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.664751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.667586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.668253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.668849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.669798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:13.671167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:13.694272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.694691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.695447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.696412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:13.697102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:13.697849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:13.714904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:14.006225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:14.021103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a9c3f1b-02ca-4fd3-aad5-aa2ebde2fc7e tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.355244 Aug 27 21:09:14.023090 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2334/4538] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:13 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:14.030021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:14.030785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:14.041994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.042542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.043057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.043992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.044598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.045274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.363437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:14.373412 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0b9932d-05f2-417f-a31d-1608c6a13439 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1312 microversion: 2.1 time: 0.348796 Aug 27 21:09:14.374010 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2335/4539] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:14 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:14.383962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:14.394282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-78fe32c1-f0cb-4867-bc80-b7d3f001e53b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.753197 Aug 27 21:09:14.396952 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2205/4540] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:13 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:14.423708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:14.431574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.432530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.433315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.471104 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action HTTP/1.1 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 15 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: {"os-stop": {}} Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '550cd635-d377-4101-b61d-6e5ca147b826', 'body': {'os-stop': {}}} Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked Aug 27 21:09:14.473078 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:14.481022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 409 to user: Instance 550cd635-d377-4101-b61d-6e5ca147b826 is locked {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:14.482182 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91a1e0b2-b22e-456d-84fa-a393ab29e0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 409 len: 107 microversion: 2.1 time: 0.062833 Aug 27 21:09:14.483655 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2336/4541] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:14 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 107 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:09:14.496865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:14.497611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:14.507388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.508346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.508880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.509654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.510134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.510672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.587085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Unlocking {{(pid=140433) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 21:09:14.696296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9935937f-ef16-45f4-96a3-dd2eee8c7d4e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.205863 Aug 27 21:09:14.697705 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2206/4542] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:14 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:09:14.707209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:14.709708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:14.720481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.722073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.722769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.757886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:09:14.814988 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c67f5c62-43f3-4df8-bc6f-8b0aa39ae778 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.111828 Aug 27 21:09:14.816149 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2337/4543] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:14 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:14.826357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:14.827144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:14.841873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.842819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.844035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:14.844949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:14.845449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:14.846165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:15.039573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:15.048711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3734fbb1-0619-45fd-825b-bff5d2b4b4fa tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.227922 Aug 27 21:09:15.049476 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2207/4544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:14 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:15.052749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.055296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:15.070328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:15.070945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:15.071661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:15.072413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:15.072947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:15.073449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:15.255434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:15.265321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3faaf91e-953d-4fad-aa1a-ab28cc2e08b5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.221179 Aug 27 21:09:15.265952 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2338/4545] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:15 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:15.360910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Action: 'create', calling method: .version_select at 0x7ff84e08a550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:15.379600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Getting quotas for project e395e1946a8a4f81ad947a8afde3168d. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:15.385746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Getting quotas for user 4c46230d7ee844fbaceb4ad1a4f2e0ba and project e395e1946a8a4f81ad947a8afde3168d. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:15.397885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.398577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:15.405546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:15.406300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:15.406913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:15.407929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:15.408755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:15.409346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:15.441081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Getting quotas for project e395e1946a8a4f81ad947a8afde3168d. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:15.449198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Getting quotas for user 4c46230d7ee844fbaceb4ad1a4f2e0ba and project e395e1946a8a4f81ad947a8afde3168d. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:15.469161 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-817b00d3-0519-4e5a-a4af-898f333007f5 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.175266 Aug 27 21:09:15.470364 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2208/4546] 10.222.0.40 () {62 vars in 1214 bytes} [Sat Aug 27 21:09:15 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:09:15.482728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec4f2468-32b9-4920-8eec-23d7f90718b6 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.505218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec4f2468-32b9-4920-8eec-23d7f90718b6 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.027689 Aug 27 21:09:15.506815 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2209/4547] 10.222.0.40 () {60 vars in 1193 bytes} [Sat Aug 27 21:09:15 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:09:15.518788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f8b09af1-f121-4913-bf35-615044637f35 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.531400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f8b09af1-f121-4913-bf35-615044637f35 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a" status: 200 len: 235 microversion: 2.64 time: 0.017795 Aug 27 21:09:15.532480 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2210/4548] 10.222.0.40 () {60 vars in 1304 bytes} [Sat Aug 27 21:09:15 2022] GET /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a => generated 235 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:09:15.545553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95e2ba3b-b16a-47f2-aa2d-33aa22b8c569 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.587970 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-95e2ba3b-b16a-47f2-aa2d-33aa22b8c569 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a" status: 204 len: 0 microversion: 2.64 time: 0.047418 Aug 27 21:09:15.588786 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2211/4549] 10.222.0.40 () {60 vars in 1307 bytes} [Sat Aug 27 21:09:15 2022] DELETE /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:09:15.597234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:15.601331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b24a590-58ce-4427-a25a-7bf7c5280801 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:15.609928 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f307019d-9097-467c-9bd1-bd4014d98433 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1495 microversion: 2.1 time: 0.215995 Aug 27 21:09:15.610675 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8b24a590-58ce-4427-a25a-7bf7c5280801 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] HTTP exception thrown: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. Aug 27 21:09:15.611542 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2339/4550] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:15 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1495 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b24a590-58ce-4427-a25a-7bf7c5280801 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Request method failure captured: Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a HTTP/1.1 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCof76jWglxuBmjqrjF2-FMyZbpIg3JcZxEeAGEedZfwU_gtJdM5ndntuCGQtCcai1AQSWjfffyXkhYSu0CHqs6LfDn2DR6Ao5VDvY4PVs_Y7pH-Qf1OQ_1KvBbP-52BF4NGcvcBOzmS3kOWNSfIJCSO6W1Vlo2ZtQaoboTnE2sRhcME Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e395e1946a8a4f81ad947a8afde3168d Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerGroup264TestJSON-179409690 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e395e1946a8a4f81ad947a8afde3168d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e395e1946a8a4f81ad947a8afde3168d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e395e1946a8a4f81ad947a8afde3168d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e395e1946a8a4f81ad947a8afde3168d"}]}] Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerGroup264TestJSON-179409690 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e395e1946a8a4f81ad947a8afde3168d Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerGroup264TestJSON-179409690 Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerGroup264TestJSON-179409690-project Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4c46230d7ee844fbaceb4ad1a4f2e0ba Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerGroup264TestJSON-179409690-project Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f0fc6c62-4142-4893-84f3-2a115b29f34a'} Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:15.624076 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b24a590-58ce-4427-a25a-7bf7c5280801 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] Returning 404 to user: Instance group f0fc6c62-4142-4893-84f3-2a115b29f34a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b24a590-58ce-4427-a25a-7bf7c5280801 tempest-ServerGroup264TestJSON-179409690 tempest-ServerGroup264TestJSON-179409690-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a" status: 404 len: 117 microversion: 2.64 time: 0.030022 Aug 27 21:09:15.633449 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2212/4551] 10.222.0.40 () {60 vars in 1307 bytes} [Sat Aug 27 21:09:15 2022] DELETE /compute/v2.1/os-server-groups/f0fc6c62-4142-4893-84f3-2a115b29f34a => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:09:16.070490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:16.072158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:16.086445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.086943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.089184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.090711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.091120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.095313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.135779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:16.136278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:16.149021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.149510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.150036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.150937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.151621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.152291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.192304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:09:16.302481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:16.320347 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-11f4ccb2-e8f3-45dc-b274-6ed01004a116 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.252007 Aug 27 21:09:16.320495 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3d7a613-783b-46fb-95f7-75ce60a36f08 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 204 len: 0 microversion: 2.1 time: 0.190330 Aug 27 21:09:16.321194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2213/4552] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:09:16 2022] DELETE /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:09:16.321662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2340/4553] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:16 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:16.326481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:16.327756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:16.333573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.334060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.334719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.335292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.335926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.336368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.340478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:16.341326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:16.352287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.353262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.353909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.354922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:16.355407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:16.355856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:16.600064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:16.618672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:16.619446 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d9579bb-f693-4db2-9166-875af11a0629 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.296653 Aug 27 21:09:16.635508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2214/4554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:16 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:16.640094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-397c9af9-72be-411d-8060-e8dc7366d943 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1501 microversion: 2.1 time: 0.306697 Aug 27 21:09:16.640773 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2341/4555] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:16 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1501 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:17.345457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:17.346223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:17.354945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.356215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.356791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.357680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.358458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.359047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.625405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:17.646001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:17.646699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:17.649755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:17.652262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:17.656181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-abf84c31-0ccd-4c81-9355-f6a07a43f3c5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.314638 Aug 27 21:09:17.660107 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2215/4556] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:17 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:17.667479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:17.668139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:17.672854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.673386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.673860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.674526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.675029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.675487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.676197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.676885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.677486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.678624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:17.679474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:17.680517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:17.685997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:18.038701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:18.049364 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-76b51518-d46f-4647-aed6-8b3a1dcdc313 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1501 microversion: 2.1 time: 0.387705 Aug 27 21:09:18.049961 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2216/4557] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:17 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:18.053740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:18.063448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ceec41ff-0e89-415a-95fc-bc497ebbb5a4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.421371 Aug 27 21:09:18.066417 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2342/4558] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:17 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:18.683832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:18.684494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:18.697935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:18.698443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:18.699190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:18.700338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:18.701030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:18.701518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:18.904543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:18.924042 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ba9f0f8-f9f5-499d-af10-1451ceea217e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.243962 Aug 27 21:09:18.926269 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2217/4559] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:18 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:19.077726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:19.088267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:19.090355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:19.091883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:19.115194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.116048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.116494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:19.117228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.117865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.118275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.119019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:19.119258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.119982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:19.120977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.122836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.123632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:19.529072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:19.539497 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0fdae1dd-f3b0-4d06-9db4-7cc927d16d12 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.456618 Aug 27 21:09:19.541160 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2218/4560] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:19 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:19.730711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:19.752487 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-df022cac-5727-4f97-b201-29a1b6f7912e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1501 microversion: 2.1 time: 0.682561 Aug 27 21:09:19.754129 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2343/4561] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:19 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1501 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:19.955375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:19.955375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:19.965502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.966321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.967155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:19.968442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:19.969384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:19.970217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.260508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:20.269420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51ab0203-69f8-419a-8d2d-8d2159ab43c7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.319462 Aug 27 21:09:20.270123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2219/4562] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:19 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:20.484051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89cddf5-c020-47f1-851d-7cacfec789fe", "name": "network-vif-deleted", "tag": "053baeb5-0ce2-4523-a2bb-70d826d0b16b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:20.498261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.498859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.499468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.518679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] Creating event network-vif-deleted:053baeb5-0ce2-4523-a2bb-70d826d0b16b for instance e89cddf5-c020-47f1-851d-7cacfec789fe on nch1-master-1 Aug 27 21:09:20.526267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-36a02c20-f6b3-49fe-b13a-1c756978d29f req-43823ecf-1f3c-48f2-83e1-1518f2df395f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055538 Aug 27 21:09:20.527247 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2344/4563] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:20.563607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:20.564394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:20.571186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.571940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.572593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.573409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.573880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.574377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.765302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:20.774965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-180ea33d-20c5-43ea-b999-1903b693752c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.216387 Aug 27 21:09:20.776050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2220/4564] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:20 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:20.780253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:20.781494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:20.796059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.797592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.799715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.800878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.801751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.803299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.851741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:20.852271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:20.852892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:20.854159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lazy-loading 'fault' on Instance uuid e89cddf5-c020-47f1-851d-7cacfec789fe {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:20.934157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:20.944240 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-54290e8c-e55f-4f7f-a178-29e3b4650e0b tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 200 len: 1302 microversion: 2.1 time: 0.168852 Aug 27 21:09:20.945163 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2345/4565] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:20 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 1302 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:21.293904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:21.294567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:21.315966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.316510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.317221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:21.317999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.318582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.319301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:21.500167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:21.515847 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62b377fe-11b9-4960-be88-2261f0688165 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.226286 Aug 27 21:09:21.517304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2221/4566] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:21 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:21.809006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:21.810335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:21.821088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.821727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.822187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:21.823311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.824109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.825020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:21.969834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:21.971060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: e89cddf5-c020-47f1-851d-7cacfec789fe] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:21.984070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.986496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.987763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:21.988688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:21.989356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:21.989957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:22.008470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:22.024392 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3a34b19-14a2-44ba-ba21-d967789131f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.219200 Aug 27 21:09:22.026249 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2346/4567] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:21 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:22.036122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] HTTP exception thrown: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Request method failure captured: Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe HTTP/1.1 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCofpJleNX7l69i3rh8oJYHTnJ_dEV7_aK7AuoDEEkJFGiwFjt9Osh6ysmsWA3BYoVJrcGgkoYwXl3TnBmebe2ytEoAVWcDlStbZkmBUhoSe-v5D0Pfs1KL-EeMSfO9U8YMj-Ii6-XWvqSju5Tf2iDF7Hmwq95AZVKwxkMu9arN3c-oc Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f0224e49310e4b1ca2e9c8aa7999dda6 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesActionsTest-65705369 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0224e49310e4b1ca2e9c8aa7999dda6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f0224e49310e4b1ca2e9c8aa7999dda6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f0224e49310e4b1ca2e9c8aa7999dda6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0224e49310e4b1ca2e9c8aa7999dda6"}]}] Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesActionsTest-65705369 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f0224e49310e4b1ca2e9c8aa7999dda6 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesActionsTest-65705369 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesActionsTest-65705369-project Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: eaf9744f89fe4df9a10e9cb0297cc7d9 Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesActionsTest-65705369-project Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e89cddf5-c020-47f1-851d-7cacfec789fe'} Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:22.039048 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Returning 404 to user: Instance e89cddf5-c020-47f1-851d-7cacfec789fe could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:22.044946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61dc85bc-4f81-4343-9538-2cbaa04f18a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe" status: 404 len: 111 microversion: 2.1 time: 0.077505 Aug 27 21:09:22.052411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2222/4568] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:21 2022] GET /compute/v2.1/servers/e89cddf5-c020-47f1-851d-7cacfec789fe => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:09:22.160886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2031008155", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "fc43b98b-bd94-42b3-8a8d-a4b66e2d7aca"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:22.220114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] validate_networks() for [('fc43b98b-bd94-42b3-8a8d-a4b66e2d7aca', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:09:22.538883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:22.540278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:22.548125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:22.549062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:22.549737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:22.550725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:22.551524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:22.552439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:22.844622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:22.858018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7cdc7d7-134b-45da-9a68-a9504bcbe146 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.323238 Aug 27 21:09:22.861537 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2223/4569] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:22 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:22.872722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33f33b5-107e-47ad-8c0f-6b54acc6d1fa", "name": "network-vif-plugged", "status": "completed", "tag": "742c425f-91e0-4305-8530-eea040757a1c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:22.887064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:22.887860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:22.888472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:22.915568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] Creating event network-vif-plugged:742c425f-91e0-4305-8530-eea040757a1c for instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa on nch1-master-1 Aug 27 21:09:22.923508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-55fa4953-6348-4a54-8896-a37d433f6f75 req-09432461-05d8-4cd9-b90a-5376dae65f1b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060072 Aug 27 21:09:22.924480 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2224/4570] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:23.052658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:23.054748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:23.067252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.079140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.082165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:23.083840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.084665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.085822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:23.244438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:09:23.245759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:09:23.247030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:09:23.248416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:09:23.249402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:09:23.276522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.277037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.282155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:23.284160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.284879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.285393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:23.312582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Getting quotas for project f0224e49310e4b1ca2e9c8aa7999dda6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:23.326816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Getting quotas for user eaf9744f89fe4df9a10e9cb0297cc7d9 and project f0224e49310e4b1ca2e9c8aa7999dda6. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:23.358721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:09:23.361350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:09:23.437097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:23.442692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-60dacb1a-dee8-4f69-a4d4-e1ad1321c3bb tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285676 Aug 27 21:09:23.444392 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2347/4571] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:09:23.452103 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ffef29f-d030-4b44-babc-30b78a16c08d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.405636 Aug 27 21:09:23.453351 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2225/4572] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:23 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:23.477542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ea19c5a-b5e8-46aa-a629-ae839b9033ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:23.479462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ea19c5a-b5e8-46aa-a629-ae839b9033ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:23.568054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ea19c5a-b5e8-46aa-a629-ae839b9033ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:23.585234 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ea19c5a-b5e8-46aa-a629-ae839b9033ed tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1214 microversion: 2.1 time: 0.124659 Aug 27 21:09:23.585858 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2348/4573] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:23 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:23.886360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:23.888011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:23.901996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.902932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.904666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:23.905855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:23.906611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:23.907252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:24.117860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:24.137994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3119f78d-f339-4b1a-877d-8c3b3cbe568f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.257426 Aug 27 21:09:24.141011 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2226/4574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:23 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:24.482629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:24.484009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:24.500000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:24.500857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:24.501553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:24.502536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:24.503439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:24.503848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:24.613138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:24.614181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:24.629285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:24.630513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:24.636096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:24.637369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:24.638040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:24.638628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:24.722907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:24.735512 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-33e101dc-1959-42bd-9bab-c0f937c74161 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1373 microversion: 2.1 time: 0.262455 Aug 27 21:09:24.752760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2349/4575] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:24 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1373 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:24.785715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:24.797449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-af38ff9d-f0bd-4667-ab9a-20e6bc5d455f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1210 microversion: 2.1 time: 0.188406 Aug 27 21:09:24.798641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2227/4576] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:24 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:25.168367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:25.170442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:25.217876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.218388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.219902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.222952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.224375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.225392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.567422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:25.578451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50a7f2c8-fe30-49c9-becb-fa8e20d19cda tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.415930 Aug 27 21:09:25.579064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2350/4577] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:25 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:25.774971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:25.776494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:25.784961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=16 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:25.792534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.793425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.794085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.795095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.795908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.796522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.835747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:25.836393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:25.850100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.850973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.851667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.852585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:25.853514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:25.854138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:25.989127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:25.998567 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab5f0546-4259-4e9c-b792-06887dc89e84 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1266 microversion: 2.1 time: 0.180853 Aug 27 21:09:26.012246 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2351/4578] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:25 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:26.271034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:26.282933 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5624634-7f44-4976-a1fc-dd16a45e9dfa tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1545 microversion: 2.1 time: 0.521683 Aug 27 21:09:26.284348 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2228/4579] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:25 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1545 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:26.306158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:26.307103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:26.318174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:26.318956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:26.319505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:26.320205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:26.320829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:26.321262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:26.326939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:26.602374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:26.603310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:26.606633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:26.616134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:26.616964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:26.617567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:26.618479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:26.619136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:26.619809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:26.661840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:26.673838 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8953b467-8b6f-4771-9f93-065b2099155c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1545 microversion: 2.1 time: 0.372217 Aug 27 21:09:26.678168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2352/4580] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:26 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1545 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:27.006361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:27.023189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d1e523a-2884-4d71-bdb0-5007d04a0a6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1655 microversion: 2.1 time: 0.425736 Aug 27 21:09:27.023705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:27.023835 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2229/4581] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:26 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1655 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:27.024674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:27.035204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:27.038493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:27.042059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:27.042805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:27.045986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:27.048214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:27.055688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:27.064236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:27.064932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:27.066224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:27.099084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Going to try to start instance {{(pid=140433) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:09:27.175378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:27.187197 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34688475-10dd-4204-84a2-56575894666e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1272 microversion: 2.1 time: 0.168738 Aug 27 21:09:27.203779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2353/4582] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:27 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:27.238882 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f202ecf1-106f-46a3-ae80-bb9013a673d6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.155353 Aug 27 21:09:27.241078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2230/4583] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:27 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:27.253802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:27.267261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:27.288586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:27.291970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:27.292939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:27.294085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:27.294901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:27.295642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:27.677247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:27.687331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56dbb0c5-587e-407a-b98b-51e58b0fc6c8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1664 microversion: 2.1 time: 0.442085 Aug 27 21:09:27.687933 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2354/4584] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:27 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1664 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:28.216371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:28.218481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:28.245713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:28.250185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:28.250805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:28.252692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:28.253938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:28.254665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:28.710205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:28.710841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:28.720062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:28.720641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:28.721149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:28.722155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:28.722827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:28.723482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:28.995443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:29.009053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4b0e2f1-69e5-4c51-a50d-bf8467e654a2 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.797525 Aug 27 21:09:29.011219 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2231/4585] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:28 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:29.332681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:29.362077 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-656c7272-e06c-40a8-ab0b-1cf5745f041e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1664 microversion: 2.1 time: 0.643310 Aug 27 21:09:29.371546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2355/4586] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:28 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1664 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:29.734770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-beda5980-5f4a-4b78-bf05-08d7ab8e3a5e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: .version_select at 0x7ff84e27de50>, body: {"keypair": {"name": "tempest-keypair-1373016131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfv+gERP3TjVQm/IEG55tida3eaDmiUl5At12ywHgnDk5k3JgovST2qDEUhY7T4YeGO8RE/cBCN7djDMa69vW6noEmhgBIqN68hgrGMoWS68C5na9QeQtXQPi2mgckktA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:29.755104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-beda5980-5f4a-4b78-bf05-08d7ab8e3a5e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:29.764084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-beda5980-5f4a-4b78-bf05-08d7ab8e3a5e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for user 7266d6f3c5f44e758e222cf97e0cda65 and project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:29.828574 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-beda5980-5f4a-4b78-bf05-08d7ab8e3a5e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.320467 Aug 27 21:09:29.835986 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2232/4587] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:09:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:30.034812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:30.036185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:30.050861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.056694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.059262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.060364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.061009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.062907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.105997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b08530a-8e21-414c-8ad0-49c21743bc07", "tag": "58ef315b-1dba-450d-b340-d8db8ff3c07d"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:30.138815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.139843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.140564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.184117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] Creating event network-changed:58ef315b-1dba-450d-b340-d8db8ff3c07d for instance 1b08530a-8e21-414c-8ad0-49c21743bc07 on nch1-master-1 Aug 27 21:09:30.196811 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f9359ee3-3bdc-4a1c-92c3-406ecb462e4e req-bd1133d9-c21e-4246-a8d4-e329ab742bf9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095163 Aug 27 21:09:30.201378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2233/4588] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:30.403225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:30.404371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:30.418226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.420248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.421560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.423938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.425096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.425765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.512077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:30.525950 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfb4706d-2a14-4e88-a6ca-1b75c52e860f tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.494577 Aug 27 21:09:30.527654 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2356/4589] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:30 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:30.813262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:30.818679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:30.833232 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dcdf80bc-8c19-4139-a113-aaf3a0c6cd9a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.440157 Aug 27 21:09:30.834328 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2234/4590] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:30 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:30.858193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:30.859171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:30.869544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.870467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.871155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:30.872556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:30.873905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:30.875035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.068107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:31.072795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.087552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.087864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.088316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.093267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.094611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.096670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.167824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.182254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4101cf2-1a72-4b6e-b818-28b7a280bb40 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.325279 Aug 27 21:09:31.182880 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2357/4591] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:30 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:31.208815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:31.209676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.230424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.230945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.231440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.232154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.232610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.233037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.325824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Unlocking {{(pid=140434) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 21:09:31.402947 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72c870f4-e017-49df-8b5c-2ae78fa14017 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.199026 Aug 27 21:09:31.404131 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2358/4592] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:31 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:31.417396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:31.418286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.427266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.429336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.430116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.431245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.431922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.432684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.578096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.598589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.602842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.605552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb6cf991-cd03-446e-a120-7b99ddae0909 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2955 microversion: 2.42 time: 0.548757 Aug 27 21:09:31.606863 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2235/4593] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:09:31 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2955 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:09:31.613378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:31.614595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.624483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.625452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.626453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.627602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.628426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.629243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.752722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.775243 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf1f6fe1-74f2-4b33-80bd-f79c666be77f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.363584 Aug 27 21:09:31.792152 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2359/4594] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:31 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:31.796186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:31.796737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.815224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.815744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.821041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.822008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.822529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.823019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.927137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:31.957943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c1cf67bb-509f-4415-96c3-25da305128d8 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.349402 Aug 27 21:09:31.958803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2236/4595] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:31 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:31.975019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:31.977122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:31.989710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.990317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.990744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:31.991539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:31.991991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:31.992638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.137444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b135820b-6eb8-41c7-a9d4-42d0c3c06dba tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.354055 Aug 27 21:09:32.139278 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2360/4596] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:09:31 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1/os-interface => generated 1830 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:09:32.303722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:32.316061 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-346e58c1-22a5-41d0-9e88-00a95a1bb875 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.355558 Aug 27 21:09:32.316923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2237/4597] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:31 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:32.351626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:32.352464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:32.363120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.363880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.365479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.367605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.368539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.369413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.642781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:32.657707 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b1907d6-f27c-4fc4-b424-a0f7cdea2571 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.312336 Aug 27 21:09:32.658614 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2361/4598] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:32 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:32.684623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:32.685173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:32.694554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.695166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.696038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.697052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.697909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.698363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.798176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b13c414-e830-449b-afd8-ef3039ae42ac tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.117594 Aug 27 21:09:32.801902 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2238/4599] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:32 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:32.807990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:32.809026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:32.820839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.821629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.822250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.823296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.823944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.824576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:32.983099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:32.984184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:32.997925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:32.998724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:32.999330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:33.000264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:33.000877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:33.001482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:33.156917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:33.172286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be5b8859-14f8-4438-b9ff-65ddfe0ac33d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1673 microversion: 2.1 time: 0.367850 Aug 27 21:09:33.193270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2362/4600] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:32 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1673 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:33.300538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:33.314248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a572f53a-6b24-495d-9764-03b9c9f21bfc tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.336076 Aug 27 21:09:33.330377 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2239/4601] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:32 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:33.355303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-115065340", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0137230-a7d5-4748-8e88-a9a054ef6657"}], "security_groups": [{"name": "tempest-securitygroup--1921796055"}], "key_name": "tempest-keypair-1373016131", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:33.371560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:33.577498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:33.657389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] validate_networks() for [('a0137230-a7d5-4748-8e88-a9a054ef6657', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:09:34.199365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:34.200526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:34.208205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.209062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.209681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:34.210640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.211259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.211865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:34.954568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:34.963506 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-047c9e16-9515-4c6a-ab07-737605d29f51 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1653 microversion: 2.1 time: 0.769967 Aug 27 21:09:34.964109 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2240/4602] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1653 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:34.977761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:09:34.977761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:09:34.977761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:09:34.977761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:09:34.977761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:09:34.978553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:34.978553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:34.978717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.978717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.978905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:34.980557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.981242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.981662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:34.982674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.983225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.983748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:34.984487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:34.984964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:34.985386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:35.002002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:09:35.008273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for user 7266d6f3c5f44e758e222cf97e0cda65 and project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:09:35.022553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:09:35.025167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:09:35.084389 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d831f534-287e-44b7-8ff9-e308bd8a403a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.736019 Aug 27 21:09:35.085519 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2363/4603] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:09:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:09:35.093277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:35.093913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:35.101747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:35.102375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:35.103163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:35.103545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:35.104018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:35.104507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:35.144320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:35.153592 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-01c5af2e-9a15-4666-b004-15bc0cace571 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.183236 Aug 27 21:09:35.154926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2241/4604] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:34 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:35.176356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f16d870f-d0d1-42c9-a24d-176945dd0bb2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:35.176928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f16d870f-d0d1-42c9-a24d-176945dd0bb2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:35.212414 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-669bdf95-784e-4927-96e8-987443a13320 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.123569 Aug 27 21:09:35.213042 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2364/4605] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:35 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:35.228352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:35.229829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:35.238294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:35.239084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:35.239571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:35.241289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:35.241289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:35.241478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:35.250511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f16d870f-d0d1-42c9-a24d-176945dd0bb2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:35.258428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f16d870f-d0d1-42c9-a24d-176945dd0bb2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1237 microversion: 2.1 time: 0.092329 Aug 27 21:09:35.259304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2242/4606] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:35 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:35.406425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:35.417283 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ecb3979-68ba-41b4-9db8-bae5ab4802cf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1660 microversion: 2.1 time: 0.193745 Aug 27 21:09:35.418333 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2365/4607] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:35 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1660 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:36.180293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.181133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.188479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.188967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.189407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.190111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.190567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.190995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.282134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.282940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.297361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.298109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.298989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.303366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.304480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.305072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.315034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:36.404283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:36.406490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:36.415397 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-46dc25ae-1a39-4eae-bbe2-6a5c7bb24a1d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1289 microversion: 2.1 time: 0.137913 Aug 27 21:09:36.416011 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2366/4608] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:36.423823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44229e8b-36a8-45d1-b179-b176165bc984 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.240310 Aug 27 21:09:36.423823 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2243/4609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:36.441839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.442559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.449100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.449587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.450018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.450740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.451189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.451642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.592494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:36.601001 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4def3f94-056e-43ea-9e93-ebe45d6d1f6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.164700 Aug 27 21:09:36.601653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2244/4610] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:36.623250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.623904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.630101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.630697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.631151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.631984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.632472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.632896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.772687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:36.780626 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4caa5e4f-f2ee-4d23-83f8-c21cb9ab3927 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.161455 Aug 27 21:09:36.782384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2367/4611] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:36.804241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.804963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.811238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.811839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.812336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.813258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.813794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.814297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.956683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:36.965161 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5af5f04e-e248-470b-8132-8de82b458eeb tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.165039 Aug 27 21:09:36.965745 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2245/4612] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:36.987659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:36.988588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:36.997431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:36.998161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:36.998815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:36.999914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.000622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.001301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.147604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:37.156288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca785f88-2831-4d00-b0ca-57488f826e19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.174343 Aug 27 21:09:37.156883 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2368/4613] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:37.177232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:37.178301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:37.184790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.185301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.185748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.186480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.187648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.188093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.332604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:37.342109 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59a8f53d-8e92-4d98-afe4-8e630eff674e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.168991 Aug 27 21:09:37.342724 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2246/4614] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:37.363870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:37.364487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:37.371916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.372405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.372843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.373537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.373990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.374415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.437412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:37.438090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:37.444633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.445133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.445605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.446320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.447009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.447744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.527639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:37.536217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5c11ca0-4a2a-473e-94ea-09d1f21b5f96 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1295 microversion: 2.1 time: 0.102785 Aug 27 21:09:37.536804 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2247/4615] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:37 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:37.541732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:37.541885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:37.542334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:37.548609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.549084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.549620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.550351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:37.550828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:37.551254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:37.557573 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4cdf24f4-2063-4070-bd78-84236e33f5b9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.197766 Aug 27 21:09:37.572147 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2369/4616] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:37.685884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:37.693934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03fd0893-aafb-404a-a43a-2cf5f47e52b9 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.155899 Aug 27 21:09:37.694518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2248/4617] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:37 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:38.558299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:38.559016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:38.564064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:38.570615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:38.571177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:38.571759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:38.572541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:38.573012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:38.573462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:38.718820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:38.720403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:38.729011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:38.735468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:38.736211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:38.737850 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50c10245-ad35-40cb-98de-634a6995d404 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.183590 Aug 27 21:09:38.737991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:38.740498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:38.740630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2370/4618] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:38 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:38.740747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:38.740747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:38.915939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:38.924807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d13d540-1ade-41e4-aa24-156b31a8f27e tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.212522 Aug 27 21:09:38.926628 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2249/4619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:38 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:38.961280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b08530a-8e21-414c-8ad0-49c21743bc07", "name": "network-vif-plugged", "status": "completed", "tag": "58ef315b-1dba-450d-b340-d8db8ff3c07d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:38.974105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:38.976185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:38.976615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:38.988643 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] Creating event network-vif-plugged:58ef315b-1dba-450d-b340-d8db8ff3c07d for instance 1b08530a-8e21-414c-8ad0-49c21743bc07 on nch1-master-1 Aug 27 21:09:38.995886 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7beb6fce-3496-4482-9372-74efd93f82d0 req-d3793785-e24e-4af5-bede-57efd1480c48 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038807 Aug 27 21:09:38.997057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2371/4620] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:39.462562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:39.463067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:39.469581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.470076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.470521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.471233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.472842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.472842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.562550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'services' on Instance uuid 652b2888-c2e3-425c-afdc-0d209b09f16c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:39.628046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:39.640008 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ddbec066-4aff-4026-ac3c-8142d8e3c801 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments/954fbcb2-8e60-468a-8fb4-ab2f508f825d" status: 202 len: 0 microversion: 2.1 time: 0.181299 Aug 27 21:09:39.640948 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2250/4621] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:09:39 2022] DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments/954fbcb2-8e60-468a-8fb4-ab2f508f825d => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:39.652281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:39.654842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:39.663274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.667506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.667506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.667506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.667506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.681626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.731975 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-454ca0fe-46f1-4b09-b129-4288af220e02 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086034 Aug 27 21:09:39.735498 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2372/4622] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:39 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:39.750362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08894f9-51d1-4343-ac4d-194a49f114e9", "tag": "77c78cae-b84d-44f1-8005-fb9bb991ab77"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:39.764743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:39.765503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:39.772362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.772987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.773486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.773593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.774099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.774519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.774639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.775184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.775750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.789263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] Creating event network-changed:77c78cae-b84d-44f1-8005-fb9bb991ab77 for instance f08894f9-51d1-4343-ac4d-194a49f114e9 on nch2-master-1 Aug 27 21:09:39.794998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bdc7b4d3-707e-49cc-a328-3131f31717e3 req-7c660d21-a3fa-49bc-aa52-e4b5d7a006d8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050173 Aug 27 21:09:39.795888 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2251/4623] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:39.913999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:39.922319 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad0d6bad-6e48-404f-8df3-63882b5784f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.166229 Aug 27 21:09:39.922907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2373/4624] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:39 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:39.946910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:39.947640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:39.954429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.955063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.955379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:39.956087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:39.956744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:39.957174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:40.095076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:40.106665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0285e3e1-eba5-43c7-9cb8-5755a7c64f50 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1314 microversion: 2.1 time: 0.164213 Aug 27 21:09:40.107450 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2252/4625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:39 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:40.745556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:40.748108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:40.755400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:40.755919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:40.756371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:40.757079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:40.757538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:40.757973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:40.789860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d48b9e3-6794-4bbc-a3e9-a6c11f518d11 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048486 Aug 27 21:09:40.790444 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2374/4626] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:40 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:40.942782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:40.944293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:40.952434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:40.953599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:40.954078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:40.955159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:40.955924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:40.957433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.098696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:41.106990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-399e98ed-4950-4b4f-8237-0b9e255d8530 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.168367 Aug 27 21:09:41.107602 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2253/4627] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:40 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:41.128223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:41.128847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:41.135273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.135797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.136207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.136931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.137444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.137883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.273837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:41.282225 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95dbc8e8-de92-4b87-ac3d-184a4281cf8d tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1498 microversion: 2.1 time: 0.158130 Aug 27 21:09:41.282809 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2375/4628] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:41 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:41.725436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:41.725778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:41.732126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.732570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.733055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.733764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.734227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.734658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.760417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:09:41.802650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:41.804953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:41.812556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.813101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.813615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.814401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.814862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.815502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.850580 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-757e0f4e-5160-454e-b9ab-3244411b89eb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051647 Aug 27 21:09:41.851835 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2376/4629] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:41 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:41.853826 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c59f7e6e-adb1-4ca9-8c49-da77200d49d0 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 204 len: 0 microversion: 2.1 time: 0.133341 Aug 27 21:09:41.854455 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2254/4630] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:09:41 2022] DELETE /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:09:41.869025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:41.869961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:41.876352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.876846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.877313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:41.878126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:41.878457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:41.878882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:42.020011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:42.029832 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06e127f7-8a67-4875-ab08-9cee3a03dc90 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1504 microversion: 2.1 time: 0.164871 Aug 27 21:09:42.030708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2377/4631] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:41 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:42.131642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:42.132335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:42.141796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:42.142410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:42.142982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:42.143955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:42.144532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:42.145095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:42.299078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:42.308656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35d0456f-92bd-42c5-8bc3-8e03f454e126 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.182661 Aug 27 21:09:42.309490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2255/4632] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:42 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:42.863597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:42.866603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:42.877335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:42.877948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:42.878466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:42.879387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:42.880011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:42.880570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:42.915523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52267097-9f82-4a3e-ab14-ac901a8d9f5b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057025 Aug 27 21:09:42.916125 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2378/4633] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:42 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:43.053913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:43.054547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:43.060793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.061279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.061978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.062683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.063136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.063791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.205156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:43.213823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-736acaac-9029-4b8a-8057-6a4295502ca3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1504 microversion: 2.1 time: 0.163979 Aug 27 21:09:43.215063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2256/4634] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:43 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:43.330160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:43.330792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:43.338166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.338748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.339660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.340503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.340966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.341593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.494905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:43.503742 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6730485b-22f3-4df0-964b-8e68c1f0c1b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.177559 Aug 27 21:09:43.506279 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2379/4635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:43 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:43.929157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:43.932335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:43.939225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.939746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.940189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.940899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:43.941356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:43.941785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:43.977846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d014dac-da58-40e4-b253-3e095c6f42d1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053277 Aug 27 21:09:43.978356 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2257/4636] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:43 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:09:44.061340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:44.063821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.071628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.072120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.072551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.074021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.074021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.074645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.103390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Cannot 'reboot' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action HTTP/1.1 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 28 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: {"reboot": {"type": "HARD"}} Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'reboot' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a07479cc-0162-4f91-afb1-59a070704d0a', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a07479cc-0162-4f91-afb1-59a070704d0a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:09:44.105135 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 409 to user: Cannot 'reboot' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5eb379de-e02f-4a90-a650-eb994087bedc tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action" status: 409 len: 145 microversion: 2.1 time: 0.053021 Aug 27 21:09:44.109838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2380/4637] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:44 2022] POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:09:44.121705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:44.124932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.131111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.131685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.132878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.133028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.133405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.133843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.161979 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Cannot 'rebuild' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action HTTP/1.1 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 65 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'rebuild' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a07479cc-0162-4f91-afb1-59a070704d0a', 'body': {'rebuild': {'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e'}}} Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a07479cc-0162-4f91-afb1-59a070704d0a in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:44.164027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 409 to user: Cannot 'rebuild' instance a07479cc-0162-4f91-afb1-59a070704d0a while it is in vm_state rescued {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4d78738-1b70-410e-98f9-6703a893e137 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action" status: 409 len: 146 microversion: 2.1 time: 0.048980 Aug 27 21:09:44.167805 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2258/4638] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:09:44 2022] POST /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a/action => generated 146 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:09:44.177531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:44.178024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.185301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.185802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.186247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.186966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.187467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.187903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.217034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:09:44.240044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:44.241744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.250124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.250886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.251540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.252525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.252925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.253354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.321118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd641c30-eb9b-498e-9734-47c24cb1e709 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 204 len: 0 microversion: 2.1 time: 0.147597 Aug 27 21:09:44.325083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2381/4639] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:09:44 2022] DELETE /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:09:44.334416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:44.335884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.343112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.343680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.344248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.344831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.345603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.346013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.351602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:44.555048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:44.563376 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c16a855-b34b-45cf-b204-d1be10bb3785 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1504 microversion: 2.1 time: 0.328012 Aug 27 21:09:44.564131 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2259/4640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:44 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:44.568787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:44.569437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:44.576611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.577071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.577673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.578565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.579171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.579808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.598181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:44.608564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e41f914-7f74-447b-9d73-a4283c0484e1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1686 microversion: 2.1 time: 0.277546 Aug 27 21:09:44.620205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2382/4641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:44 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1686 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:09:44.771490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b08530a-8e21-414c-8ad0-49c21743bc07", "name": "network-vif-deleted", "tag": "58ef315b-1dba-450d-b340-d8db8ff3c07d"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:44.781559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:44.782050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:44.782482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:44.794072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] Creating event network-vif-deleted:58ef315b-1dba-450d-b340-d8db8ff3c07d for instance 1b08530a-8e21-414c-8ad0-49c21743bc07 on nch1-master-1 Aug 27 21:09:44.797799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:44.799138 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d638f990-e12c-4b14-a950-87344b81df4b req-c6eb1f5b-23f9-4cd1-b7d6-c657dc75132a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031610 Aug 27 21:09:44.799767 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2383/4642] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:44.806962 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-09122fb1-1416-4836-bb3c-9cb18d4f4fb4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.241727 Aug 27 21:09:44.807674 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2260/4643] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:44 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:45.303723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:45.305482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:45.314836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:45.315818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:45.325254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.325755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.326194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.326901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.327373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.327805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.527814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.537356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.538840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.540152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fecb9245-fe50-4336-9047-c0b6cb02129c tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2950 microversion: 2.32 time: 0.237877 Aug 27 21:09:45.540715 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2384/4644] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:09:45 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2950 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:09:45.565063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:45.565597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:45.568517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:45.574372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.574862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.575566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.576372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.576830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.577261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.588149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:45.588765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:45.595369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.595897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.596422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.597118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.597573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.597986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.685954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.694883 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2bac256a-3b76-45a4-917b-26742a740e89 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1462 microversion: 2.1 time: 0.111734 Aug 27 21:09:45.695491 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2385/4645] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:45 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:45.700042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:45.700652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:45.706471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.706962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.707504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.708205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.708663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.709090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.731593 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8d12bb6-3cbe-4a16-8baf-d5ac17884d31 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.170555 Aug 27 21:09:45.732825 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2261/4646] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:09:45 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45/os-interface => generated 1832 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:09:45.827994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:45.828704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:45.836986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.837637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.838479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.839985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:45.840609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:45.841234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:45.865749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.875593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b83616bb-fc04-486a-a4c1-0c636532cc03 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1686 microversion: 2.1 time: 0.179009 Aug 27 21:09:45.876188 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2386/4647] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:45 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:45.980974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:45.989016 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-67409211-70e3-4ec4-a0ce-23f734258938 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.165047 Aug 27 21:09:45.989656 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2262/4648] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:45 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:46.716782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:46.717410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:46.725285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:46.725789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:46.726230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:46.727101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:46.727660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:46.728164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:46.795238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:46.803333 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-237bd586-e4d5-413a-910f-0c830cfac2d3 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1462 microversion: 2.1 time: 0.091015 Aug 27 21:09:46.803925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2387/4649] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:46 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:46.897054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:46.897693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:46.905706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:46.906202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:46.906643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:46.907373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:46.907891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:46.908279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.010860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:47.011513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:47.018153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:47.018640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:47.019079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.019810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:47.020271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:47.020697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.043909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:47.051955 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9bd5869-c9c5-46bc-a018-5efe5bf3b55a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1686 microversion: 2.1 time: 0.158921 Aug 27 21:09:47.052572 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2263/4650] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:46 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:47.158511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:47.167185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5077503-dfed-419a-b282-4dc7d616ef8a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.160866 Aug 27 21:09:47.167810 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2388/4651] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:47 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:47.427253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08894f9-51d1-4343-ac4d-194a49f114e9", "name": "network-vif-plugged", "status": "completed", "tag": "77c78cae-b84d-44f1-8005-fb9bb991ab77"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:47.437625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:47.438075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:47.438870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.453814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] Creating event network-vif-plugged:77c78cae-b84d-44f1-8005-fb9bb991ab77 for instance f08894f9-51d1-4343-ac4d-194a49f114e9 on nch2-master-1 Aug 27 21:09:47.459010 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f94ba29d-1f7f-4781-985f-20dd232a0b91 req-50123d2c-cc12-4090-aacc-3d7d541fcf7b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Aug 27 21:09:47.459855 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2264/4652] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:47.827485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:47.828111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:47.835921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:47.836436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:47.836875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.837583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:47.838031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:47.838451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:47.909709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:47.918870 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-89571129-eae8-4326-b717-31b89cbf5574 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1462 microversion: 2.1 time: 0.095520 Aug 27 21:09:47.919960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2389/4653] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:47 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:48.073924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:48.074789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:48.082473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.083063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.083548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.084358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.084985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.085591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.190060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:48.190904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:48.199902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.200963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.201874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.203065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.204286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.205116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.246299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:48.254766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-792d6a76-8003-4f8e-bc55-35b3340cce1a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1686 microversion: 2.1 time: 0.186224 Aug 27 21:09:48.269906 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2265/4654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:48 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:48.382557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:48.394813 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07521b3a-dff4-4ed2-93b5-590953ab2722 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1363 microversion: 2.1 time: 0.209085 Aug 27 21:09:48.395909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2390/4655] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:48 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:48.952207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:48.953225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:48.959651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.960133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.960567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.961266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.961724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.962335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.995076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:48.995591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:48.996044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:48.996483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lazy-loading 'fault' on Instance uuid 1b08530a-8e21-414c-8ad0-49c21743bc07 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:49.043137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf9744f89fe4df9a10e9cb0297cc7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0224e49310e4b1ca2e9c8aa7999dda6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:49.051551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad7b85ad-8bdb-4042-bfd8-8831a8a38453 tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 200 len: 1304 microversion: 2.1 time: 0.104960 Aug 27 21:09:49.052409 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2266/4656] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:48 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:49.285798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:49.291975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:49.305482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.307095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.307802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.309361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.310628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.311295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.421022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:49.422239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:49.433136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.433955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.434516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.435267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.435908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.436613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.468667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:49.677259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:49.688900 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae799553-da26-413c-9e60-83046f635820 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1686 microversion: 2.1 time: 0.414820 Aug 27 21:09:49.689958 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2391/4657] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:49 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1686 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:49.809335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:49.818041 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c33d6eb-7aa7-4664-a069-adf126fa7183 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1548 microversion: 2.1 time: 0.404051 Aug 27 21:09:49.819084 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2267/4658] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:49 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1548 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:49.841061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:49.841833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:49.849626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.850188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.850735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.851607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:49.852299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:49.852898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:49.959062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28d93d03-6b59-475d-a69b-48a69f90a072 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123455 Aug 27 21:09:49.959847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2392/4659] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:09:49 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:50.076410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:50.077647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] [instance: 1b08530a-8e21-414c-8ad0-49c21743bc07] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:50.087562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.089540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.090346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.091566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.091950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.091950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.109176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] HTTP exception thrown: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Request method failure captured: Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 HTTP/1.1 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCofpJleNX7l69i3rh8oJYHTnJ_dEV7_aK7AuoDEEkJFGiwFjt9Osh6ysmsWA3BYoVJrcGgkoYwXl3TnBmebe2ytEoAVWcDlStbZkmBUhoSe-v5D0Pfs1KL-EeMSfO9U8YMj-Ii6-XWvqSju5Tf2iDF7Hmwq95AZVKwxkMu9arN3c-oc Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f0224e49310e4b1ca2e9c8aa7999dda6 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesActionsTest-65705369 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0224e49310e4b1ca2e9c8aa7999dda6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f0224e49310e4b1ca2e9c8aa7999dda6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f0224e49310e4b1ca2e9c8aa7999dda6", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0224e49310e4b1ca2e9c8aa7999dda6"}]}] Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesActionsTest-65705369 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f0224e49310e4b1ca2e9c8aa7999dda6 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesActionsTest-65705369 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesActionsTest-65705369-project Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: eaf9744f89fe4df9a10e9cb0297cc7d9 Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesActionsTest-65705369-project Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1b08530a-8e21-414c-8ad0-49c21743bc07'} Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:50.111605 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] Returning 404 to user: Instance 1b08530a-8e21-414c-8ad0-49c21743bc07 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2d67feea-fdbf-4ca8-bc6a-f767d8f4010c tempest-VolumesActionsTest-65705369 tempest-VolumesActionsTest-65705369-project] 10.222.0.40 "GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07" status: 404 len: 111 microversion: 2.1 time: 0.042733 Aug 27 21:09:50.116304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2268/4660] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:50 2022] GET /compute/v2.1/servers/1b08530a-8e21-414c-8ad0-49c21743bc07 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:09:50.444955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652b2888-c2e3-425c-afdc-0d209b09f16c", "name": "network-vif-deleted", "tag": "c221895f-e7ba-4149-a46f-ec89d33ba0a0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:50.465442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.466311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.466934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.488704 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] Creating event network-vif-deleted:c221895f-e7ba-4149-a46f-ec89d33ba0a0 for instance 652b2888-c2e3-425c-afdc-0d209b09f16c on nch1-master-1 Aug 27 21:09:50.513655 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-596f9287-47d4-4bc1-971a-44351aab7020 req-3638f75e-813f-47ea-ba09-56f0a79cc2f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071271 Aug 27 21:09:50.514588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2393/4661] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:50.719756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:50.721122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:50.730145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:50.732787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.735352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.736184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.736963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.737416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.737840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.800442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:50.800931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:50.801366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:50.801846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'fault' on Instance uuid 652b2888-c2e3-425c-afdc-0d209b09f16c {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:50.859756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:50.869148 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-430702d5-a8cf-4169-86d8-79c8f055bab1 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 200 len: 1335 microversion: 2.1 time: 0.162566 Aug 27 21:09:50.869835 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2269/4662] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:50 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 1335 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:51.329907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08894f9-51d1-4343-ac4d-194a49f114e9", "tag": "77c78cae-b84d-44f1-8005-fb9bb991ab77"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:51.344544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:51.345521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:51.346646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:51.362125 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] Creating event network-changed:77c78cae-b84d-44f1-8005-fb9bb991ab77 for instance f08894f9-51d1-4343-ac4d-194a49f114e9 on nch2-master-1 Aug 27 21:09:51.368825 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c664e2e9-2172-458c-ad4d-1557e0af1743 req-5309b8fc-c866-42a8-b62c-e59274979182 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043643 Aug 27 21:09:51.370184 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2394/4663] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:51.895933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:51.897376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: 652b2888-c2e3-425c-afdc-0d209b09f16c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:51.907521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:51.910843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:51.914340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:51.915615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:51.918459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:51.919243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:51.954331 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c HTTP/1.1 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '652b2888-c2e3-425c-afdc-0d209b09f16c'} Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:51.956495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 404 to user: Instance 652b2888-c2e3-425c-afdc-0d209b09f16c could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba288955-141a-4fa4-8bd6-fe3433fc05a5 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c" status: 404 len: 111 microversion: 2.1 time: 0.074040 Aug 27 21:09:51.963508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2270/4664] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:51 2022] GET /compute/v2.1/servers/652b2888-c2e3-425c-afdc-0d209b09f16c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:09:51.974572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-806e3e94-ab40-409b-a5d8-acd36d08000b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '.version_select at 0x7ff84e560670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:52.020211 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-806e3e94-ab40-409b-a5d8-acd36d08000b tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311781983" status: 202 len: 0 microversion: 2.1 time: 0.051296 Aug 27 21:09:52.023116 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2395/4665] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311781983 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:53.265130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:53.265802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:53.277319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:53.278485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:53.279643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:53.280973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:53.282048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:53.282942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:53.352628 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e33e8457-5373-4360-9698-dc458830c12b tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/ips" status: 200 len: 149 microversion: 2.1 time: 0.289685 Aug 27 21:09:53.360553 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2271/4666] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:09:53 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/ips => generated 149 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:55.027316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:55.030073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:55.038685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.039179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.039650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:55.040647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.041395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.042066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:55.405578 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383458 Aug 27 21:09:55.406852 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2396/4667] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:09:55 2022] POST /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:09:55.703286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:55.703892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:55.710430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.711098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.711574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:55.713036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.713658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.714603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:55.752098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:09:55.903893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6af71255-3251-451c-992c-d2b42c696de8 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 204 len: 0 microversion: 2.1 time: 0.203853 Aug 27 21:09:55.908841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2272/4668] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:09:55 2022] DELETE /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:09:55.915242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:55.916006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:55.924916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.925476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.925918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:55.926776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:55.927240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:55.927712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:56.095824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:56.106500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f776f6f-6d88-47e5-be76-5aefd86170bd tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1508 microversion: 2.1 time: 0.195890 Aug 27 21:09:56.107726 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2397/4669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:55 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:57.132396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:57.135380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:57.144533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:57.145291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:57.145945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:57.147171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:57.150413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:57.151143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:57.317255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:57.329114 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92d40fe5-27bb-46e1-ad19-b95e83804e28 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1508 microversion: 2.1 time: 0.203103 Aug 27 21:09:57.329752 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2273/4670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:57 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:58.355919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:58.356527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:58.376912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:58.377552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:58.378018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:58.378772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:58.379238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:58.385806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:58.441190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07479cc-0162-4f91-afb1-59a070704d0a", "name": "network-vif-deleted", "tag": "1073f6ac-a607-4655-9afc-bc62716d5188"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:58.464505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:58.466655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:58.468153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:58.489134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] Creating event network-vif-deleted:1073f6ac-a607-4655-9afc-bc62716d5188 for instance a07479cc-0162-4f91-afb1-59a070704d0a on nch2-master-1 Aug 27 21:09:58.496516 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0f29e994-c5c2-4abb-b41e-9d450f93b5ba req-68445606-4159-4824-b55e-8ea40bcee19d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132305 Aug 27 21:09:58.502614 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2274/4671] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:58.509264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:58.518294 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd1c3d78-2966-486b-916f-1cba33be5ae9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1466 microversion: 2.1 time: 0.170299 Aug 27 21:09:58.519363 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2398/4672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:58 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1466 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:09:58.954733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:09:58.960167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:58.967463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:58.974498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:58.975217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:58.976156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:58.976773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:58.977368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.132392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments HTTP/1.1 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 74 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: {"volumeAttachment": {"volumeId": "5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5"}} Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'server_id': '848c4479-c568-4e24-b2f0-692592658735', 'body': {'volumeAttachment': {'volumeId': '5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5'}}} Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:59.135063 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 Aug 27 21:09:59.140043 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:09:59.142605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 400 to user: Invalid volume: volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is already attached to instances: 848c4479-c568-4e24-b2f0-692592658735 {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:09:59.143604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-788c9d5d-3989-4031-a6fa-8cddb87c6608 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.193383 Aug 27 21:09:59.144982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2275/4673] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:09:58 2022] POST /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:09:59.232696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:59.233228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:59.240900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.241415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.241881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.243437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.244641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.245103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.364789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'services' on Instance uuid 848c4479-c568-4e24-b2f0-692592658735 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:59.459392 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b45fe849-185f-47ae-a708-2bff6ddccb49 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments/5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5" status: 202 len: 0 microversion: 2.1 time: 0.230629 Aug 27 21:09:59.460304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2399/4674] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:09:59 2022] DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments/5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:09:59.470976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:59.476565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:59.493261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.494827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.495631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.496786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.497520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.498177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.541059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:09:59.542341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:09:59.559414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.559922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.561413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.564124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.564605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.565026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.574828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-130881f0-84d1-4d08-93eb-bb18ae8319b6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107954 Aug 27 21:09:59.575214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2276/4675] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:09:59 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:09:59.585318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:09:59.635883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:09:59.636462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:09:59.637011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:09:59.637681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'fault' on Instance uuid a07479cc-0162-4f91-afb1-59a070704d0a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:09:59.694875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:09:59.710166 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7fd67c93-f590-4dc5-829f-cbbada635827 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 200 len: 1312 microversion: 2.1 time: 0.174043 Aug 27 21:09:59.711893 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2400/4676] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:09:59 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:10:00.599403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:00.601692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:00.610429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.611193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.611654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.612354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.612803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.613417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.646440 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc32b2bf-3e23-4761-950c-2f18bd83ae70 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051086 Aug 27 21:10:00.646650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2277/4677] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:10:00 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:10:00.736866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:00.737320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:00.738060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: a07479cc-0162-4f91-afb1-59a070704d0a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:00.738532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:00.745140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.745875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.746456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.747357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.747970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.748388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.749811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.751853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.752865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.754018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.754581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.756157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.778149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:10:00.788008 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a HTTP/1.1 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a07479cc-0162-4f91-afb1-59a070704d0a'} Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:10:00.794097 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. Aug 27 21:10:00.798920 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:10:00.800205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 404 to user: Instance a07479cc-0162-4f91-afb1-59a070704d0a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:00.801910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1dcbdf5-ec8a-4527-ae64-0321b10013ee tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a" status: 404 len: 111 microversion: 2.1 time: 0.068921 Aug 27 21:10:00.807456 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2401/4678] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:00 2022] GET /compute/v2.1/servers/a07479cc-0162-4f91-afb1-59a070704d0a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:10:00.817138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:00.818024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:00.829586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.830861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.831672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.832825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.833502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.834172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.870722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:10:00.911465 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e1d17787-1a85-4038-a000-327981f71de0 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 204 len: 0 microversion: 2.1 time: 0.176320 Aug 27 21:10:00.914252 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2278/4679] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:10:00 2022] DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:10:00.923188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:00.924287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:00.931015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.931850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.932353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:00.933168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:00.933724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:00.934233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:01.012385 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eec5ea45-ad96-4698-8699-613be1e7ee21 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 204 len: 0 microversion: 2.1 time: 0.202697 Aug 27 21:10:01.013141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2402/4680] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:10:00 2022] DELETE /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:10:01.024564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:01.025418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:01.033418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:01.033418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:01.033832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:01.034871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:01.035401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:01.035846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:01.166963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:01.175698 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d6ca860-2f86-42d9-b9c4-f6cc39660cdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1680 microversion: 2.1 time: 0.256737 Aug 27 21:10:01.189693 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2279/4681] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:00 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:01.260903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:01.269605 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-617ff2f7-184b-483a-a58e-5a222566aeeb tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.251899 Aug 27 21:10:01.271235 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2403/4682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:01 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:02.198584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:02.199465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:02.206983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:02.207724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:02.208265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:02.208960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:02.209595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:02.210175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:02.292575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:02.293629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:02.311385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:02.311962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:02.312412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:02.313139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:02.313598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:02.315979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:02.479927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:02.508038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62aacc3c-2630-47c0-b5f7-94bb7411b29a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1680 microversion: 2.1 time: 0.312229 Aug 27 21:10:02.519373 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2280/4683] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:02 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1680 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:02.557785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:02.566250 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6414ecb0-4c07-4e46-97c0-c624d3636a71 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.278021 Aug 27 21:10:02.581842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2404/4684] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:02 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:10:03.539487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:03.539487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:03.552773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:03.553249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:03.553748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:03.554487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:03.555036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:03.555546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:03.590120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:03.590862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:03.599379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:03.600095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:03.600847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:03.601661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:03.602441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:03.603128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:03.692353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:03.706180 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d998cdf-bc64-4e14-93ee-c2eede288471 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1612 microversion: 2.1 time: 0.175208 Aug 27 21:10:03.707220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2281/4685] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:03 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1612 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:03.905720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:03.918117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44b01520-15ac-4e28-9b15-b5291eb0370a tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1521 microversion: 2.1 time: 0.330303 Aug 27 21:10:03.919205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2405/4686] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:03 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:04.076862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848c4479-c568-4e24-b2f0-692592658735", "name": "network-vif-deleted", "tag": "1214c1e3-8b25-4a36-a919-a1388fb450a3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:04.091702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.092570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.094029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.115805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] Creating event network-vif-deleted:1214c1e3-8b25-4a36-a919-a1388fb450a3 for instance 848c4479-c568-4e24-b2f0-692592658735 on nch2-master-1 Aug 27 21:10:04.149473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e363a06f-68f0-41da-a740-7c5c5d97cf98 req-b3af2175-ad60-41e6-920e-267a2f2af6c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081174 Aug 27 21:10:04.153794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2282/4687] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:04.629784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9133a12-8ade-4172-8ebf-cf81a8e3122b", "name": "network-vif-deleted", "tag": "38211ab7-bb51-4b28-b052-7dd55bbd2ec2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:04.673626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.678702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.681609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.698108 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] Creating event network-vif-deleted:38211ab7-bb51-4b28-b052-7dd55bbd2ec2 for instance c9133a12-8ade-4172-8ebf-cf81a8e3122b on nch1-master-1 Aug 27 21:10:04.704095 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1ba990eb-a190-42e7-80bf-3187625adae0 req-dfcc50f6-50c0-4a73-99f9-4f11352dca07 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078820 Aug 27 21:10:04.705260 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2406/4688] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:04.729610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:04.730306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:04.740002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.744112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.744967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.746724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.747891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.752757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.795227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:04.831508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.833245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.835672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.839592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'fault' on Instance uuid 848c4479-c568-4e24-b2f0-692592658735 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:04.945808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:04.947118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:04.948309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:04.960663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ceb5242-3507-4722-9d13-ae5a697152c4 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 200 len: 1330 microversion: 2.1 time: 0.235867 Aug 27 21:10:04.962125 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2283/4689] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:04 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 1330 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:04.967361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.974298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.975593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:04.980212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:04.981111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:04.985472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:05.107659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:05.109300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:05.111024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:05.112444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lazy-loading 'fault' on Instance uuid c9133a12-8ade-4172-8ebf-cf81a8e3122b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:05.184206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d8126f174f5424ebdcc1f062ffb9b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ebee97f90d4fafbcadeb4e8279c8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:05.199705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d7117cc-a0b8-4b52-8e5b-f58331a8b1f9 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 200 len: 1311 microversion: 2.1 time: 0.259440 Aug 27 21:10:05.220581 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2407/4690] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:04 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 1311 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:10:05.988561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:05.989956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:05.997767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:05.999851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:06.002073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:06.003591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:06.004545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:06.006599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:06.039214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 HTTP/1.1 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '848c4479-c568-4e24-b2f0-692592658735'} Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:06.046681 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c0d6f78a-f2d6-4b21-a4b6-9f1da9101f45 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 404 len: 111 microversion: 2.1 time: 0.063662 Aug 27 21:10:06.050824 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2284/4691] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:05 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:10:06.059769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d714c293-39f8-4407-b36c-7fd289214386 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '.version_select at 0x7ff84e642a60>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:06.088607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d714c293-39f8-4407-b36c-7fd289214386 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223556278" status: 202 len: 0 microversion: 2.1 time: 0.034850 Aug 27 21:10:06.089998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2408/4692] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 21:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223556278 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:10:06.223828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:06.224781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] [instance: c9133a12-8ade-4172-8ebf-cf81a8e3122b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:06.235291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:06.237921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:06.238624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:06.240224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:06.244812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:06.245815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:06.271154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] HTTP exception thrown: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Request method failure captured: Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b HTTP/1.1 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCobjKXGwvCwCsoeyZbN-Db_u39YUhCfq9KN9LTPHwx3tIE4Isk9x824cO8H31ccMTE8GzOw5hwuxWq7CUB15TCFZeIOfImIe-y9omfjzf5IyryWKzaNoTlguDTmdmiuUo8XyQyyu7qW-sOgwxoD9i_OWaijc_6aqno56q5aqMc3N6ic Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4ebee97f90d4fafbcadeb4e8279c8f8", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4ebee97f90d4fafbcadeb4e8279c8f8"}]}] Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e4ebee97f90d4fafbcadeb4e8279c8f8 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-904246104 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 5d8126f174f5424ebdcc1f062ffb9b69 Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerRescueNegativeTestJSON-904246104-project Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'c9133a12-8ade-4172-8ebf-cf81a8e3122b'} Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.273108 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. Aug 27 21:10:06.277023 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:06.278953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] Returning 404 to user: Instance c9133a12-8ade-4172-8ebf-cf81a8e3122b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:06.280354 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d703b86-d0bf-4abc-b142-66f720ded488 tempest-ServerRescueNegativeTestJSON-904246104 tempest-ServerRescueNegativeTestJSON-904246104-project] 10.222.0.40 "GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b" status: 404 len: 111 microversion: 2.1 time: 0.061561 Aug 27 21:10:06.285762 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2285/4693] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:06 2022] GET /compute/v2.1/servers/c9133a12-8ade-4172-8ebf-cf81a8e3122b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:10:06.978377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d7b589bf-0dd4-4e13-8534-5d9585103c20 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: .version_select at 0x7ff84e4f8550>, body: {"keypair": {"name": "tempest-keypair-2015806161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcvBf0XnKF0IeQ+go1Nui62hoWvuRc144gyoPtM3+qyhjdc/MDdnUF9ujGMEhIzJ3kooTUi88XwqDwDXrAiSe0q4YaDvdm6OxzEcQt7hY2W4pLrw/SqIDilVsgWdyjMeA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:06.997369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:07.011237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d7b589bf-0dd4-4e13-8534-5d9585103c20 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:10:07.021034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d7b589bf-0dd4-4e13-8534-5d9585103c20 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:10:07.051497 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d7b589bf-0dd4-4e13-8534-5d9585103c20 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077517 Aug 27 21:10:07.052844 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2409/4694] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:10:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:09.541931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1433876643", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b51e83b-3888-45e9-b028-18277f96139f"}], "security_groups": [{"name": "tempest-securitygroup--1686544292"}], "key_name": "tempest-keypair-2015806161", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:09.699113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] validate_networks() for [('3b51e83b-3888-45e9-b028-18277f96139f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:10:10.586660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:10:10.587251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:10:10.587898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:10:10.588407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:10:10.588963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:10:10.616504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:10.617350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:10.618116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:10.619025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:10.619686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:10.620130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:10.642067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:10:10.648470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Getting quotas for user f0df3ca755314bdc8e8b236abb0924b2 and project d8b4c86f3463480ab7ea7fc27c7e3c16. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:10:10.677089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:10:10.682724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:10:10.773663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2032cfdf-dce3-4ddb-a705-7d033d1706d3 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.236135 Aug 27 21:10:10.774801 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2286/4695] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:10:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:10:10.787042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-987ccbf1-6902-4993-887a-5ba37f7ace1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:10.787691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-987ccbf1-6902-4993-887a-5ba37f7ace1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:10.874186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-987ccbf1-6902-4993-887a-5ba37f7ace1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:10.886836 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-987ccbf1-6902-4993-887a-5ba37f7ace1f tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1242 microversion: 2.1 time: 0.104088 Aug 27 21:10:10.903559 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2410/4696] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:10 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:11.933565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:11.934823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:11.958510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:11.963926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:11.966963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:11.971393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:11.972071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:11.976107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:12.152567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:12.168849 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3bd06604-dbca-489d-b886-9062d078a893 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1294 microversion: 2.1 time: 0.263167 Aug 27 21:10:12.173038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2287/4697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:11 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1294 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:13.194728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:13.195536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:13.205224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:13.211237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:13.211771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:13.212526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:13.213008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:13.213427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:13.339915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:13.356057 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-377d7f03-e54b-451f-b313-5e8324a8d659 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1300 microversion: 2.1 time: 0.165547 Aug 27 21:10:13.358904 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2411/4698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:13 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:14.386204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:14.386948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:14.401095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:14.401599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:14.405531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:14.406364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:14.406847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:14.407293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:14.666430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:14.677794 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de7ab998-5624-4fd6-93b7-c355848e8df6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.302974 Aug 27 21:10:14.688726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2288/4699] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:14 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:14.766418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:14.767148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:14.778618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:14.779263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:14.780047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:14.780840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:14.782956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:14.783705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:14.847623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:10:15.032278 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-51ef055b-2b2c-47af-80d4-209ca72b6f4c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 204 len: 0 microversion: 2.1 time: 0.270917 Aug 27 21:10:15.033107 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2412/4700] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:10:14 2022] DELETE /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:10:15.053098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:15.053881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:15.060494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2057385727", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:15.062429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.065643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.066135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.067203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.067744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.068260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.131927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:10:15.132351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:10:15.132985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:10:15.133966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:10:15.134590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:10:15.151481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.152617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.154114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.155107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.156192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.156959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.182953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Getting quotas for project e0aef10f8b344ee2b650b422ec25f9ae. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:10:15.189800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Getting quotas for user b713f8286eb14776a4b7bb219cadd029 and project e0aef10f8b344ee2b650b422ec25f9ae. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:10:15.207644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:10:15.210898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:10:15.277259 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6bf5a44f-d91b-4edb-8634-6eedbfc85bcd tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.490331 Aug 27 21:10:15.277851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:15.278712 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2289/4701] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:10:15.307505 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-224e605b-9469-47b1-87c0-c1bb8aa7cd92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1551 microversion: 2.1 time: 0.249669 Aug 27 21:10:15.309231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2413/4702] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:15 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1551 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:15.314709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:15.316124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:15.321129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71", "tag": "48970409-cca6-4ea3-b83f-7b75c24a936a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:15.335748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.336413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.336911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.351977 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] Creating event network-changed:48970409-cca6-4ea3-b83f-7b75c24a936a for instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 on nch1-master-1 Aug 27 21:10:15.358188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7286d556-3f2f-43b3-bf5f-abaf27d29563 req-e0848978-03c5-469d-9891-4101c2bc51a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077723 Aug 27 21:10:15.359463 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2290/4703] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:15.419141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:15.437028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:15.439720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:15.441087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-99cc5967-f34a-4075-a7b9-ca8cb1b96bbb tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1278 microversion: 2.57 time: 0.130694 Aug 27 21:10:15.441692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2414/4704] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:15 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:15.701751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:15.702385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:15.710609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.711462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.711901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.712872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:15.713327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:15.713747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:15.922578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:15.931007 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1def967f-2656-4967-b8fc-470dde310493 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.233819 Aug 27 21:10:15.931721 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2291/4705] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:15 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:16.335910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:16.336537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:16.347954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.349149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.349784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:16.350935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.350935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.351383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:16.465694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:16.466314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:16.473680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.473989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.474419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:16.475206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.475653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.476813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:16.902077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:16.910978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:16.913336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:16.914725 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f371cd1-d132-49d8-b66b-5ea64f3eea7f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1330 microversion: 2.57 time: 0.453439 Aug 27 21:10:16.915969 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2292/4706] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:16 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1330 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:16.929657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:16.942509 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb332e80-c565-476a-a460-40950b0a3930 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1551 microversion: 2.1 time: 0.611294 Aug 27 21:10:16.943672 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2415/4707] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:16 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1551 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:16.955721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:16.955721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:16.959956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.960461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.960959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:16.961902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:16.962549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:16.963170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:17.212923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:17.227154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36aa36d9-5872-488d-b955-94eda2dc5ec5 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.279109 Aug 27 21:10:17.245228 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2293/4708] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:16 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:17.453997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33f33b5-107e-47ad-8c0f-6b54acc6d1fa", "name": "network-vif-deleted", "tag": "742c425f-91e0-4305-8530-eea040757a1c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:17.467861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:17.468716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:17.469251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:17.482515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] Creating event network-vif-deleted:742c425f-91e0-4305-8530-eea040757a1c for instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa on nch1-master-1 Aug 27 21:10:17.488694 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8f51738a-235f-482b-801b-905d67c38e7b req-9ea6942e-9ed6-4584-bad6-3405608b345e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038343 Aug 27 21:10:17.489461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2416/4709] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:17.938845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:17.939521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:17.946209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:17.946705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:17.947423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:17.948709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:17.949286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:17.949718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:17.967135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:17.968280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:17.974676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:17.975517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:17.976141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:17.976923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:17.977387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:17.977818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:18.014639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:18.015156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:18.015869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:18.016352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid e33f33b5-107e-47ad-8c0f-6b54acc6d1fa {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:18.021522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:18.031465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:18.032953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:18.034326 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-01eba5ef-be15-4e3c-8be2-5cc648918949 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1336 microversion: 2.57 time: 0.099544 Aug 27 21:10:18.048972 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2294/4710] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:17 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:18.061853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:18.069720 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3046343c-60d7-4f80-856d-004d144bd75d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1338 microversion: 2.1 time: 0.107633 Aug 27 21:10:18.070335 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2417/4711] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:17 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:18.253101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:18.253101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:18.258252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:18.258765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:18.259166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:18.259887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:18.260335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:18.260763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:18.405329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:18.413347 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3771178f-2d44-409b-b6a8-45fc4edb1b6c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.167034 Aug 27 21:10:18.414027 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2295/4712] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:18 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:19.061685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:19.062568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:19.069513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.070015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.070469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.071175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.071719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.072257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.094298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:19.094932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:19.095714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:19.100280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:19.106158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.106930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.107386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.108218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.108695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.109447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.147208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.147902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.148498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.149237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid e33f33b5-107e-47ad-8c0f-6b54acc6d1fa {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:19.152689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:19.162259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:19.163633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:19.164795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f3ade3e-b006-45b3-9f7f-7999b85bc387 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1336 microversion: 2.57 time: 0.107743 Aug 27 21:10:19.165840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2418/4713] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:19 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:19.196415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:19.206225 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4491d16b-b1bc-4be3-9063-dc3c68a8c152 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1338 microversion: 2.1 time: 0.115914 Aug 27 21:10:19.206818 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2296/4714] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:19 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:10:19.436648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:19.437504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:19.446126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.446817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.447609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.448398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:19.448853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:19.449283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:19.583434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:19.593494 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b8fcee5-21fe-49f0-b41c-791c1de00bdd tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.161962 Aug 27 21:10:19.594178 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2419/4715] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:19 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:20.188076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:20.189010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:20.197186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.197746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.198197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.198981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.199484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.200115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.231187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:20.233343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:20.242435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.243201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.244637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.245581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.246118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.246681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.277906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:20.289218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:20.291479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:20.292707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d95abd4d-8700-48c8-92e0-c9ce2efed242 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1336 microversion: 2.57 time: 0.108854 Aug 27 21:10:20.293273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2297/4716] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:20 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:20.322606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.323217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.324478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.325048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid e33f33b5-107e-47ad-8c0f-6b54acc6d1fa {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:20.375075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:20.382778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-377d9967-0176-4947-b82a-4b7c69f1108f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 200 len: 1338 microversion: 2.1 time: 0.156520 Aug 27 21:10:20.396320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2420/4717] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:20 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 1338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:20.616511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:20.617156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:20.625121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.625755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.626205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.626981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:20.627956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:20.628456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:20.769051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:20.776964 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0abdcb99-449a-499f-ba0d-cfe80ddf0a3a tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.165262 Aug 27 21:10:20.777538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2298/4718] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:20 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:21.323358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:21.324102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.332432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.332932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.333377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.334281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.334740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.335378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.404360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.404629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:21.405245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: e33f33b5-107e-47ad-8c0f-6b54acc6d1fa] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.412229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.412728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.413168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.413299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.413879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.414326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.414881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.415022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.416239 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b043fbda-912d-46d7-99c3-ac1c7c4d8ba8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1357 microversion: 2.57 time: 0.097001 Aug 27 21:10:21.416946 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2421/4719] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:21 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:21.429973 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] HTTP exception thrown: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Request method failure captured: Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa HTTP/1.1 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCodkrZ6t2-28cfaSkItrMzxcB3j2Ki8YPP1YrIowChs1K-PK_kcUi_c3p7qsZtW9Q0VmJKBzXKC1SoIRAMUyj7oTKD5mK5KTjnYaOLkkubuWzqHkFEyHQoRMIwHyF4f1xIakvBkKlL3PUnfJNRy61iIF4Qq9A31NEU_laHMqJc3iHKo Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/795a623882274b06a65971bfe1398e29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_795a623882274b06a65971bfe1398e29", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}] Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: eee686b708a849c9a2e59a0ddba908e6 Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e33f33b5-107e-47ad-8c0f-6b54acc6d1fa'} Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:21.431759 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Returning 404 to user: Instance e33f33b5-107e-47ad-8c0f-6b54acc6d1fa could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-332bbc90-4933-402f-9692-1fbe04d04806 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa" status: 404 len: 111 microversion: 2.1 time: 0.032915 Aug 27 21:10:21.437562 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2299/4720] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:21 2022] GET /compute/v2.1/servers/e33f33b5-107e-47ad-8c0f-6b54acc6d1fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:10:21.441377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:21.444353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.451150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.451715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.452147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.452965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.453360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.453892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.571740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:10:21.572174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:10:21.572719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:10:21.573139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:10:21.573558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:10:21.647896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb83f8e2-a5fb-4ebc-83e6-de400d07e45d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '.version_select at 0x7ff84e0313a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:21.665118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.669168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb83f8e2-a5fb-4ebc-83e6-de400d07e45d tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-288527544" status: 202 len: 0 microversion: 2.1 time: 0.025525 Aug 27 21:10:21.675496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.676133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.676676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.677719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.678235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.678955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.685585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2300/4721] 10.222.0.40 () {58 vars in 1254 bytes} [Sat Aug 27 21:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-288527544 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:10:21.710747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-857839c1-9374-41f1-95f3-4e3029d4bbf3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "POST /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030/action" status: 202 len: 1138 microversion: 2.57 time: 0.275465 Aug 27 21:10:21.711958 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2422/4722] 10.222.0.40 () {62 vars in 1320 bytes} [Sat Aug 27 21:10:21 2022] POST /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030/action => generated 1138 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 21:10:21.730841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:21.731496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.738644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.739139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.739612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.740319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.740780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.741213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.798590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:21.799209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:21.806418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.806980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.809512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.809512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:21.809512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:21.809798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:21.818328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.831796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.834086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:21.835933 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-325d1f95-522a-47e7-8a75-7106bf53fa90 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.109220 Aug 27 21:10:21.838022 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2301/4723] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:21 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:22.028174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:22.036668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd210bc4-2212-4820-88b2-94e7ddc86dda tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.242222 Aug 27 21:10:22.037449 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2423/4724] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:21 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:22.861853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:22.862690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:22.870855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:22.871369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:22.872188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:22.873229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:22.873874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:22.874557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:22.943925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:22.953619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:22.955772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:22.957014 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed9b3227-92f3-4d87-b7b1-6b23eff10996 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.099986 Aug 27 21:10:22.964394 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2302/4725] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:22 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:23.058957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:23.060259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:23.067811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:23.068302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:23.068738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:23.069448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:23.069896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:23.070316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:23.226539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:23.235440 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55a614d6-9150-463f-bbc0-21e51f78af33 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.180951 Aug 27 21:10:23.236164 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2424/4726] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:23 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:23.425527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71", "name": "network-vif-plugged", "status": "completed", "tag": "48970409-cca6-4ea3-b83f-7b75c24a936a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:23.439164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:23.439797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:23.440240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:23.456054 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] Creating event network-vif-plugged:48970409-cca6-4ea3-b83f-7b75c24a936a for instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 on nch1-master-1 Aug 27 21:10:23.462382 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9e54dbb7-0567-4a00-ba2c-67e2f8b1973d req-5283a92d-ac28-47d9-8f5b-0b90d936183b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208398 Aug 27 21:10:23.463121 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2303/4727] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:23.982807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:23.983918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:23.990896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:23.991453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:23.991891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:23.992607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:23.993067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:23.993530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.049438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:24.051089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:24.061111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.062500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.063220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.064562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.065601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.066269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.081071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:24.091108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:24.093121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:24.095103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6bf864ca-7706-4a33-a282-13f69725f795 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.116525 Aug 27 21:10:24.096089 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2425/4728] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:23 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:10:24.101926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d060e67-e252-4b42-b7b9-619e689beff1", "tag": "a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:24.109433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:10:24.116594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.117311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.117914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.132970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] Creating event network-changed:a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b for instance 9d060e67-e252-4b42-b7b9-619e689beff1 on nch2-master-1 Aug 27 21:10:24.140705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:24.140951 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-32a20586-4743-4513-ada4-f664d26adab5 req-53ab3421-8dc9-458a-9859-625e74ad4288 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042928 Aug 27 21:10:24.145849 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2426/4729] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:24.251159 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-602acecd-4e4e-4bf8-879e-3aaf2fd029a8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 204 len: 0 microversion: 2.1 time: 0.207642 Aug 27 21:10:24.251159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2304/4730] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:10:24 2022] DELETE /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:10:24.264812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:24.265645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:24.270687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:24.271494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:24.274370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.275668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.276509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.277664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.278561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.278958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.279556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.279838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.280082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.280868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:24.281383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:24.281809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:24.527451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:24.532323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:24.538659 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d49e472a-5fd0-427e-982b-12f410b27697 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1671 microversion: 2.1 time: 0.280518 Aug 27 21:10:24.539241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2427/4731] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:24 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:24.540885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f439dd73-5f5f-4414-9085-66ef55e00a65 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1368 microversion: 2.1 time: 0.279723 Aug 27 21:10:24.542113 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2305/4732] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:24 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:25.122620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:25.123329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:25.130727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.131229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.131794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.132507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.132974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.133477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.204186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:25.213930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:25.215889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:25.217094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e2161075-1607-452b-9b46-bdd0f178014e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.098668 Aug 27 21:10:25.217670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2428/4733] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:25 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:25.561335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:25.562730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:25.563675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:25.564389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:25.565352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:25.566022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:25.568532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:25.572757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.573192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.573464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.573673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.573901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.574306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.574616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.575010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.575114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.575501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.575608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.575916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.802772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:25.804186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:25.813667 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-88e139b2-c120-4a60-9887-7dabd2da6c22 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1558 microversion: 2.1 time: 0.255344 Aug 27 21:10:25.814472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2429/4734] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:25 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:25.830484 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56f3e9cb-f894-4a92-b4cf-7f866148febd tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1671 microversion: 2.1 time: 0.257869 Aug 27 21:10:25.831424 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2306/4735] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:25 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:25.836158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:25.836806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:25.850329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.851056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.852280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.853147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:25.854465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:25.854733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:25.941665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7134d1d-b207-45b0-a0cd-c6af6d88eef1 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110638 Aug 27 21:10:25.942275 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2430/4736] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:10:25 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:10:26.254407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:26.256735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:26.265378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.266141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.266744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.267939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.268595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.269208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.539089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:26.555395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:26.556571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d060e67-e252-4b42-b7b9-619e689beff1", "name": "network-vif-deleted", "tag": "a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:26.561022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:26.562981 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c11662b2-bf2c-4c41-8544-39031adb723f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.316796 Aug 27 21:10:26.567631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2307/4737] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:26 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:26.570115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.570936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.571472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.618779 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] Creating event network-vif-deleted:a905a61e-d9ba-4cab-a01c-65c8d1fcfb4b for instance 9d060e67-e252-4b42-b7b9-619e689beff1 on nch2-master-1 Aug 27 21:10:26.625265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9f05d223-630a-4805-a419-a38821e76b44 req-96bb3931-6e27-4a42-a5b8-d61c4d101c97 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073940 Aug 27 21:10:26.626199 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2431/4738] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:10:26.852696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:26.853859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:26.862304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.863246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.864040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.866083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.866725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.867423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.917071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:26.917578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:26.918036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:26.918502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid 9d060e67-e252-4b42-b7b9-619e689beff1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:27.017611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:27.028104 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f793a3cd-e4fd-4e49-ade4-8b184240d009 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 200 len: 1339 microversion: 2.1 time: 0.179495 Aug 27 21:10:27.028786 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2308/4739] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:26 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:27.590977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:27.591716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:27.598584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:27.599081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:27.599557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:27.600268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:27.600724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:27.601181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:28.000224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:28.011044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:28.013106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:28.014679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a28c79a6-5d59-41ee-898d-bcaa5ead8885 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.430645 Aug 27 21:10:28.015314 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2432/4740] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:27 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:28.051649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:28.052840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 9d060e67-e252-4b42-b7b9-619e689beff1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:28.066733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:28.067238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:28.067698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:28.068596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:28.069212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:28.069790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:28.100063 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] HTTP exception thrown: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Request method failure captured: Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 HTTP/1.1 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCodkrZ6t2-28cfaSkItrMzxcB3j2Ki8YPP1YrIowChs1K-PK_kcUi_c3p7qsZtW9Q0VmJKBzXKC1SoIRAMUyj7oTKD5mK5KTjnYaOLkkubuWzqHkFEyHQoRMIwHyF4f1xIakvBkKlL3PUnfJNRy61iIF4Qq9A31NEU_laHMqJc3iHKo Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/795a623882274b06a65971bfe1398e29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_795a623882274b06a65971bfe1398e29", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}] Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: eee686b708a849c9a2e59a0ddba908e6 Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9d060e67-e252-4b42-b7b9-619e689beff1'} Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:28.110565 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. Aug 27 21:10:28.115072 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:28.116796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Returning 404 to user: Instance 9d060e67-e252-4b42-b7b9-619e689beff1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:28.117833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cef447e5-9de7-49fe-a480-e08cd247092a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1" status: 404 len: 111 microversion: 2.1 time: 0.071183 Aug 27 21:10:28.120108 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2309/4741] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:28 2022] GET /compute/v2.1/servers/9d060e67-e252-4b42-b7b9-619e689beff1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:10:28.151904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71", "tag": "48970409-cca6-4ea3-b83f-7b75c24a936a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:28.167211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:28.168233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:28.168863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:28.182739 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] Creating event network-changed:48970409-cca6-4ea3-b83f-7b75c24a936a for instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 on nch1-master-1 Aug 27 21:10:28.188754 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9769d323-89be-41f8-8ab0-c5bd217c74af req-c3bf56fb-12e3-4bc2-a72e-dab7ebcb6a80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041237 Aug 27 21:10:28.189679 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2433/4742] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:28.461799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9967916b-74c3-47ed-a000-13363defcb24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '.version_select at 0x7ff84e0364c0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:28.493421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9967916b-74c3-47ed-a000-13363defcb24 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1755604470" status: 202 len: 0 microversion: 2.1 time: 0.036158 Aug 27 21:10:28.495011 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2310/4743] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 21:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1755604470 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:10:29.041043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:29.042431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:29.051315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:29.052247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:29.052898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:29.054242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:29.055250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:29.055923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:29.133400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:29.142687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:29.144196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:29.145423 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b707db6-5f47-4e90-9520-6be9f1a28353 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.111026 Aug 27 21:10:29.146004 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2434/4744] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:29 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:30.172097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:30.172725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:30.180392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:30.181077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:30.182050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:30.182927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:30.183505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:30.184008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:30.258284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:30.267682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:30.269433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:30.270986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea83da43-d8dd-48ab-9e78-e743b69542dc tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.105814 Aug 27 21:10:30.275402 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2311/4745] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:30 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:31.295356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:31.295958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:31.303309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:31.304065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:31.304280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:31.305207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:31.305427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:31.305862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:31.324715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:31.377886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:31.386605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:31.388207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:31.389667 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a98ecb6c-1fb2-49ef-bd66-26b05a675637 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.099025 Aug 27 21:10:31.390176 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2435/4746] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:31 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:32.425633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:32.426728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:32.443632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:32.444147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:32.444594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:32.445310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:32.445757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:32.446211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:32.549910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:32.563955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:32.566650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:32.569198 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a3b16c5-8619-47c7-b1a6-12fa4d36afa9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.158808 Aug 27 21:10:32.584597 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2312/4747] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:32 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:33.594873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:33.595517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:33.609540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:33.610340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:33.611285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:33.612273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:33.612947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:33.613537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:33.763171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:33.764874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:33.776010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:33.785845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:33.786361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:33.786865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:33.790267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:33.791061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:33.791771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:33.802296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:33.809070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:33.812019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05fe8e9b-7c6f-476e-8a2a-9f07e14848ad tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.219718 Aug 27 21:10:33.817044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2436/4748] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:33 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:34.016296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fc2b432-5493-4f38-9f13-c732f802bf66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.260284 Aug 27 21:10:34.021329 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2313/4749] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:10:33 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:10:34.049871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:34.050839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:34.069368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:34.070130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:34.072069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:34.074258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:34.077003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:34.077757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:34.575079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:34.592030 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1dd3b3af-d11a-4574-a2ce-1f9bc1a5aa8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1670 microversion: 2.1 time: 0.562292 Aug 27 21:10:34.593590 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2437/4750] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1670 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:34.846811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:34.847661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:34.858595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:34.859567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:34.860144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:34.861503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:34.862691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:34.863438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:35.368647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:35.381450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:35.383164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:35.385084 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9c89dde-0205-416a-acec-31282ed9fb74 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.546256 Aug 27 21:10:35.385662 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2314/4751] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:34 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:35.616993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:35.617841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:35.627910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:35.628732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:35.629360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:35.630301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:35.630954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:35.631626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:35.989752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:36.006164 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0955b51-5969-4827-9ff8-32228d5d0470 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1670 microversion: 2.1 time: 0.395034 Aug 27 21:10:36.008094 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2438/4752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:35 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1670 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:36.415045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:36.416875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:36.429267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:36.429856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:36.430287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:36.431197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:36.431932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:36.433313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:36.557389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:36.573356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:36.576007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:36.580384 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d989ef62-63a1-4af8-b236-69b14e87b3db tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.169048 Aug 27 21:10:36.584491 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2315/4753] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:36 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:37.031289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:37.033400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:37.045214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:37.047087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:37.050053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:37.053582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:37.054560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:37.055299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:37.055950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:37.381447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:37.411945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-528cdd75-175d-4e66-84d0-d367a08d9282 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.383716 Aug 27 21:10:37.423561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2439/4754] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:37.611773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:37.612426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:37.627262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:37.627771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:37.628143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:37.628880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:37.629356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:37.639684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:37.839628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:37.863673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:37.872730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:37.875536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-30174219-4c21-420b-b8a8-2ba1a62adb6f tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.269107 Aug 27 21:10:37.880007 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2316/4755] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:37 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:38.911192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:38.912665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:38.922001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:38.922729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:38.923330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:38.924290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:38.924902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:38.925482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:39.077176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:39.086775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:39.088368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:39.090220 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c6be17c-62eb-43af-b808-d007706a2172 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.184169 Aug 27 21:10:39.090800 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2440/4756] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:38 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:40.123218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:40.124575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:40.139043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:40.140703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:40.141358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:40.143534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:40.144561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:40.145295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:40.824593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:40.840529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:40.842387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:40.846155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-575c7081-1e07-4a5c-9746-afc84f75ec8d tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.734124 Aug 27 21:10:40.848134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2317/4757] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:40 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:41.874079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:41.874871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:41.897182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:41.897983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:41.898684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:41.899801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:41.900787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:41.901303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:42.128001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:42.141244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:42.146819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:42.148700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-feeba8f3-21c3-41f1-b2b2-289b5a9b8f5e tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.281073 Aug 27 21:10:42.150117 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2441/4758] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:41 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:43.173448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:43.174835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:43.187423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:43.192285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:43.193121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:43.194091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:43.194713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:43.195450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:43.292857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c2d883b2-fd7e-4e5e-a6c6-c8d4f9eda4fe tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-238183981", "availability_zone": "foo_zone"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:43.303743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.aggregate [None req-c2d883b2-fd7e-4e5e-a6c6-c8d4f9eda4fe tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Generated uuid 32087a77-805f-4925-b711-bdce030f0d01 for aggregate {{(pid=140433) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 21:10:43.399434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:43.407946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c2d883b2-fd7e-4e5e-a6c6-c8d4f9eda4fe tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.338842 Aug 27 21:10:43.408734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2318/4759] 10.222.0.40 () {60 vars in 1164 bytes} [Sat Aug 27 21:10:43 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:43.425479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:43.432403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:43.432974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd51764f-9942-439f-8726-c4727a206ab9 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:43.440802 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07c90b1e-ec5d-4b57-8145-70e748c63719 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.270122 Aug 27 21:10:43.443066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2442/4760] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:43 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:10:43.480569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd51764f-9942-439f-8726-c4727a206ab9 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.063421 Aug 27 21:10:43.482404 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2319/4761] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 21:10:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:43.495885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:43.503578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:43.504130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:43.504647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:43.505802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:43.508287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:43.509577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:43.542209 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4809ef9b-34b5-48cc-af5f-fe7d75133517 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052120 Aug 27 21:10:43.542833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2443/4762] 10.222.0.40 () {58 vars in 1176 bytes} [Sat Aug 27 21:10:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:43.555137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-532d0601-8df1-4334-919f-d3c326a555bc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:43.564337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-532d0601-8df1-4334-919f-d3c326a555bc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013796 Aug 27 21:10:43.565715 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2320/4763] 10.222.0.40 () {58 vars in 1143 bytes} [Sat Aug 27 21:10:43 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:10:43.578738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22f88082-ffed-4b6a-b557-876d1a631477 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:43.591820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22f88082-ffed-4b6a-b557-876d1a631477 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:43.592316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22f88082-ffed-4b6a-b557-876d1a631477 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:43.592749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22f88082-ffed-4b6a-b557-876d1a631477 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:43.905706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22f88082-ffed-4b6a-b557-876d1a631477 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.331740 Aug 27 21:10:43.906391 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2444/4764] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 21:10:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:43.920682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7dc7b865-6fc1-4524-91db-007dff3fb629 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:43.932696 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7dc7b865-6fc1-4524-91db-007dff3fb629 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.017870 Aug 27 21:10:43.933625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2321/4765] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:10:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:43.948212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7a5de16-23f3-4123-bc8b-af6af38e5cbb tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1021570386", "availability_zone": "foo_zone"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:44.138331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7a5de16-23f3-4123-bc8b-af6af38e5cbb tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.194242 Aug 27 21:10:44.139921 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2445/4766] 10.222.0.40 () {60 vars in 1173 bytes} [Sat Aug 27 21:10:43 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:44.153833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91f20142-0470-4752-b624-8cb3a3f47ba2 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:44.204109 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91f20142-0470-4752-b624-8cb3a3f47ba2 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.055431 Aug 27 21:10:44.213443 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2322/4767] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 21:10:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:10:44.218615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bffae95-54be-47cf-91fa-062f5b7d6589 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:44.230550 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5bffae95-54be-47cf-91fa-062f5b7d6589 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.016542 Aug 27 21:10:44.231666 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2446/4768] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:10:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:44.246575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-960a20b1-cda0-4c9b-9b50-3b84919080dc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:44.260301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960a20b1-cda0-4c9b-9b50-3b84919080dc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:44.260802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960a20b1-cda0-4c9b-9b50-3b84919080dc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:44.261488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960a20b1-cda0-4c9b-9b50-3b84919080dc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:44.473149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:44.474858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:44.489550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:44.492360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:44.493912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:44.495569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:44.498728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:44.499506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:44.587609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-960a20b1-cda0-4c9b-9b50-3b84919080dc tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.345661 Aug 27 21:10:44.590106 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2323/4769] 10.222.0.40 () {60 vars in 1194 bytes} [Sat Aug 27 21:10:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:44.602989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9d798bd-0ac8-4eb9-b75a-c2df7d2dc630 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:44.673156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:44.685858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:44.687685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:44.689276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bfc88829-4c81-436a-85de-f9f15089dc87 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.226737 Aug 27 21:10:44.690423 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2447/4770] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:44 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:10:44.701800 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9d798bd-0ac8-4eb9-b75a-c2df7d2dc630 tempest-TestAggregatesBasicOps-648423591 tempest-TestAggregatesBasicOps-648423591-project-admin] 10.222.0.40 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.103249 Aug 27 21:10:44.703518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2324/4771] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 21:10:44 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 21:10:44.781534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07a9845a-5bab-4198-be9c-dbf1871ac891 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: .version_select at 0x7ff84f93f1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1195794736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1A1zR0Aj/4nWU8xEEKMSFpIqoOW7hwDJrv91xQIc7xbFCbmOrcdKijMTJHRkwwirywcjD3MqzNDgw789u3xoSScoF4Jw/loBCWI32MJCR2cbpufrMLtAAwtgJdGD/sig=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:44.824252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-07a9845a-5bab-4198-be9c-dbf1871ac891 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:10:44.836425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-07a9845a-5bab-4198-be9c-dbf1871ac891 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:10:44.872213 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07a9845a-5bab-4198-be9c-dbf1871ac891 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.095337 Aug 27 21:10:44.874210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2448/4772] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:10:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:45.718732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:45.719477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:45.739329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:45.740507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:45.741130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:45.741870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:45.742326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:45.742752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:45.844353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:45.856516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:45.858217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:45.859837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f336ef69-619d-4101-b62a-812a8cdc9561 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.149931 Aug 27 21:10:45.861291 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2325/4773] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:45 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:46.762382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1663962264", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "193ad99f-b5da-4b28-b272-9aea5ccfec81"}], "key_name": "tempest-TestNetworkBasicOps-1195794736", "security_groups": [{"name": "tempest-secgroup-smoke-1912199020"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:46.885334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:46.886136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:46.893585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:46.894391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:46.895102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:46.896057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:46.896703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:46.897322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:46.988898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:47.011064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:47.017662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:47.026027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:47.028578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] validate_networks() for [('193ad99f-b5da-4b28-b272-9aea5ccfec81', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:10:47.034422 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5250db5-134d-4417-b05c-40e5513610f5 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.153780 Aug 27 21:10:47.035782 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2326/4774] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:46 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:10:47.555490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:10:47.556034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:10:47.556574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:10:47.556986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:10:47.557397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:10:47.568001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:47.568858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:47.569298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:47.570027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:47.570476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:47.570894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:47.593277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:10:47.601244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Getting quotas for user eee686b708a849c9a2e59a0ddba908e6 and project 795a623882274b06a65971bfe1398e29. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:10:47.620863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:10:47.623332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:10:47.683614 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d11f70cc-df19-450b-8c5f-52a80501c7c4 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929754 Aug 27 21:10:47.690027 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2449/4775] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:10:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:10:47.698526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6102db9-c5d7-4e29-9168-1ba6e8d4c1d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:47.699170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6102db9-c5d7-4e29-9168-1ba6e8d4c1d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:47.708715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:47.814188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6102db9-c5d7-4e29-9168-1ba6e8d4c1d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:47.824291 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6102db9-c5d7-4e29-9168-1ba6e8d4c1d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1249 microversion: 2.1 time: 0.132394 Aug 27 21:10:47.827619 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2327/4776] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:47 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1249 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:48.070817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:48.075060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:48.093564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:48.094079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:48.094587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:48.095411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:48.099976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:48.100558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:48.228660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:48.241514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:48.244216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:48.246358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0f55e62-b043-4c2c-88ed-e1edc04ab409 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.191961 Aug 27 21:10:48.247530 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2450/4777] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:48 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:48.851552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:48.852740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:48.878094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:48.878855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:48.879509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:48.880409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:48.881024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:48.881721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:49.070819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:49.082851 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9237f11e-315c-454e-861d-7f4e3ac3fcc2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1301 microversion: 2.1 time: 0.238866 Aug 27 21:10:49.100555 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2328/4778] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:48 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1301 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:49.279447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:49.281893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:49.292895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:49.294446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:49.295149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:49.296396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:49.297292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:49.298112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:49.448893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:49.479564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:49.481172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:49.482955 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eec3b414-e48e-4191-b25d-9df674262aa3 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1366 microversion: 2.57 time: 0.211767 Aug 27 21:10:49.483580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2451/4779] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:49 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:50.108690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:50.109429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:50.124277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:50.125299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:50.125896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:50.126654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:50.129809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:50.130274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:50.231764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:50.244882 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da82333e-c3b6-4ba0-a778-684b47a74499 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1307 microversion: 2.1 time: 0.140536 Aug 27 21:10:50.256220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2329/4780] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:50 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:50.511234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:50.512587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:50.521201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:50.521976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:50.522570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:50.524041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:50.525573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:50.526441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:50.677816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:50.699644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:50.701626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:50.702932 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c690e68c-d4f6-4f35-8e80-671e612059b2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1372 microversion: 2.57 time: 0.199716 Aug 27 21:10:50.710163 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2452/4781] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:50 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:51.267112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:51.268635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:51.282866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:51.283382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:51.283856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:51.284518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:51.284970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:51.285395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:51.561519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:51.569762 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e640f2b7-a75c-48c7-a5fc-4d83c4bb4ec5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.306778 Aug 27 21:10:51.570427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2330/4782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:51 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:51.652889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157016a8-4962-4863-b68c-45a6b51338eb", "tag": "81b0f137-1e28-4675-9179-b8940cbfe8a7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:10:51.670191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:51.670677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:51.671118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:51.685219 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] Creating event network-changed:81b0f137-1e28-4675-9179-b8940cbfe8a7 for instance 157016a8-4962-4863-b68c-45a6b51338eb on nch1-master-1 Aug 27 21:10:51.692408 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a8184295-3cbb-4e0e-9bca-b502dfd04935 req-66c2487f-2f0c-4249-a984-766774d0189b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045590 Aug 27 21:10:51.693380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2453/4783] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:10:51.726571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:51.727215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:51.740161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:51.740680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:51.741129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:51.741860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:51.742315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:51.742746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:52.206187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:52.224274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:52.227898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:52.230167 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-899e1529-8e49-4521-9fa7-de5e4f2dceb1 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1372 microversion: 2.57 time: 0.507545 Aug 27 21:10:52.231645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2331/4784] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:51 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1372 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:52.593000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:52.593886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:52.600506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:52.601096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:52.601638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:52.602408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:52.602995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:52.603515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:52.751952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:52.760160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2bb19ed5-4f99-460e-909a-fe5b7ec48800 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.173638 Aug 27 21:10:52.760731 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2454/4785] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:52 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:53.254629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:53.255993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:53.265079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:53.265756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:53.266277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:53.267188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:53.267762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:53.268250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:53.369332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:53.378419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:53.379898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:53.381087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66b37977-4af2-43a3-8c25-e82f56c35dd9 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1372 microversion: 2.57 time: 0.130594 Aug 27 21:10:53.381657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2332/4786] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:53 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1372 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:53.781691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:53.782414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:53.790352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:53.790855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:53.791308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:53.792066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:53.792528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:53.792963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:53.957612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:53.969483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84175276-91dd-48dd-b707-103236b64acf tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.191928 Aug 27 21:10:53.971212 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2455/4787] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:53 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:54.405508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:54.406620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:54.416110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.416349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.417045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.417844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.418731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.419496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.513693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.522376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.523855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.525874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2660b313-2db4-4c5a-87b4-d26d7e7a7788 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1357 microversion: 2.57 time: 0.124898 Aug 27 21:10:54.526443 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2333/4788] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:54 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:54.554984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:54.556109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:54.563039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.563608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.564228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.564933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.565388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.565915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.595054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:10:54.610970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:54.700964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0e02fe6-fb5e-49ce-b680-169488b4528c tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 204 len: 0 microversion: 2.57 time: 0.149396 Aug 27 21:10:54.701510 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2456/4789] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:10:54 2022] DELETE /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:10:54.711390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:54.714884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:54.721951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.722738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.723368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.724410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:54.725276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:54.725869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:54.838030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.849295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.851232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:54.852472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-be5aacdf-cea1-4765-a708-455239ce655a tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1363 microversion: 2.57 time: 0.146634 Aug 27 21:10:54.853069 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2334/4790] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:54 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:55.000551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:55.001347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:55.009170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:55.009788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:55.010340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:55.011280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:55.011833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:55.012269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:55.261485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:55.272943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7130f7f-16ca-4fac-b998-65e8023b3873 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.277406 Aug 27 21:10:55.273685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2457/4791] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:54 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:55.878031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:55.878563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:55.886588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:55.887110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:55.887600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:55.888452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:55.888987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:55.889470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:55.959478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:55.968929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:55.970397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:55.971654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4e1adb15-f966-4197-953a-f87240d8c7c2 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1363 microversion: 2.57 time: 0.097775 Aug 27 21:10:55.972202 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2335/4792] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:55 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:56.296145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:56.297171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:56.313519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:56.314349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:56.318294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:56.319686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:56.320543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:56.321142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:56.509767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:56.519819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f476b5f9-ae95-4ba0-80bb-5f750d72ac86 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.228144 Aug 27 21:10:56.521049 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2458/4793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:56 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:56.995972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:56.996588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:57.004910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:57.005935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:57.006741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:57.007928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:57.008450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:57.009251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:57.054193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:57.054444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:57.055167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:57.056416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lazy-loading 'fault' on Instance uuid 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:10:57.107392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:57.123065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:57.125856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b713f8286eb14776a4b7bb219cadd029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0aef10f8b344ee2b650b422ec25f9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:57.127642 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cbc7b82a-540b-4704-bb2f-49dbe459c741 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 200 len: 1368 microversion: 2.57 time: 0.136830 Aug 27 21:10:57.129592 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2336/4794] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:56 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:10:57.544442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:57.545780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:57.563910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:57.564864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:57.567794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:57.569845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:57.572649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:57.573270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:57.580151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:57.613995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=10 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:57.804525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:57.813666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e5acfbb-23e8-4d02-ac1e-f3ba7028d066 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.274956 Aug 27 21:10:57.814308 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2459/4795] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:57 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:10:58.152800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:10:58.159479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:58.160102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] [instance: 8ea4042a-41e0-4e88-aecd-f6c1f6b84030] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:58.168152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:58.168662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:58.169326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:58.170320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:58.170945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:58.172632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:58.202729 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] HTTP exception thrown: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Request method failure captured: Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 HTTP/1.1 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCog2E5mdrYpeACn3uO7Q9jbGujLe73qgk0KwWGQ0am07x0bnPtQ7Vrj3oz22TVr68bODH64_-oxSlwHAgwZ9OH9IMxu-icknyPu4qx8Ggvh3r6DZXovjb2hOyDH5_cJu9-gU_BmcHy28xperyMIAwcwZUksUlQaTH_zfCmXmFsyYkTY Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e0aef10f8b344ee2b650b422ec25f9ae Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerShowV257Test-624291951 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e0aef10f8b344ee2b650b422ec25f9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e0aef10f8b344ee2b650b422ec25f9ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e0aef10f8b344ee2b650b422ec25f9ae", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e0aef10f8b344ee2b650b422ec25f9ae"}]}] Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerShowV257Test-624291951 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e0aef10f8b344ee2b650b422ec25f9ae Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerShowV257Test-624291951 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerShowV257Test-624291951-project Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: b713f8286eb14776a4b7bb219cadd029 Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerShowV257Test-624291951-project Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '8ea4042a-41e0-4e88-aecd-f6c1f6b84030'} Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:10:58.204673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. Aug 27 21:10:58.209274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:10:58.213257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] Returning 404 to user: Instance 8ea4042a-41e0-4e88-aecd-f6c1f6b84030 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:10:58.220557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70fb0502-2a5f-4d38-9656-fb8208fd06d8 tempest-ServerShowV257Test-624291951 tempest-ServerShowV257Test-624291951-project] 10.222.0.40 "GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030" status: 404 len: 111 microversion: 2.57 time: 0.068867 Aug 27 21:10:58.221476 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2337/4796] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:10:58 2022] GET /compute/v2.1/servers/8ea4042a-41e0-4e88-aecd-f6c1f6b84030 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:10:58.838310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:10:58.840611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:10:58.859363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:58.862847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:58.863579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:58.865108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:10:58.867834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:10:58.869001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:10:59.085029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:10:59.095134 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.261743 Aug 27 21:10:59.096426 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2460/4797] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:10:58 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:00.116648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:00.117863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:00.128928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:00.130517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:00.131037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:00.132426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:00.132960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:00.133775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:00.362304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:00.363312 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dec20a5c-cfba-41d5-8248-f836b2e2bfa2 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001394 Aug 27 21:11:00.363779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2461/4798] 10.222.0.40 () {56 vars in 886 bytes} [Sat Aug 27 21:11:00 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 21:11:00.507841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:00.519296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf6b66ef-95ec-42b3-a917-a0876a0b0e92 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.406882 Aug 27 21:11:00.519913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2338/4799] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:00 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:00.537706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157016a8-4962-4863-b68c-45a6b51338eb", "name": "network-vif-plugged", "status": "completed", "tag": "81b0f137-1e28-4675-9179-b8940cbfe8a7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:00.556513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:00.557063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:00.558016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:00.591162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] Creating event network-vif-plugged:81b0f137-1e28-4675-9179-b8940cbfe8a7 for instance 157016a8-4962-4863-b68c-45a6b51338eb on nch1-master-1 Aug 27 21:11:00.602517 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d95219f8-123c-412d-8419-eff76c40071c req-167e0776-a4b7-400d-8ac2-d537baf0b5ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072756 Aug 27 21:11:00.603573 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2462/4800] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:11:01.542371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:01.543949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:01.553276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:01.554224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:01.554994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:01.556180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:01.557041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:01.557619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:01.754536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:01.764105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d606404f-9433-4981-a0c8-74dd7c067316 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1375 microversion: 2.1 time: 0.227649 Aug 27 21:11:01.764789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2339/4801] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:01 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1375 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:02.789120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:02.794581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:02.803808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:02.804606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:02.805229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:02.806390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:02.807061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:02.807738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:03.150597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:03.171029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a9f2cfa-5506-4a47-a46f-d3253f429b0c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1548 microversion: 2.1 time: 0.387932 Aug 27 21:11:03.175176 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2463/4802] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:02 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1548 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:03.197941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:03.198822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:03.208471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:03.209073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:03.209588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:03.210370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:03.210833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:03.212056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:03.454976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:03.465280 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ac0af67-a12b-4a97-8974-18ddb339747a tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1548 microversion: 2.1 time: 0.272261 Aug 27 21:11:03.466012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2340/4803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:03 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1548 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:07.229801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:07.230468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:07.234790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:07.249275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:07.250941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:07.252450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:07.261852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:07.262353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:07.262806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:07.305517 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aad44326-9769-45d0-978a-a389951d8368 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/ips" status: 200 len: 145 microversion: 2.1 time: 0.080885 Aug 27 21:11:07.314222 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2464/4804] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:11:07 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:07.878307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157016a8-4962-4863-b68c-45a6b51338eb", "tag": "81b0f137-1e28-4675-9179-b8940cbfe8a7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:07.891850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:07.893968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:07.894660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:07.916497 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] Creating event network-changed:81b0f137-1e28-4675-9179-b8940cbfe8a7 for instance 157016a8-4962-4863-b68c-45a6b51338eb on nch1-master-1 Aug 27 21:11:07.929666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cf2214bd-6103-440c-ab74-1834142460e4 req-d2d47f28-8cfb-44f4-8dcd-240bfaff2e32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054957 Aug 27 21:11:07.930535 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2341/4805] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:09.617544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61a807d3-b11f-43f6-965d-0da042564d73"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:09.623582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:09.636444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:09.636945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:09.637387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:09.638099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:09.638551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:09.638974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:09.999575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390900 Aug 27 21:11:10.000320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2465/4806] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:11:09 2022] POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:10.769369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5017ddc0-d25b-4613-afab-2f282c3e3f84 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: .version_select at 0x7ff84e008ee0>, body: {"keypair": {"name": "tempest-keypair-872605123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbswANqJnSABqMsdIDG9kj0v44T1fdNh3h8NbEN0Fgv6aPJK67O2eBGzwiprYi84nxIzYx7E4JSQv/5oQYT/rJLY5RkG31ZupJdsC+G8gg/etd4cL0u31cOS6lwKdxGuA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:10.791404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5017ddc0-d25b-4613-afab-2f282c3e3f84 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:11:10.798743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-5017ddc0-d25b-4613-afab-2f282c3e3f84 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for user 3ed5b662d08e405395b930a185b78d47 and project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:11:10.839663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5017ddc0-d25b-4613-afab-2f282c3e3f84 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.231495 Aug 27 21:11:10.841827 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2342/4807] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 21:11:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 21:11:12.244721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1027134765", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47578b3b-10ca-4ff3-aca7-0f6cdcbb735f"}], "security_groups": [{"name": "tempest-securitygroup--522388230"}], "key_name": "tempest-keypair-872605123", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:12.355025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] validate_networks() for [('47578b3b-10ca-4ff3-aca7-0f6cdcbb735f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:11:12.875734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:11:12.876264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:11:12.876738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:11:12.877145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:11:12.877558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:11:12.889154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:12.889640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:12.890242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:12.891133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:12.891797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:12.892389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:12.912609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:11:12.920615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for user 3ed5b662d08e405395b930a185b78d47 and project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:11:12.935414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:11:12.937918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:11:13.001837 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f877f51b-a7c5-4617-b139-631680122b5c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.763055 Aug 27 21:11:13.003421 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2466/4808] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:11:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:11:13.022055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:13.022905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:13.152573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:13.171760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:13.173461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:13.174784 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8741e47a-a3c7-4108-a9c6-af19e3956823 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1281 microversion: 2.20 time: 0.164048 Aug 27 21:11:13.175560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2343/4809] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:13 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:13.366001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:13.374944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:13.375757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:13.376847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:13.402440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:11:13.460945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-89f0c5fa-db86-4e4c-b20e-851cb84d4821 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action" status: 202 len: 0 microversion: 2.1 time: 0.100301 Aug 27 21:11:13.462325 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2467/4810] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:11:13 2022] POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:11:13.471212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:13.474432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:13.487093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:13.487623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:13.488068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:13.488792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:13.489226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:13.489646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:13.662501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:13.671813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-758851d7-14b4-4d19-ad7b-0feee71fb818 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.204401 Aug 27 21:11:13.672405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2344/4811] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:13 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:14.199025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:14.199782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:14.206870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:14.207494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:14.208104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:14.208866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:14.209328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:14.209768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:14.280583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:14.289695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:14.291576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:14.292706 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b667337-538e-46ef-bbce-9ed742f21f2c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1333 microversion: 2.20 time: 0.098293 Aug 27 21:11:14.293284 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2468/4812] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:14 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:14.693797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:14.694471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:14.703933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:14.704685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:14.705574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:14.706462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:14.707112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:14.707783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:14.859656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:14.869119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aff9ad31-38f5-4486-b0e0-f120f341c84e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.178848 Aug 27 21:11:14.869743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2345/4813] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:14 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:15.323900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:15.324528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:15.333681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:15.334390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:15.334838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:15.335590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:15.336318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:15.336804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:15.477715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:15.487468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:15.489027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:15.490293 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d224be9-28d2-4aa9-a9f8-13e4dcafa52e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.173510 Aug 27 21:11:15.490956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2469/4814] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:15 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:15.858481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:15.871634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:15.872119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:15.872572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:15.883974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] Creating event network-changed:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:11:15.889083 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-29bba84d-4c78-4ac8-96fc-2575827a16f8 req-10a295c5-a0c6-4d2b-89ab-4dc052044f82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035231 Aug 27 21:11:15.889826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2346/4815] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:15.890468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:15.891189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:15.906288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:15.906790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:15.907242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:15.907984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:15.908442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:15.908871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:16.044021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:16.052606 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aeccf0fc-598a-496b-bc18-187da873df05 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.166181 Aug 27 21:11:16.053169 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2470/4816] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:15 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:16.518340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:16.519384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:16.526933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:16.527460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:16.527912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:16.528702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:16.529164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:16.529594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:16.672688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:16.682721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:16.684212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:16.685311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f14c46bf-6003-4957-87a7-cda591be6a24 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.172215 Aug 27 21:11:16.685853 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2347/4817] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:16 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:17.076817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:17.077428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:17.084912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:17.085410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:17.085855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:17.086555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:17.087013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:17.087459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:17.226569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:17.235793 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ccdc929-5710-4359-bb08-eddc1b13739a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.163826 Aug 27 21:11:17.236389 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2471/4818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:17 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:17.712304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:17.713471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:17.726849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:17.727742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:17.728497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:17.729223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:17.729680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:17.730112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:17.734534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:17.871584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:17.880290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:17.881753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:17.882886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41361e6f-6926-46a2-bad8-5463a89e6a99 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.177524 Aug 27 21:11:17.883497 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2348/4819] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:17 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:18.261021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:18.261628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:18.269044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:18.269546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:18.269996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:18.270703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:18.271177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:18.271661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:18.290481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:18.408409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:18.417921 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3abbc30c-0b5f-4b5d-808b-908fa3d4cae3 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.161159 Aug 27 21:11:18.419096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2472/4820] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:18 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:18.905632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:18.906223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:18.909087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:18.915050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:18.915564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:18.916267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:18.916726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:18.917194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:18.917617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:19.052611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:19.061573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:19.063032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:19.064197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eacaba97-3703-45a6-b87a-32069d339a7e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.162568 Aug 27 21:11:19.064738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2349/4821] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:18 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:19.444637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:19.445775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:19.464462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:19.464939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:19.465391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:19.466122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:19.466585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:19.467026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:19.623932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:19.632769 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3f71fb7-1f93-4d4e-b3ea-93ea5ac7f311 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.194879 Aug 27 21:11:19.633354 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2473/4822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:19 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:20.091988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:20.092817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:20.103830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:20.104330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:20.104773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:20.105510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:20.106007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:20.106440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:20.258965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:20.267922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:20.269369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:20.270500 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b84f9452-2555-459d-884d-94c5791a811b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.185650 Aug 27 21:11:20.271070 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2350/4823] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:20 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:20.655841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:20.656488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:20.664497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:20.665007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:20.665477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:20.666297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:20.666750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:20.667179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:20.823103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:20.835522 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a24a3a18-1ca6-4f32-af26-25af59ea6d1b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.183883 Aug 27 21:11:20.836291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2474/4824] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:20 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:21.293873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:21.294540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:21.302612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:21.303164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:21.303685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:21.304451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:21.304960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:21.305435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:21.451592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:21.460534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:21.461984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:21.463160 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2984e698-20bd-4285-a758-cad3e8356220 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.173661 Aug 27 21:11:21.464271 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2351/4825] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:21 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:21.835081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "name": "network-vif-plugged", "status": "completed", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:21.846539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:21.847043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:21.847525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:21.859201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] Creating event network-vif-plugged:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:11:21.864528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:21.864677 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4256c9cb-b756-45e4-8d2b-6e24edef3405 req-917cd33e-a9a2-47e6-9201-c58bdbfc87d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033273 Aug 27 21:11:21.864785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:21.865343 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2475/4826] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:21.871618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:21.872109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:21.872577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:21.873449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:21.873907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:21.874331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:22.013790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:22.022608 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-591143ac-7106-425c-8854-dae89f4f15da tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.162835 Aug 27 21:11:22.023210 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2352/4827] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:21 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:22.495215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:22.495827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:22.502752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:22.503242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:22.503715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:22.504407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:22.504864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:22.505296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:22.648377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:22.657447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:22.658966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:22.660107 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0126cc06-d905-42a3-90ce-49f56aacf6de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1406 microversion: 2.20 time: 0.171952 Aug 27 21:11:22.660692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2476/4828] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:22 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:23.048751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:23.049740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:23.061711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.062532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.063279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.064511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.065300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.066032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.167812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:23.204912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:23.214244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29b96178-17b2-4232-9aae-955476ca37ce tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.171777 Aug 27 21:11:23.214843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2353/4829] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:23 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:23.684516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:23.685143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:23.689308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:23.690350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:23.698740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.699239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.699913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.700626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.701090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.701524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.842662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:23.854589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:23.856091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:23.857316 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6f70a9b-b4cd-44f6-8690-4f8b2138c67c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1597 microversion: 2.20 time: 0.177299 Aug 27 21:11:23.857891 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2477/4830] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:23 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1597 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:23.886645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:23.887174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:23.893774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.894262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.894699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.895401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:23.895885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:23.896309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:23.975776 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e73a01ca-506e-4189-b9a4-a36fdaca17f8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093313 Aug 27 21:11:23.976379 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2354/4831] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:11:23 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:11:24.240476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:24.241197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:24.249317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:24.249810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:24.250255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:24.250963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:24.251437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:24.251871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:24.421162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:24.431772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0a0bed3f-fa4e-477d-a5fe-ea9d811b0ef4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.195338 Aug 27 21:11:24.432409 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2478/4832] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:24 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:25.382015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:25.392634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:25.393119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:25.393553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:25.406010 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] Creating event network-changed:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:11:25.412686 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3edbbd76-9521-40aa-b5b4-30018853a56f req-bc72ed18-f637-4077-8adb-7237e961714c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035619 Aug 27 21:11:25.412686 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2355/4833] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:25.459013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:25.459944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:25.467450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:25.467944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:25.468377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:25.469073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:25.469529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:25.469956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:25.613160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:25.622194 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0dcf0f6-81b4-42e3-8125-48cfe1175c89 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.168097 Aug 27 21:11:25.623381 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2479/4834] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:25 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:26.648051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:26.648981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:26.657740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:26.658405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:26.658991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:26.659969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:26.660586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:26.661156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:26.819541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:26.830551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1bc9e8b-6baf-4df3-b787-15c596e91535 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.189615 Aug 27 21:11:26.831167 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2356/4835] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:26 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:27.854330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:27.854939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:27.866092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:27.866720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:27.867248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:27.868351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:27.869159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:27.869448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:28.016283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:28.025443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15043879-464e-4b83-91d9-cc1bdae0a709 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.175486 Aug 27 21:11:28.026085 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2480/4836] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:27 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:29.047221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:29.047852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:29.055814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:29.056703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:29.057584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:29.058314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:29.058924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:29.059385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:29.280451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:29.289321 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a3f0e6b-2ef9-4b5e-a1ea-a3840076e699 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.246212 Aug 27 21:11:29.290140 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2357/4837] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:29 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:30.311739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:30.312329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:30.318987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:30.319534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:30.320003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:30.320717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:30.321183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:30.321596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:30.550529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:30.560059 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-939e4007-d9d3-4518-b11e-af0203dc154e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.253639 Aug 27 21:11:30.560896 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2481/4838] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:30 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:31.582202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:31.582796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:31.592520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:31.593182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:31.593832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:31.594979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:31.595693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:31.596285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:31.740397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:31.750429 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f88468d-c834-4106-ab15-8328ff3da06e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.172521 Aug 27 21:11:31.751017 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2358/4839] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:31 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:32.776799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:32.777669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:32.788611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:32.789365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:32.790043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:32.791274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:32.791770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:32.792202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:32.933416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:32.942316 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7319bb44-66e6-4762-806c-ab79e684a2df tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1723 microversion: 2.1 time: 0.172213 Aug 27 21:11:32.942882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2482/4840] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:32 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:33.965789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:33.966414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:33.973835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:33.974320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:33.974765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:33.975509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:33.975974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:33.976398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:34.119442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:34.130658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e1fcfc7-cde5-4835-8d8c-e492227e9721 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1700 microversion: 2.1 time: 0.169167 Aug 27 21:11:34.131469 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2359/4841] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:33 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1700 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:34.151679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:34.159243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:34.159807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:34.160246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:34.183365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Going to try to start instance {{(pid=140434) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:11:34.234368 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9463831-7e4e-4281-8d9e-2d90eb1d0cf0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action" status: 202 len: 0 microversion: 2.1 time: 0.086421 Aug 27 21:11:34.234955 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2483/4842] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:11:34 2022] POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:11:34.243295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:34.244113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:34.250330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:34.250807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:34.251275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:34.252072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:34.252523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:34.252950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:34.389523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:34.398437 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e03cd3a-4853-4755-b434-a85542f74096 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1709 microversion: 2.1 time: 0.159112 Aug 27 21:11:34.399006 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2360/4843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:34 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:35.429200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:35.430372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:35.438117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:35.438617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:35.439063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:35.439882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:35.440345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:35.440777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:35.588085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:35.601402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fccfdea2-fd9a-447b-839f-ce595cb0040d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1709 microversion: 2.1 time: 0.181412 Aug 27 21:11:35.602242 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2484/4844] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:35 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1709 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:36.628030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:36.629128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:36.639389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.639920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.640363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:36.641076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.641535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.641966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:36.767730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:36.768879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:36.775092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.775828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.776323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:36.776777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:36.777702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.778155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.778646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:36.785945 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-913f2569-f93d-4b0c-a1b3-2680ccf401e4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1713 microversion: 2.1 time: 0.165063 Aug 27 21:11:36.786709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2361/4845] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:36 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:36.806200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:11:36.898123 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b610e57f-5ebe-4706-93fc-972c14633ee9 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 204 len: 0 microversion: 2.42 time: 0.259309 Aug 27 21:11:36.898743 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2485/4846] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:11:36 2022] DELETE /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:11:36.907515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:36.908127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:36.914363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.914845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.915275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:36.916004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:36.916646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:36.917109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:37.109061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:37.124636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:37.126978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:37.128725 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0729f3c5-aec4-4dc4-b062-3bf4a293de12 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2961 microversion: 2.42 time: 0.225108 Aug 27 21:11:37.129482 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2362/4847] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:36 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2961 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:38.159620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:38.160782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:38.165295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:38.172569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:38.173148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:38.173596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:38.174293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:38.174781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:38.175202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:38.387843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:38.397293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:38.398788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:38.400072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e12970a8-4cce-46c7-98b2-9bb408d2f522 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2961 microversion: 2.42 time: 0.247877 Aug 27 21:11:38.400745 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2486/4848] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:38 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2961 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:39.429944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:39.430591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:39.438430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:39.438970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:39.439446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:39.440259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:39.440722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:39.441154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:39.632588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:39.642460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:39.643966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:39.645228 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5af59b77-d635-4fb4-a058-6ec692c0f5b2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2961 microversion: 2.42 time: 0.219470 Aug 27 21:11:39.645843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2363/4849] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:39 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2961 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:40.673879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:40.674493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:40.681793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:40.682484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:40.682928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:40.683734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:40.684196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:40.684621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:40.690195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:40.810636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:40.810636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:40.818417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:40.819041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:40.819736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:40.820570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:40.821094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:40.821569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:40.911334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:40.926805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:40.928665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:40.930020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5762030b-7ece-4627-a44f-9eb94a033e60 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2961 microversion: 2.42 time: 0.262452 Aug 27 21:11:40.930588 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2487/4850] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:40 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2961 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:40.982016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:40.990399 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-120efabf-1b7a-4fad-b5c4-29be339d3b4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.185091 Aug 27 21:11:40.991034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2364/4851] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:40 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:41.011954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:41.012962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:41.012962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:41.013771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:41.018889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.019432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.019869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.020353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.020716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.020824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.021197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.021317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.021590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.021927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.022535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.023110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.052370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-31bb72e6-8610-4494-972b-af656ada5863 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/ips" status: 200 len: 149 microversion: 2.1 time: 0.044641 Aug 27 21:11:41.053227 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2488/4852] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:11:41 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:41.191311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:41.195249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:41.200601 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5b9ec2cc-a2d9-49ca-a871-4e19d051c31e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.192391 Aug 27 21:11:41.216052 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2365/4853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:41.222369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:41.223068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:41.230088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.230663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.231108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.232081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.232548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.232980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.425565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:41.434266 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2fceb5eb-8c0b-4a31-a122-a6cd976ec6b2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.215538 Aug 27 21:11:41.448084 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2489/4854] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:41.457473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:41.459475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:41.468421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.469090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.469861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.470640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.471368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.471998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.638577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:41.647140 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d405bab0-f4bd-40f6-8fa4-9e569b8d19ae tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.194591 Aug 27 21:11:41.647960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2366/4855] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:41 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:41.762585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1442611628", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "f75aad2c-a76e-4365-abfb-15744ff8d972"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:41.820461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] validate_networks() for [('f75aad2c-a76e-4365-abfb-15744ff8d972', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:11:41.955900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:41.957078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:41.965069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.966291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.966934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:41.967879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:41.968561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:41.969210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.332661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:42.348724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:42.352133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:42.355460 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0b5a526-41b1-4d27-84a4-5d336d7fc2ef tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2940 microversion: 2.42 time: 0.403286 Aug 27 21:11:42.359523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:11:42.360364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:11:42.361404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:11:42.362337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:11:42.363250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:11:42.369127 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2367/4856] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:41 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2940 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:42.376803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:42.377674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:42.378385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.379298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:42.380024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:42.380623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.382834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "e990918c-a7ca-438e-b9e8-4610424b6cc4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:42.395969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:42.397153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:42.397934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.402762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:11:42.408693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:11:42.414241 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] Creating event network-vif-unplugged:e990918c-a7ca-438e-b9e8-4610424b6cc4 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:42.421987 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4ab86b16-312a-4697-b001-1562cd6d327b req-46cfa455-6306-47ed-95b8-9f80677fe151 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046544 Aug 27 21:11:42.422452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:11:42.423057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2368/4857] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:42.425050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:11:42.485363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "116450af-17af-42c9-8d69-d6f0f35c3c21"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:42.488414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:42.491732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b4e0fed1-ddd4-4b0b-8291-a94846752356 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733330 Aug 27 21:11:42.497782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:42.498835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:42.499179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2490/4858] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:11:42.499673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.501492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:42.502350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:42.502959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:42.505400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3380fe19-6aed-4011-a0f8-e689dd175605 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:42.506183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3380fe19-6aed-4011-a0f8-e689dd175605 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:42.586042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3380fe19-6aed-4011-a0f8-e689dd175605 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:42.594949 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3380fe19-6aed-4011-a0f8-e689dd175605 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1215 microversion: 2.1 time: 0.094364 Aug 27 21:11:42.600937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2491/4859] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:42 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:42.890320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "POST /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411566 Aug 27 21:11:42.891139 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2369/4860] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:11:42 2022] POST /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:11:43.393213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:43.395551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:43.405186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:43.405892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:43.406551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:43.408291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:43.408779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:43.410004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:43.617492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:43.618212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:43.623394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:43.630449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:43.632074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:43.632423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:43.633152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:43.633616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:43.634048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:43.634917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:43.636731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:43.638011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af36e3c9-ffdb-4d21-a842-c052f8a81341 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2919 microversion: 2.42 time: 0.253632 Aug 27 21:11:43.638906 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2492/4861] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:43 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2919 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:43.720189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:43.728620 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d70c1f37-7c49-44a7-814d-e2c30bbeb05a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1267 microversion: 2.1 time: 0.115447 Aug 27 21:11:43.729563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2370/4862] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:43 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:43.993118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-deleted", "tag": "ec94104a-dc15-401c-896b-ab4bc36c4c52"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:44.020785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.022063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.022831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.053224 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] Creating event network-vif-deleted:ec94104a-dc15-401c-896b-ab4bc36c4c52 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:44.060912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e1e4ca63-39cf-4a1d-ab92-219760d99acb req-df8dbed2-4575-49d4-ab42-7c27bc4fcc14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073283 Aug 27 21:11:44.066310 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2493/4863] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:44.474617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "6fdea988-e8fe-4f45-b392-b55477b33feb"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "601119b8-282e-401e-9557-ba5c8dda2531"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-unplugged", "status": "completed", "tag": "b5414c2c-a41b-4574-bbaa-f52411d09c65"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:44.487536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.487950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.488401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.503172 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Creating event network-vif-unplugged:6fdea988-e8fe-4f45-b392-b55477b33feb for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:44.503800 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Creating event network-vif-unplugged:601119b8-282e-401e-9557-ba5c8dda2531 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:44.504439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] Creating event network-vif-unplugged:b5414c2c-a41b-4574-bbaa-f52411d09c65 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:44.512072 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-70bd10ff-c14b-40f8-bd2f-c517a9162f3f req-95e7d42e-9c7c-44bd-af70-fbbd321a5cf8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.041657 Aug 27 21:11:44.512754 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2371/4864] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:11:44.668361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:44.669059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:44.676967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.677540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.677980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.678686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.679141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.679621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.751151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:44.751825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:44.763485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.764247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.764903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.765661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:44.766182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:44.766716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:44.860478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:44.872403 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87954bfd-40e1-4f93-bcf7-980a0e228b94 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1273 microversion: 2.1 time: 0.125700 Aug 27 21:11:44.873002 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2372/4865] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:44 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:44.899928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:44.913199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:44.914665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:44.916011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84a7a829-c603-4472-9a1e-1a3db3de1312 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2759 microversion: 2.42 time: 0.252268 Aug 27 21:11:44.916837 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2494/4866] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:44 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2759 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:45.894678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:45.895211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:45.902945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:45.903504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:45.903952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:45.904670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:45.905134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:45.905565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:45.944178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:45.944769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:45.951850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:45.952341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:45.952775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:45.953482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:45.953932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:45.954669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.099967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:46.109082 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-849dee77-99eb-49b3-b844-d753fe525e67 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.218517 Aug 27 21:11:46.110272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2373/4867] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:45 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:46.115491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-deleted", "tag": "e990918c-a7ca-438e-b9e8-4610424b6cc4"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-deleted", "tag": "601119b8-282e-401e-9557-ba5c8dda2531"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:46.126454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.126948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.127630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.149637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Creating event network-vif-deleted:e990918c-a7ca-438e-b9e8-4610424b6cc4 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:46.150152 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] Creating event network-vif-deleted:601119b8-282e-401e-9557-ba5c8dda2531 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:46.156682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b5718300-31d5-48cd-ae45-2bb090cae2d3 req-5ebff28c-ce6a-45d4-ad84-7f4260bb1429 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044768 Aug 27 21:11:46.157823 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2374/4868] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:46.173898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:46.185056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:46.198488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:46.200305 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0830c58-0244-4b30-98c3-bb93135d63de tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2778 microversion: 2.42 time: 0.260414 Aug 27 21:11:46.214052 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2495/4869] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:45 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2778 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:46.405019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:46.405617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:46.412259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.412840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.413356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.414147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.414757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.415188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.511310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'services' on Instance uuid f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:11:46.600478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments/116450af-17af-42c9-8d69-d6f0f35c3c21" status: 202 len: 0 microversion: 2.1 time: 0.200057 Aug 27 21:11:46.601193 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2375/4870] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:11:46 2022] DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments/116450af-17af-42c9-8d69-d6f0f35c3c21 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:11:46.604726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:46.604726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:46.611752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.612044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:46.612674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.613220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.614031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.614856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.615395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:46.615577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.623441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.623885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.624391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.625160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:46.625652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:46.626112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:46.665805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ed53579-3b92-4ec5-b6ef-b5ac6fc4ee16 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058716 Aug 27 21:11:46.667087 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2376/4871] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:11:46 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:46.724732 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-361e61ca-4aac-49d7-bb1b-e2b04fd15b1c tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb/action" status: 200 len: 24575 microversion: 2.1 time: 0.270802 Aug 27 21:11:46.725413 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2496/4872] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:11:46 2022] POST /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb/action => generated 24575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:11:47.130545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:47.131186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:47.139124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.139674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.140241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.140835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.141349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.141758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.229750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:47.231238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:47.240758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.241395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.242188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.243121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.243726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.244667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.325270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:47.333677 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b648d66-b2a1-4b6a-8727-6bc92117b353 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.207135 Aug 27 21:11:47.334368 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2377/4873] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:47 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:47.415797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:47.425935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:47.427438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:47.428688 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bfed2b6-1d55-4898-a3cb-37d9ae36718d tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2503 microversion: 2.42 time: 0.203493 Aug 27 21:11:47.429264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2497/4874] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:47 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:47.678853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:47.682312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:47.689576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.690334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.690930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.692190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.692810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.693394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.728828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d40d6e94-e48c-44a0-bb5e-684a6e81f9ed tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054141 Aug 27 21:11:47.729410 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2378/4875] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:11:47 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:11:47.801764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:47.803191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:47.809846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.810341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.811076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.811806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.812417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.813013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.840635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:11:47.941610 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de79b96a-095f-4295-81d5-5f6f2fe18e96 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 204 len: 0 microversion: 2.1 time: 0.143304 Aug 27 21:11:47.943203 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2498/4876] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:11:47 2022] DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:11:47.953143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:47.953769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:47.959995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.960495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.960941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:47.961649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:47.962112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:47.962548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.104566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:48.113759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2adab6b2-3e44-4469-a19f-21838d459407 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1682 microversion: 2.1 time: 0.165610 Aug 27 21:11:48.114618 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2379/4877] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:47 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:48.186000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec28951b-e437-4514-8883-7bea491d7967", "tag": "73d2d278-43b8-4742-9e2a-2ce12a8912c5"}, {"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-deleted", "tag": "b5414c2c-a41b-4574-bbaa-f52411d09c65"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:48.197266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:48.197913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:48.198345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.211808 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Creating event network-changed:73d2d278-43b8-4742-9e2a-2ce12a8912c5 for instance ec28951b-e437-4514-8883-7bea491d7967 on nch2-master-1 Aug 27 21:11:48.212321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] Creating event network-vif-deleted:b5414c2c-a41b-4574-bbaa-f52411d09c65 for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:48.219316 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-0a21aee4-c159-4c6a-a6f6-329daf21eb6f req-74d6d803-7a5b-4827-b941-57c7e20692a1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037971 Aug 27 21:11:48.219990 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2499/4878] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:48.355815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:48.356515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:48.363966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:48.364461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:48.364944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.365642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:48.366101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:48.366501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.456408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:48.457130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:48.465445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:48.467100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:48.467812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.468794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:48.469321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:48.469922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:48.538448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:48.548105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c20e803-2c0b-450e-9a3a-ceced416e9cc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.196449 Aug 27 21:11:48.548708 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2380/4879] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:48 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:48.563665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:48.583890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:48.585336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:48.586585 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21b0cc57-fd3f-430d-b016-039641990684 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2435 microversion: 2.42 time: 0.135082 Aug 27 21:11:48.587156 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2500/4880] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:48 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2435 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:49.140507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:49.141525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:49.144808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=64 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:49.151265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.151789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.152233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.152940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.153525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.154136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.296483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:49.304926 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40f0a527-2a6e-456a-80bd-566729be9112 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1682 microversion: 2.1 time: 0.171072 Aug 27 21:11:49.305516 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2381/4881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:49 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:49.569984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:49.570606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:49.577907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.578433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.578882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.579677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.580152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.580587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.612225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:49.612839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:49.620236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.620731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.621189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.621883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:49.622525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:49.623260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:49.646182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:49.714383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:49.724309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:49.725771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:49.726963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-312505fa-eb2d-4894-ab38-dc4e99be84be tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 2435 microversion: 2.42 time: 0.118742 Aug 27 21:11:49.727563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2382/4882] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:49 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 2435 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:49.744814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:49.753012 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-808c3f29-1fb1-4b30-943c-f8aca77af0d4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.187071 Aug 27 21:11:49.753561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2501/4883] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:49 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:50.238267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e908a40-bd43-4127-8c65-fde46e781fa1", "name": "network-vif-deleted", "tag": "6fdea988-e8fe-4f45-b392-b55477b33feb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:50.257754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.261805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.262318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.282676 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] Creating event network-vif-deleted:6fdea988-e8fe-4f45-b392-b55477b33feb for instance 8e908a40-bd43-4127-8c65-fde46e781fa1 on nch2-master-1 Aug 27 21:11:50.293400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8f6f72e9-9d5d-4baf-8c7b-997d7698d12a req-9051affc-d930-4d40-903f-6378f5af7c57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062942 Aug 27 21:11:50.294087 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2383/4884] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:50.327372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:50.328053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:50.335016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.335804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.336420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.337503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.338493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.339502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.436362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:50.450723 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cde162c4-2c38-4abc-8b18-ca39fac1cc75 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1614 microversion: 2.1 time: 0.128331 Aug 27 21:11:50.451983 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2502/4885] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:50 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:50.753796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:50.754683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:50.761457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.762011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.762475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.763395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.763967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.764390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.802776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.803563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.803979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.804789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lazy-loading 'fault' on Instance uuid 8e908a40-bd43-4127-8c65-fde46e781fa1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:11:50.869437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71", "name": "network-vif-deleted", "tag": "48970409-cca6-4ea3-b83f-7b75c24a936a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:50.878031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:50.887302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.891641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:50.892582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.893111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.894476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1eb7e6ff68c14b3f8f6ce22a6926920b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9abfa1d159f4e2cb2ddbbcd80f3615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:50.896611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51546f3c-3c76-49f6-806c-0e742c0a41e0 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 200 len: 1609 microversion: 2.42 time: 0.147901 Aug 27 21:11:50.909030 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2384/4886] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:50 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 1609 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:50.909030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:50.909030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:50.919796 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] Creating event network-vif-deleted:48970409-cca6-4ea3-b83f-7b75c24a936a for instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 on nch1-master-1 Aug 27 21:11:50.931178 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-41d88600-1c22-4822-bb06-c77144bacb34 req-16b418bd-d2a1-464e-ad3f-0025748288f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182345 Aug 27 21:11:50.931843 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2503/4887] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:50.934473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.935104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.935503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:50.938033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:50.938556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:50.938934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.127569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:51.135898 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-352bc1cf-99c9-4fe5-a7a6-66fabd70e643 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.235266 Aug 27 21:11:51.136920 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2385/4888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:50 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:51.475210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:51.476991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:51.485329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.486238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.487066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.487850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.488465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.489215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.529894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.530631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.531266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.531911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lazy-loading 'fault' on Instance uuid f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:11:51.600062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0df3ca755314bdc8e8b236abb0924b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b4c86f3463480ab7ea7fc27c7e3c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:51.616190 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f6f2ef9-ec9d-44a7-a7c7-fe628b08566d tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 200 len: 1332 microversion: 2.1 time: 0.145531 Aug 27 21:11:51.617406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2386/4889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:51 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 1332 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:51.754808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:51.755474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:51.761978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.762464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.762918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.763835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.764309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.764746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.793586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:11:51.853356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:51.889302 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fe22d41-f126-42ab-bf6f-8368c72941d1 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "DELETE /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 204 len: 0 microversion: 2.32 time: 0.436832 Aug 27 21:11:51.890057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2504/4890] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:11:51 2022] DELETE /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:11:51.899015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:51.899724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:51.907273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.908028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.908476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.909227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.909691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.910122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.925864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:51.926619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:51.934007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.934579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.935110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.935816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:51.936281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:51.936720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:51.953075 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] HTTP exception thrown: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Request method failure captured: Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 HTTP/1.1 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoclDprrNvxajVzcuZrtHDqruUddhrCGkeuTqYtJJgnACe-Soyi_hH02QEFMrqdgeEcIpR6kmvZVXqmsRhDVFf26XYq9qOULr7i-RZjBZ3eNyBwjsKCONKFykAo_SQBZZIzXyr_Yw8XgNw4o1lkSubU9Wdu4CxPN6j-DMBpyAQ_0oMs Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9abfa1d159f4e2cb2ddbbcd80f3615e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}] Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1eb7e6ff68c14b3f8f6ce22a6926920b Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '8e908a40-bd43-4127-8c65-fde46e781fa1'} Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:51.955075 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Returning 404 to user: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-57160ed0-e0e3-4ba9-8486-3835e0b26dcc tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 404 len: 111 microversion: 2.42 time: 0.035191 Aug 27 21:11:51.960139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2505/4891] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:51 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:11:51.970328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-17db0c18-fc83-4070-85ce-08fc6e9060d2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '.version_select at 0x7ff84ef329d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:51.991314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-17db0c18-fc83-4070-85ce-08fc6e9060d2 tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025754348" status: 204 len: 0 microversion: 2.42 time: 0.025019 Aug 27 21:11:51.995457 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2506/4892] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 21:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025754348 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:11:52.144155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:52.158485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:52.159218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:52.161079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:52.164945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:52.166674 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c1fb9d6-dd7d-4453-bef5-0fc844cbdfde tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2956 microversion: 2.32 time: 0.271996 Aug 27 21:11:52.167461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2387/4893] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:51 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2956 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:52.175906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:52.178663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:52.179130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:52.180080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:52.180703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:52.181383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:52.336324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:52.345668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-411a17ef-d6a4-4a41-815d-3a610bc9536a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.192135 Aug 27 21:11:52.346354 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2507/4894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:52 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:52.639956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:52.640568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:52.647084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:52.647571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:52.648166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:52.649027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:52.649632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:52.650227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:52.665665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 HTTP/1.1 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71'} Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:52.667554 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b33ba8c0-6283-42dc-bfd9-094e679fdc77 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 404 len: 111 microversion: 2.1 time: 0.032994 Aug 27 21:11:52.673441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2388/4895] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:52 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:52.678705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ab81297-1ff4-444a-a7a7-7ff074f027da tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '.version_select at 0x7ff84e4f8e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:52.683482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:52.684276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:52.704896 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ab81297-1ff4-444a-a7a7-7ff074f027da tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015806161" status: 202 len: 0 microversion: 2.1 time: 0.030399 Aug 27 21:11:52.705527 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2508/4896] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015806161 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:11:53.199900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:53.200748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:53.208421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:53.208921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:53.209366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:53.210090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:53.210568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:53.211209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:53.369802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:53.371228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:53.382829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:53.383376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:53.383867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:53.384589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:53.385052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:53.385472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:53.417257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:53.428281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:53.429877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:53.431403 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0413441-e87e-4f30-9270-e8553990cc00 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2956 microversion: 2.32 time: 0.235649 Aug 27 21:11:53.444773 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2389/4897] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:53 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2956 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:53.530780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:53.539438 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a541e4b8-c354-44b3-91ef-f21c17fcc49b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.174783 Aug 27 21:11:53.540034 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2509/4898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:53 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:54.166215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec28951b-e437-4514-8883-7bea491d7967", "name": "network-vif-plugged", "status": "completed", "tag": "73d2d278-43b8-4742-9e2a-2ce12a8912c5"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:54.191477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:54.208401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:54.213931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:54.238341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] Creating event network-vif-plugged:73d2d278-43b8-4742-9e2a-2ce12a8912c5 for instance ec28951b-e437-4514-8883-7bea491d7967 on nch2-master-1 Aug 27 21:11:54.247235 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5af2b88d-c1cc-43aa-b485-f59830e0d027 req-e70a6ef4-0a70-41d1-b6d6-b3fe0687dbf5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085783 Aug 27 21:11:54.250218 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2390/4899] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:54.458773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:54.460742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:54.472546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:54.473580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:54.474675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:54.475734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:54.477084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:54.478262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:54.560413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:54.561137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:54.575579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:54.577152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:54.578010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:54.579032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:54.580033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:54.585098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.161250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:55.176308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:55.182066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:55.184740 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a22f732a-97fc-42c0-aae5-9f7263dce2a6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2956 microversion: 2.32 time: 0.730385 Aug 27 21:11:55.187520 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2510/4900] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:54 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2956 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:55.194535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:55.195050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:55.219734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.220478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.221782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.224128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.227612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.228092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.230515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:55.239378 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a46436d0-1920-46bc-9ea8-b44da283f706 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1315 microversion: 2.1 time: 0.683224 Aug 27 21:11:55.239963 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2391/4901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:54 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:55.243800 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 HTTP/1.1 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71'} Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:55.245884 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.250879 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.252904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:55.254038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-174383ee-2d1e-4086-81d6-5383ce8c5c90 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 404 len: 111 microversion: 2.1 time: 0.065517 Aug 27 21:11:55.255081 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2511/4902] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:11:55 2022] DELETE /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:55.265995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:55.266631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:55.278924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.279459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.279901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.280612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.281064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.281486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.304774 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 HTTP/1.1 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71'} Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.306544 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-070ce6b5-d6de-4811-8534-f6e94ebba868 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71" status: 404 len: 111 microversion: 2.1 time: 0.047262 Aug 27 21:11:55.310552 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2392/4903] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:55 2022] GET /compute/v2.1/servers/f2b71a0a-a171-49e6-93c9-8f1fd9bb6d71 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:55.898346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:55.898959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:55.907474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.908339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.909020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.909978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.910807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.911638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.931133 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] HTTP exception thrown: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Request method failure captured: Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 HTTP/1.1 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoclDprrNvxajVzcuZrtHDqruUddhrCGkeuTqYtJJgnACe-Soyi_hH02QEFMrqdgeEcIpR6kmvZVXqmsRhDVFf26XYq9qOULr7i-RZjBZ3eNyBwjsKCONKFykAo_SQBZZIzXyr_Yw8XgNw4o1lkSubU9Wdu4CxPN6j-DMBpyAQ_0oMs Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9abfa1d159f4e2cb2ddbbcd80f3615e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}] Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1eb7e6ff68c14b3f8f6ce22a6926920b Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '8e908a40-bd43-4127-8c65-fde46e781fa1'} Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:55.933184 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:55.937448 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:55.939838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Returning 404 to user: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:55.940960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39e2ab91-1d37-471d-b7f7-57fb9538cf1f tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 404 len: 111 microversion: 2.42 time: 0.048169 Aug 27 21:11:55.941782 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2512/4904] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:11:55 2022] DELETE /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:11:55.951729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:55.952384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] [instance: 8e908a40-bd43-4127-8c65-fde46e781fa1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:55.960298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.960812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.961303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:55.962046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:55.962529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:55.962938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.001320 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] HTTP exception thrown: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Request method failure captured: Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 HTTP/1.1 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoclDprrNvxajVzcuZrtHDqruUddhrCGkeuTqYtJJgnACe-Soyi_hH02QEFMrqdgeEcIpR6kmvZVXqmsRhDVFf26XYq9qOULr7i-RZjBZ3eNyBwjsKCONKFykAo_SQBZZIzXyr_Yw8XgNw4o1lkSubU9Wdu4CxPN6j-DMBpyAQ_0oMs Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f9abfa1d159f4e2cb2ddbbcd80f3615e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f9abfa1d159f4e2cb2ddbbcd80f3615e"}]}] Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f9abfa1d159f4e2cb2ddbbcd80f3615e Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1042837722 Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1eb7e6ff68c14b3f8f6ce22a6926920b Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1042837722-project Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '8e908a40-bd43-4127-8c65-fde46e781fa1'} Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.003672 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] Returning 404 to user: Instance 8e908a40-bd43-4127-8c65-fde46e781fa1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:56.007550 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8516b205-7f7d-4fa9-865a-1d647e9b32dd tempest-TaggedBootDevicesTest_v242-1042837722 tempest-TaggedBootDevicesTest_v242-1042837722-project] 10.222.0.40 "GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1" status: 404 len: 111 microversion: 2.42 time: 0.060367 Aug 27 21:11:56.008281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2393/4905] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:55 2022] GET /compute/v2.1/servers/8e908a40-bd43-4127-8c65-fde46e781fa1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:11:56.218960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:56.219933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.227776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.228339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.228856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.229733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.230247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.231078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.267088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:56.268608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.277264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.278091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.279114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.280034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.280504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.280922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.592392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:56.596723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:56.615614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:56.617057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:56.618343 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-988f4282-519a-419d-a24e-2c6aa2a64379 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2935 microversion: 2.32 time: 0.404441 Aug 27 21:11:56.621542 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51071c3b-d504-4543-adea-c4475a7fa1a5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1501 microversion: 2.1 time: 0.363086 Aug 27 21:11:56.622194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2394/4906] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:56 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1501 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:11:56.623789 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2513/4907] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:56 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2935 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:56.638163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:56.638665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.646547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:56.647083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.647461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.648049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.648557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.649742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.650958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.651607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.653358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.653911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.654584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.655800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.656344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.657740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.931312 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.network.security_group_api [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Removing security group 14979b0b-eebe-4a26-86ef-02a705cc7662 from port 73d2d278-43b8-4742-9e2a-2ce12a8912c5 Aug 27 21:11:56.939180 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 HTTP/1.1 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '848c4479-c568-4e24-b2f0-692592658735'} Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:56.940814 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e0e4e5b-1331-457e-9631-4cccc5ae517c tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 404 len: 111 microversion: 2.1 time: 0.319057 Aug 27 21:11:56.948014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2395/4908] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:11:56 2022] DELETE /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 111 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:56.950752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:56.951373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 848c4479-c568-4e24-b2f0-692592658735] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.957593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.958085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.958528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.959227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.959726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.960136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.974611 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 HTTP/1.1 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '848c4479-c568-4e24-b2f0-692592658735'} Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:56.976225 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 848c4479-c568-4e24-b2f0-692592658735 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4cbea175-803f-4a8d-9155-07943bdc94d6 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735" status: 404 len: 111 microversion: 2.1 time: 0.030531 Aug 27 21:11:56.980452 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2396/4909] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:56 2022] GET /compute/v2.1/servers/848c4479-c568-4e24-b2f0-692592658735 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:11:56.986415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:56.986995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:56.993416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.994035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.994491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:56.995195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:56.995691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:56.996158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.011196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d HTTP/1.1 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1750bd7e-c490-4129-b9b8-0f8079470e2d'} Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:57.013228 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02175cd2-8ada-4a60-8b75-c470d3ff9c80 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 404 len: 111 microversion: 2.1 time: 0.031993 Aug 27 21:11:57.017143 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2397/4910] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:11:56 2022] DELETE /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:57.023015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:57.023667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1750bd7e-c490-4129-b9b8-0f8079470e2d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:57.030158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.030648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.031109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.031851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.032310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.032739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.046909 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d HTTP/1.1 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '1750bd7e-c490-4129-b9b8-0f8079470e2d'} Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:57.048574 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1750bd7e-c490-4129-b9b8-0f8079470e2d could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c032da0-7e6c-4b36-8d1a-5a171ba56401 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d" status: 404 len: 111 microversion: 2.1 time: 0.030826 Aug 27 21:11:57.052541 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2398/4911] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:57 2022] GET /compute/v2.1/servers/1750bd7e-c490-4129-b9b8-0f8079470e2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:11:57.472758 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5706740c-5dc7-4f26-a640-e44dbe11791a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967/action" status: 202 len: 0 microversion: 2.1 time: 0.830030 Aug 27 21:11:57.477852 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2514/4912] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:11:56 2022] POST /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:11:57.485937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:57.487593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:57.490814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec28951b-e437-4514-8883-7bea491d7967", "tag": "73d2d278-43b8-4742-9e2a-2ce12a8912c5"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:57.497075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.498483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.499153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.500219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.500899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.501544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.503909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.504247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.504902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.521535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] Creating event network-changed:73d2d278-43b8-4742-9e2a-2ce12a8912c5 for instance ec28951b-e437-4514-8883-7bea491d7967 on nch2-master-1 Aug 27 21:11:57.527674 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b2ab0b7b-9693-417e-b7ca-9f4baef1b0bc req-71c6b3ae-22f8-40e7-8e6a-42b8ec05b9a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041973 Aug 27 21:11:57.529154 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2515/4913] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:11:57.667692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:57.670134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:57.676367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:57.677959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dd9590c-b70f-489b-a227-b4e11358adc5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1459 microversion: 2.1 time: 0.199459 Aug 27 21:11:57.678551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2399/4914] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:57 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1459 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:57.686611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.687421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.688193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.689874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.690602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.691567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.701358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:57.702240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:57.712889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.717114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.717908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:57.720270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:57.727732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:57.728175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.184539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:58.194897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:58.195914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:58.197219 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-98a976ac-4603-4a0c-8e32-3238e1a514f6 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2867 microversion: 2.32 time: 0.554392 Aug 27 21:11:58.198217 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2516/4915] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:57 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2867 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:11:58.215006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:58.237122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d971e9cb-ce67-4ff2-914d-77a90b8a39be tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.539033 Aug 27 21:11:58.238386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2400/4916] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:57 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:58.259855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:58.260525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:58.268788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.269270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.269924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.270803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.271445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.271929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:58.272292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.272650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:58.287657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.288246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.288622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.291157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.291280 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.291679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.292112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 HTTP/1.1 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1bce13ff-c933-4dfa-8b52-c61a97a61491'} Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:58.293416 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.297628 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.299961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:58.301333 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79b9dba5-2b41-4204-bb3a-b4b40d194296 tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 404 len: 111 microversion: 2.1 time: 0.047921 Aug 27 21:11:58.308465 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2517/4917] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:11:58 2022] DELETE /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:58.315136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:58.316050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] [instance: 1bce13ff-c933-4dfa-8b52-c61a97a61491] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:58.323330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.323872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.324326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.325172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.325704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.326143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.349667 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] HTTP exception thrown: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Request method failure captured: Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 HTTP/1.1 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoay76pxv1ypQXYVRutNCdjmWtbneKIi-WcnHiy0Z-xMPXwH7VQj0sP6Q0imOUFF83h8LXzM_bZvA_7ssmS8Cwxs4YfmMoL6_y9eVYneaSBsMqUniNlElEEViccexEyJkrx_KJL8tiCkaYZ8Ztk1kgwuXm0WNMjnbUT1iLTLcYADXDk Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d8b4c86f3463480ab7ea7fc27c7e3c16", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d8b4c86f3463480ab7ea7fc27c7e3c16"}]}] Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: d8b4c86f3463480ab7ea7fc27c7e3c16 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-737699077 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: f0df3ca755314bdc8e8b236abb0924b2 Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeNegativeTest-737699077-project Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '1bce13ff-c933-4dfa-8b52-c61a97a61491'} Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:11:58.351573 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. Aug 27 21:11:58.355784 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:11:58.356909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] Returning 404 to user: Instance 1bce13ff-c933-4dfa-8b52-c61a97a61491 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:11:58.358759 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-183c7063-359b-4abd-9108-41916c2382fe tempest-AttachVolumeNegativeTest-737699077 tempest-AttachVolumeNegativeTest-737699077-project] 10.222.0.40 "GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491" status: 404 len: 111 microversion: 2.1 time: 0.048701 Aug 27 21:11:58.359469 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2518/4918] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:58 2022] GET /compute/v2.1/servers/1bce13ff-c933-4dfa-8b52-c61a97a61491 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:11:58.646491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:58.658883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea164e47-64c0-4550-b6ed-d544a3431e2f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.393624 Aug 27 21:11:58.660222 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2401/4919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:58 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:58.691649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:58.692632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:58.712305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.714002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.720590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:58.721690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:58.725889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:58.727364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.058078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:59.071592 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-205c5b8a-6660-48f9-a689-acc1f40ce89d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.392107 Aug 27 21:11:59.072949 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2519/4920] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:58 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:59.093428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:59.094065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:59.106215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:59.108769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:59.109893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.110835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:59.111565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:59.112166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.224315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:11:59.225010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:11:59.231580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:11:59.233835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:59.234643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:59.235134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.235919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:59.236427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:59.237222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.451316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:59.466738 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-115d96fe-debf-4aa6-a196-0662d6035af6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.377660 Aug 27 21:11:59.467406 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2402/4921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:11:59 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:11:59.557720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-deleted", "tag": "05231cba-c36e-4c03-a60c-8cf5d1759c75"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-deleted", "tag": "8920ecf1-3b0c-468b-b59b-00b35de15f40"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:59.569240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:11:59.570008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:11:59.570604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:11:59.587230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Creating event network-vif-deleted:05231cba-c36e-4c03-a60c-8cf5d1759c75 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:11:59.588090 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] Creating event network-vif-deleted:8920ecf1-3b0c-468b-b59b-00b35de15f40 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:11:59.595170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0ce22894-0720-4fb7-8b83-4e9b588d1ecc req-e3b02982-5f6a-4f46-8b9c-04b436accd1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045620 Aug 27 21:11:59.596167 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2403/4922] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:11:59.602243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-128582478", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "f75aad2c-a76e-4365-abfb-15744ff8d972"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:11:59.644852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:59.666312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:59.672928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:11:59.674554 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe98674b-d4a8-4112-b27d-48151faf14ec tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2820 microversion: 2.32 time: 0.455452 Aug 27 21:11:59.687615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2520/4923] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:11:59 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2820 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:11:59.704692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] validate_networks() for [('f75aad2c-a76e-4365-abfb-15744ff8d972', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:12:00.526555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-unplugged", "status": "completed", "tag": "1928081a-e18a-40a9-8c32-f6a165d48e48"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:00.552307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:00.552913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:00.553448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:00.589246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] Creating event network-vif-unplugged:1928081a-e18a-40a9-8c32-f6a165d48e48 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:12:00.594767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4fe6b7d7-6491-4ed9-aac0-eea5590cd4c1 req-4382f979-7f3e-4fc5-ac4a-d6d5d5e34cc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072084 Aug 27 21:12:00.595720 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2521/4924] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:00.709647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:00.710360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:00.724605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:00.725117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:00.725558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:00.726782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:00.729676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:00.730342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:00.771553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:00.773121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:00.773832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:00.774464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:00.776028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:00.792377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:00.793644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:00.794377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:00.795369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:00.796343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:00.797008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:00.822441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:12:00.832670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Getting quotas for user cf68fad783694a4499b32ae1a9370966 and project facef93eae3a467c8d965bb563e3c523. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:12:00.859473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:12:00.868218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:12:00.953510 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f70b34ca-ad39-4471-affc-d131a29e82d2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355794 Aug 27 21:12:00.954903 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2404/4925] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:12:00.967312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b5b40f2-97ff-4e74-b17a-7a19856c112d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:00.968572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1b5b40f2-97ff-4e74-b17a-7a19856c112d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:01.575713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1b5b40f2-97ff-4e74-b17a-7a19856c112d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:01.589792 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1b5b40f2-97ff-4e74-b17a-7a19856c112d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1214 microversion: 2.1 time: 0.624429 Aug 27 21:12:01.590463 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2405/4926] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:00 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1214 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:01.613548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:01.623508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-deleted", "tag": "bf58ee0e-25fd-4e17-aed4-84919edde433"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:01.646665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:01.648470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:01.649860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49cd9e09-0b20-40ff-a1dc-6530ad9a9f4e tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 2372 microversion: 2.32 time: 0.944553 Aug 27 21:12:01.650902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2522/4927] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:00 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 2372 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:01.652448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:01.652953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:01.653730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:01.687947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] Creating event network-vif-deleted:bf58ee0e-25fd-4e17-aed4-84919edde433 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:12:01.703114 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e46c8b38-b879-40f3-9541-84c6aaf62485 req-13caef44-9602-46ee-a420-f384b3f1ab6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084534 Aug 27 21:12:01.705231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2406/4928] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:02.630916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:02.631981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-unplugged", "status": "completed", "tag": "ba8c1011-8a54-4d65-b018-67dd534862a4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:02.633521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:02.648024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:02.649148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:02.649870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:02.651846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:02.654778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:02.655982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:02.664433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:02.670788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:02.672260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:02.692003 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] Creating event network-vif-unplugged:ba8c1011-8a54-4d65-b018-67dd534862a4 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:12:02.743635 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-30e95201-281b-4b87-a06d-714f88060c1f req-cc1ccfa1-8076-41d5-be4c-145ebd71d51b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115736 Aug 27 21:12:02.745257 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2407/4929] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:02.763312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:02.764137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:02.788400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:02.788910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:02.789360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:02.790091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:02.790559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:02.790995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:02.842621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:02.986862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:02.997147 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96795075-52b2-45e0-9480-6aba96610f0c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1274 microversion: 2.1 time: 0.386809 Aug 27 21:12:03.003868 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2523/4930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:02 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1274 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:03.039468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:03.056566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:03.058525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:03.060909 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb7bab41-30d4-400b-9ca3-e11b2e2f6b45 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1603 microversion: 2.32 time: 0.314150 Aug 27 21:12:03.062285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2408/4931] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:02 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1603 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:03.736489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-deleted", "tag": "ba8c1011-8a54-4d65-b018-67dd534862a4"}, {"server_uuid": "28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45", "name": "network-vif-deleted", "tag": "1928081a-e18a-40a9-8c32-f6a165d48e48"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:03.762515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:03.763453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:03.766570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:03.781108 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Creating event network-vif-deleted:ba8c1011-8a54-4d65-b018-67dd534862a4 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:12:03.782023 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] Creating event network-vif-deleted:1928081a-e18a-40a9-8c32-f6a165d48e48 for instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 on nch1-master-1 Aug 27 21:12:03.788665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c19f0e84-821d-4224-8a2c-5de4a5e7606d req-772bee18-7d9c-4b2e-a63e-24dc94715f6e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059569 Aug 27 21:12:03.789961 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2524/4932] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:12:04.020472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:04.021175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:04.038206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:04.038990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:04.039659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:04.040586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:04.041206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:04.041802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:04.088104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:04.089185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:04.102853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:04.105847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:04.107871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:04.111639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:04.112347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:04.112976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:04.154095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:04.154945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:04.155640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:04.156287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lazy-loading 'fault' on Instance uuid 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:04.279869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:04.283052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:04.306876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:04.312540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3365d519-cc86-45bc-ad1e-fb8dc797528e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1272 microversion: 2.1 time: 0.294493 Aug 27 21:12:04.315506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2409/4933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:04 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:04.316484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c82ae6511f2443888af3d79a6a40d7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366653ab581f4c23aa632fe3253100cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:04.318633 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2b318263-f005-4940-b0d0-1587b7a4c334 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 200 len: 1370 microversion: 2.32 time: 0.235684 Aug 27 21:12:04.319615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2525/4934] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:04 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:05.334954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:05.335617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:05.345920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:05.346615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:05.347001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:05.348035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:05.348554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:05.349280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:05.349968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:05.350562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:05.363931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:05.364443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:05.364910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:05.365607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:05.366237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:05.366820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:05.382109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] HTTP exception thrown: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Request method failure captured: Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 HTTP/1.1 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCodPlWHDPGwaPaNW83tHvX4CsMjV3zMVjckn_59DkLSuQtZ9G8DzMHNhs1dDqXOcT4BJd7q9XGljdziigXmEJwCkjaPJqKq2GlLv_RvIT5jKN5NPWFCFaWvMkR9J1OKE94atDTEu0uCcG-kMwkHkYa7sXc52mfANX7QR_f-qPjs0ol0 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_366653ab581f4c23aa632fe3253100cf", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}] Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c82ae6511f2443888af3d79a6a40d7d6 Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45'} Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:05.384148 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:05.388999 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:05.391584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Returning 404 to user: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:05.392682 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-30a234c4-ae4e-456c-8dfe-557cd34899fe tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 404 len: 111 microversion: 2.32 time: 0.050930 Aug 27 21:12:05.393814 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2526/4935] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:05 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:12:05.402017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a799b1b-afca-4696-9f8f-c1cbf1558505 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '.version_select at 0x7ff84ee8a280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:05.444580 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a799b1b-afca-4696-9f8f-c1cbf1558505 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38747942" status: 204 len: 0 microversion: 2.32 time: 0.046320 Aug 27 21:12:05.445893 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2527/4936] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38747942 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:12:05.706025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:05.724028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ba834df-fc4f-427f-81a7-7373794f0a66 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.389478 Aug 27 21:12:05.725569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2410/4937] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:05 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:05.915891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766afc8f-1c84-4de6-98eb-523a66fecb55", "tag": "9c2a927f-20eb-4af3-b1ec-abe5516af6b9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:05.946616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:05.947787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:05.948454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:05.969507 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] Creating event network-changed:9c2a927f-20eb-4af3-b1ec-abe5516af6b9 for instance 766afc8f-1c84-4de6-98eb-523a66fecb55 on nch1-master-1 Aug 27 21:12:05.976783 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7f8fdd12-66c6-48d6-8bac-799c472d2d2e req-0d80949f-8c1e-4686-95df-7e83791077f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066402 Aug 27 21:12:05.978677 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2528/4938] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:06.745751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:06.746376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:06.757288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:06.762624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:06.763121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:06.767871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:06.768717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:06.769130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:07.004330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-822e39ff-6766-4618-b056-3b7faf148885 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Action: 'create', calling method: .version_select at 0x7ff84eeb7c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1892378608", "metadata": {"Type": "work"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:07.010267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-822e39ff-6766-4618-b056-3b7faf148885 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 122 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1892378608", "metadata": {"Type": "work"}}} Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1892378608', 'metadata': {'Type': 'work'}}}} Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:12:07.010436 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-822e39ff-6766-4618-b056-3b7faf148885 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-822e39ff-6766-4618-b056-3b7faf148885 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145675 Aug 27 21:12:07.015788 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2529/4939] 10.222.0.40 () {60 vars in 1156 bytes} [Sat Aug 27 21:12:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:12:07.022607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f49dac95-4e3b-490c-b80d-811837a43b71 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Action: 'create', calling method: .version_select at 0x7ff84ee65670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1547985396", "metadata": {"Type": "work"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f49dac95-4e3b-490c-b80d-811837a43b71 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 120 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1547985396", "metadata": {"Type": "work"}}} Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1547985396', 'metadata': {'Type': 'work'}}}} Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '0' Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:12:07.028108 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 21:12:07.033902 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.035196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-811b9ba6-b436-4811-9d76-bd34ec103d86 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.291769 Aug 27 21:12:07.036833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f49dac95-4e3b-490c-b80d-811837a43b71 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.037923 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f49dac95-4e3b-490c-b80d-811837a43b71 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019966 Aug 27 21:12:07.038981 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2530/4940] 10.222.0.40 () {60 vars in 1156 bytes} [Sat Aug 27 21:12:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:12:07.047424 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2411/4941] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:06 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:07.048166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4a35379-be5c-4a1a-b010-2cb833230f13 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Action: 'create', calling method: .version_select at 0x7ff84e4f8e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1491151491", "metadata": {"Type": "work"}}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4a35379-be5c-4a1a-b010-2cb833230f13 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 119 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1491151491", "metadata": {"Type": "work"}}} Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1491151491', 'metadata': {'Type': 'work'}}}} Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '' Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:12:07.052455 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4a35379-be5c-4a1a-b010-2cb833230f13 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4a35379-be5c-4a1a-b010-2cb833230f13 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010699 Aug 27 21:12:07.058202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2531/4942] 10.222.0.40 () {60 vars in 1156 bytes} [Sat Aug 27 21:12:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:12:07.066594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-884281f6-46e3-45e9-bf8d-759a2782a6ca tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Calling method '.version_select at 0x7ff84e17ef70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:07.097969 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-884281f6-46e3-45e9-bf8d-759a2782a6ca tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] HTTP exception thrown: Volume tempest-invalid-2109501490 could not be found. Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-884281f6-46e3-45e9-bf8d-759a2782a6ca tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2109501490 HTTP/1.1 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume tempest-invalid-2109501490 could not be found. Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'tempest-invalid-2109501490'} Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2109501490 could not be found. (HTTP 404) (Request-ID: req-5991e095-66a4-4f0f-89bc-e0800f59c2bf) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:12:07.148668 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2109501490 could not be found. Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2109501490 could not be found. Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2109501490 could not be found. Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-884281f6-46e3-45e9-bf8d-759a2782a6ca tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 404 to user: Volume tempest-invalid-2109501490 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-884281f6-46e3-45e9-bf8d-759a2782a6ca tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2109501490" status: 404 len: 99 microversion: 2.1 time: 0.089564 Aug 27 21:12:07.154530 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2412/4943] 10.222.0.40 () {58 vars in 1218 bytes} [Sat Aug 27 21:12:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2109501490 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:12:07.162500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee0a0d12-8883-479d-a2b2-173b5240cbdf tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003940 Aug 27 21:12:07.163011 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2532/4944] 10.222.0.40 () {58 vars in 1140 bytes} [Sat Aug 27 21:12:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 21:12:07.174036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ba47fc6-98db-4b5b-8692-159d5ed7661a tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004322 Aug 27 21:12:07.175253 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2413/4945] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:12:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 21:12:07.189202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ef022e-8a4a-4ae9-8385-f4d1444b35d4 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Calling method '.version_select at 0x7ff84ed58820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:07.220082 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c4ef022e-8a4a-4ae9-8385-f4d1444b35d4 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] HTTP exception thrown: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ef022e-8a4a-4ae9-8385-f4d1444b35d4 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-volumes/baa5cb38-d731-4fbe-a9e1-d8587539d473 HTTP/1.1 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: method: Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: exception: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'baa5cb38-d731-4fbe-a9e1-d8587539d473'} Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. (HTTP 404) (Request-ID: req-c04e4e8f-17c2-48d8-91eb-74b2d8793c10) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:12:07.254302 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4ef022e-8a4a-4ae9-8385-f4d1444b35d4 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 404 to user: Volume baa5cb38-d731-4fbe-a9e1-d8587539d473 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4ef022e-8a4a-4ae9-8385-f4d1444b35d4 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/baa5cb38-d731-4fbe-a9e1-d8587539d473" status: 404 len: 109 microversion: 2.1 time: 0.074352 Aug 27 21:12:07.261791 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2533/4946] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:12:07 2022] DELETE /compute/v2.1/os-volumes/baa5cb38-d731-4fbe-a9e1-d8587539d473 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:12:07.269595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f6fb6ab-66f2-4588-8e30-11dc3844e089 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Calling method '.version_select at 0x7ff84e19f430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:07.304471 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9f6fb6ab-66f2-4588-8e30-11dc3844e089 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] HTTP exception thrown: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f6fb6ab-66f2-4588-8e30-11dc3844e089 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Request method failure captured: Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-volumes/699a95e3-c404-4e33-a94f-367102a4d7a0 HTTP/1.1 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoimYVpmJiq-N48niCto1wlKpuJJ-pFS5gdTlJ0CG3DhbRQbkrqj2FxjjDpTLfZwpKpcy4nzUU7zuarIBVN_AwNj1OyACIJymTKuoOyPfWTitIYCFT83dMLRJrUy1YjYEVw7-xzU6BudKLF5JkXs6uq-4HzNk18ONNHD1RnLts5UxB8 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f5fc5007625e433fbf2bffbae0bfbde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f5fc5007625e433fbf2bffbae0bfbde2", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f5fc5007625e433fbf2bffbae0bfbde2"}]}] Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: f5fc5007625e433fbf2bffbae0bfbde2 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesNegativeTest-926148243 Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: d96f83c13e324891b200b20a27eedd8b Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesNegativeTest-926148243-project Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '699a95e3-c404-4e33-a94f-367102a4d7a0'} Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. (HTTP 404) (Request-ID: req-22b956b6-73e8-4955-94b1-2a798cc1bff8) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:12:07.307516 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f6fb6ab-66f2-4588-8e30-11dc3844e089 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] Returning 404 to user: Volume 699a95e3-c404-4e33-a94f-367102a4d7a0 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:07.311921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f6fb6ab-66f2-4588-8e30-11dc3844e089 tempest-VolumesNegativeTest-926148243 tempest-VolumesNegativeTest-926148243-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/699a95e3-c404-4e33-a94f-367102a4d7a0" status: 404 len: 109 microversion: 2.1 time: 0.043383 Aug 27 21:12:07.316841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2414/4947] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:12:07 2022] GET /compute/v2.1/os-volumes/699a95e3-c404-4e33-a94f-367102a4d7a0 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:12:08.057561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:08.059465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:08.068885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:08.069362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:08.069827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:08.070574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:08.071031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:08.071632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:08.681650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:08.693636 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-376e3db1-5cda-46ca-86a1-dffabe5bba8b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.640321 Aug 27 21:12:08.705330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2534/4948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:08 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:09.721074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:09.722389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:09.728752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:09.729488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:09.729929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:09.730803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:09.731294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:09.731903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:10.123142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:10.123812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:10.131325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:10.131993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:10.132444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:10.133164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:10.133611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:10.134228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:10.150008 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] HTTP exception thrown: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Request method failure captured: Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 HTTP/1.1 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCodPlWHDPGwaPaNW83tHvX4CsMjV3zMVjckn_59DkLSuQtZ9G8DzMHNhs1dDqXOcT4BJd7q9XGljdziigXmEJwCkjaPJqKq2GlLv_RvIT5jKN5NPWFCFaWvMkR9J1OKE94atDTEu0uCcG-kMwkHkYa7sXc52mfANX7QR_f-qPjs0ol0 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_366653ab581f4c23aa632fe3253100cf", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}] Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c82ae6511f2443888af3d79a6a40d7d6 Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45'} Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:12:10.151679 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.156539 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.157618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:10.159175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Returning 404 to user: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:10.160534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-986d6df7-809f-4bdf-9ffa-bbda7ad09615 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "DELETE /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 404 len: 111 microversion: 2.32 time: 0.041821 Aug 27 21:12:10.164691 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2535/4949] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:12:10 2022] DELETE /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:12:10.170532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8f46131-9c9e-4643-974e-a0ebaf9c3c44 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.454131 Aug 27 21:12:10.170889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:10.171769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] [instance: 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:10.178146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:10.179008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:10.179634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:10.180638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:10.181263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:10.181848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:10.183823 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2415/4950] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:09 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:10.198451 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] HTTP exception thrown: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Request method failure captured: Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 HTTP/1.1 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCodPlWHDPGwaPaNW83tHvX4CsMjV3zMVjckn_59DkLSuQtZ9G8DzMHNhs1dDqXOcT4BJd7q9XGljdziigXmEJwCkjaPJqKq2GlLv_RvIT5jKN5NPWFCFaWvMkR9J1OKE94atDTEu0uCcG-kMwkHkYa7sXc52mfANX7QR_f-qPjs0ol0 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/366653ab581f4c23aa632fe3253100cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_366653ab581f4c23aa632fe3253100cf", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/366653ab581f4c23aa632fe3253100cf"}]}] Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 366653ab581f4c23aa632fe3253100cf Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TaggedBootDevicesTest-326852622 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c82ae6511f2443888af3d79a6a40d7d6 Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TaggedBootDevicesTest-326852622-project Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45'} Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:10.200126 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. Aug 27 21:12:10.204959 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:10.206502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] Returning 404 to user: Instance 28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:10.207578 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db81b601-e615-4b75-9a1c-69cc5e93e408 tempest-TaggedBootDevicesTest-326852622 tempest-TaggedBootDevicesTest-326852622-project] 10.222.0.40 "GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45" status: 404 len: 111 microversion: 2.32 time: 0.041609 Aug 27 21:12:10.208299 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2536/4951] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:10 2022] GET /compute/v2.1/servers/28dc7cfe-d7aa-4cf6-a0a5-40d3efc8cc45 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:12:11.191391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:11.192059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:11.196219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:11.204437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:11.205208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:11.205948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:11.207116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:11.207889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:11.209625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:11.474490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:11.484713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8051d413-f2a9-4f2f-829d-259238cb3080 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.297617 Aug 27 21:12:11.485340 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2416/4952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:11 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:12.506066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:12.506690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:12.514810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:12.515400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:12.515846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:12.516651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:12.517361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:12.517843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:12.541651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:12.549737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766afc8f-1c84-4de6-98eb-523a66fecb55", "name": "network-vif-plugged", "status": "completed", "tag": "9c2a927f-20eb-4af3-b1ec-abe5516af6b9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:12.560583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:12.571938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:12.572617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:12.572852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:12.603193 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] Creating event network-vif-plugged:9c2a927f-20eb-4af3-b1ec-abe5516af6b9 for instance 766afc8f-1c84-4de6-98eb-523a66fecb55 on nch1-master-1 Aug 27 21:12:12.620952 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-32c5e299-8f88-4844-91cd-c01bbafbf357 req-a46a22dd-7a7d-4130-9c64-ae511fd12598 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063274 Aug 27 21:12:12.623331 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2417/4953] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:12:12.838295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:12.876671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-577fc5a3-d2ff-4030-9fee-a9e2cad70e3a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.374295 Aug 27 21:12:12.877824 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2537/4954] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:12 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:13.899488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:13.900196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:13.909197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:13.909692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:13.910304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:13.911365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:13.911981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:13.912569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:14.069670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:14.083133 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eeb22cd3-6c02-4813-9d12-c2e88ce00a29 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1314 microversion: 2.1 time: 0.188311 Aug 27 21:12:14.104034 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2418/4955] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:13 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:15.115840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:15.117277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:15.142649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.143617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.144245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.145142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.145777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.146214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.361429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:15.375721 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04f751b7-8684-43b4-9240-a98d61239153 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1500 microversion: 2.1 time: 0.262824 Aug 27 21:12:15.377692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2538/4956] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:15 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:15.403126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:15.403891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:15.410719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.411950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.412587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.413554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.414209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.415001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.528694 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41310f44-2c82-4787-9642-0b002a38f2b1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55/action" status: 202 len: 0 microversion: 2.1 time: 0.130382 Aug 27 21:12:15.530709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2419/4957] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:15 2022] POST /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:15.541135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:15.542052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:15.559530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.561125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.564502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.565349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:15.565896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:15.567501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:15.846763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:15.859216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-61b7122e-db7e-4d27-9c0f-f4f50b8ec76a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1505 microversion: 2.1 time: 0.322927 Aug 27 21:12:15.860426 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2539/4958] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:15 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:16.882689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:16.883400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:16.897805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:16.898514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:16.904822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:16.905800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:16.906212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:16.906687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:17.091065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:17.106522 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a79fae1-0e82-49b5-80df-2655d110d744 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1485 microversion: 2.1 time: 0.227641 Aug 27 21:12:17.107457 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2420/4959] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:16 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1485 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:17.128410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:17.129011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:17.137628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:17.138594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:17.139689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:17.140821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:17.141745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:17.143953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:17.183774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lazy-loading 'flavor' on Instance uuid 766afc8f-1c84-4de6-98eb-523a66fecb55 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:17.565336 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf11c22b-0ed6-474a-b51f-a905785b2ff1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55/action" status: 202 len: 0 microversion: 2.1 time: 0.440999 Aug 27 21:12:17.575230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:17.582179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:17.592231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2540/4960] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:17 2022] POST /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:17.606631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:17.607624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:17.609026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:17.610075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:17.611378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:17.613231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:17.795487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:17.805170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab981d43-ff6a-42ca-8b0a-7ee418197dfd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1491 microversion: 2.1 time: 0.234397 Aug 27 21:12:17.806416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2421/4961] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:17 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1491 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:18.828753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:18.829574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:18.846312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:18.849386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:18.850976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:18.852785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:18.854581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:18.855883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:19.693494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:19.729930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1166d4f-3883-4829-8e31-29c46b14da8f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1491 microversion: 2.1 time: 0.903218 Aug 27 21:12:19.732677 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2541/4962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:18 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1491 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:20.754870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:20.755565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:20.768087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:20.780020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:20.780538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:20.780989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:20.781720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:20.782180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:20.785947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:21.291973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:21.304362 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a02370b-426d-49a6-880a-18803d7da1ca tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1512 microversion: 2.1 time: 0.554168 Aug 27 21:12:21.307735 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2422/4963] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:20 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:22.252481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1047369419", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "1e8609f2-9aa0-4ab0-9237-6d4b63aae40f"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:22.330747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:22.331931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:22.342218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:22.343104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:22.343588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:22.344311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:22.345804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:22.346253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:22.390236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] validate_networks() for [('1e8609f2-9aa0-4ab0-9237-6d4b63aae40f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:12:22.724880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:22.746519 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f121c4a2-1348-4d7d-a17e-fa00cca00761 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1512 microversion: 2.1 time: 0.422522 Aug 27 21:12:22.752230 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2423/4964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:22 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:23.298919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:23.299423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:23.299833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:23.300256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:23.303211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:23.322737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:23.324117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:23.325277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:23.326210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:23.327656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:23.328627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:23.397899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:12:23.410260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for user 879bc0b8cc764e5ca6f7c75a34a86d5f and project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:12:23.434370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:12:23.439023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:12:23.525467 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b932b48-4d34-4fa6-b069-c4810f4ed963 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589865 Aug 27 21:12:23.527378 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2542/4965] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:12:23.539731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0cd0861b-47b7-48e9-8ccd-f02c805be0a8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:23.541286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0cd0861b-47b7-48e9-8ccd-f02c805be0a8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:23.648446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0cd0861b-47b7-48e9-8ccd-f02c805be0a8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:23.658486 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0cd0861b-47b7-48e9-8ccd-f02c805be0a8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1218 microversion: 2.1 time: 0.123005 Aug 27 21:12:23.669796 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2424/4966] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:23 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:23.774484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:23.776470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:23.787809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:23.788934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:23.791136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:23.792329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:23.793106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:23.793997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:23.998809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:24.010523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a5d5e85b-a69c-44c1-9738-63f85961d3d3 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1512 microversion: 2.1 time: 0.244592 Aug 27 21:12:24.011374 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2543/4967] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:23 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:24.687943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:24.689102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:24.704660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:24.710379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:24.712331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:24.716247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:24.718776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:24.721267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:24.920221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:24.935533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3183e46-7523-4d26-9f2a-e1390470e1a5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1270 microversion: 2.1 time: 0.255769 Aug 27 21:12:24.936123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2425/4968] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:24 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:25.038723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:25.039530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:25.058072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.061663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.062220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.063084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.063949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.065902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.069205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766afc8f-1c84-4de6-98eb-523a66fecb55", "name": "network-vif-plugged", "status": "completed", "tag": "9c2a927f-20eb-4af3-b1ec-abe5516af6b9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:25.081422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.082200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.082818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.098379 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] Creating event network-vif-plugged:9c2a927f-20eb-4af3-b1ec-abe5516af6b9 for instance 766afc8f-1c84-4de6-98eb-523a66fecb55 on nch1-master-1 Aug 27 21:12:25.104928 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-22d9c512-f1f8-4cf6-8b86-8ef8f889ca6e req-e7f79b60-cb9b-4ad7-a206-be2c9529f193 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039742 Aug 27 21:12:25.106297 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2426/4969] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:25.418247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:25.431145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4521da22-aa30-419f-9159-d6ae7a0dda83 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.397496 Aug 27 21:12:25.432257 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2544/4970] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:25 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:25.804486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:25.806811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:25.817338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.828157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.829015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.829946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.830555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.831121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.957776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:25.958553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:25.968598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.975915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.976373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:25.977127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:25.977588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:25.978010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:26.021071 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a72e96a-24f1-41f3-93b5-c7fd4b6153d6 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "POST /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb/action" status: 200 len: 32651 microversion: 2.1 time: 0.220431 Aug 27 21:12:26.024937 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2427/4971] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:25 2022] POST /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb/action => generated 32651 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:12:26.224186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:26.242179 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec8fe12a-e1ef-4a92-8c0b-70ae38f42439 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1276 microversion: 2.1 time: 0.286552 Aug 27 21:12:26.244834 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2545/4972] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:25 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:26.458315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:26.459862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:26.477436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:26.478473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:26.479176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:26.480180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:26.481745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:26.485097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:26.965098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:26.984517 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99a9cf1a-ca65-4ab5-91c9-36aafea58523 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.530584 Aug 27 21:12:26.985575 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2428/4973] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:26 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:27.267461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:27.268897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:27.294114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:27.294944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:27.295647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:27.296885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:27.298093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:27.299324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:27.651779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:27.676642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-422294f5-6de0-4802-a31e-7330e4c6a7cb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1276 microversion: 2.1 time: 0.413103 Aug 27 21:12:27.704648 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2546/4974] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:27 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1276 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:28.013066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:28.013700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:28.026627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:28.029162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:28.030616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:28.031567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:28.032944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:28.033740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:28.104374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:28.604134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:28.618228 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23c671ed-5b49-4962-b4d6-26de3d148333 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.610478 Aug 27 21:12:28.624639 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2429/4975] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:28 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:28.701161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:28.702606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:28.715827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:28.719952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:28.720528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:28.721479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:28.722050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:28.722683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.064366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:29.076281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e5252ec-b3a9-4b1a-90e0-4e371fbee5dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.379073 Aug 27 21:12:29.080141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2547/4976] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:28 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:29.242192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:29.243578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:29.256937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.257752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.259579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.263991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.264929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.265608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.277976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157016a8-4962-4863-b68c-45a6b51338eb", "tag": "81b0f137-1e28-4675-9179-b8940cbfe8a7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:29.289903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:29.299720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:12:29.322782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.323270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.333384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.398221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] Creating event network-changed:81b0f137-1e28-4675-9179-b8940cbfe8a7 for instance 157016a8-4962-4863-b68c-45a6b51338eb on nch1-master-1 Aug 27 21:12:29.434034 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a3be0d22-4be9-4448-97ed-6529b5dee80c req-3225a0cb-80f2-40a2-ba80-5e8b7c6b6d05 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155925 Aug 27 21:12:29.437431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2548/4977] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:29.499847 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2550a9a-7338-417b-a5ce-eb0e519acfe0 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 204 len: 0 microversion: 2.1 time: 0.261161 Aug 27 21:12:29.501889 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2430/4978] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:12:29 2022] DELETE /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:12:29.510743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:29.512166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:29.526035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.526701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.527153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.540183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.540985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.541587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.630892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7160b9cf-bbaf-4c51-a428-8eaad209f824", "tag": "6374bc3f-fbcd-437a-9e44-a1327f377c25"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:29.654948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.657755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.658325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.693288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] Creating event network-changed:6374bc3f-fbcd-437a-9e44-a1327f377c25 for instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 on nch1-master-1 Aug 27 21:12:29.707575 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c445c8ba-f455-4649-8f81-8660f10e33cf req-e775663e-4bb1-4a1c-bebb-9e1e516ff3c5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080107 Aug 27 21:12:29.711264 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2431/4979] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:12:29.724746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:29.725849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:29.744462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.745114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.745995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:29.747149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:29.748716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:29.750520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:30.046244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:30.055322 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2e018e23-c496-44aa-a785-bb824c8032d7 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1672 microversion: 2.1 time: 0.548901 Aug 27 21:12:30.069162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:30.078352 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2549/4980] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:29 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1672 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:30.078659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-682f6ee6-4c28-40e6-930f-c09547418c4c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.365381 Aug 27 21:12:30.079375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2432/4981] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:29 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:30.103193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:30.104227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:30.113055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:30.113844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:30.114646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:30.115591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:30.116324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:30.116901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:30.371889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:30.393535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba8adca7-9033-4cb4-81a6-762eeb7f6602 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.295110 Aug 27 21:12:30.397717 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2550/4982] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:30 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:31.104531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:31.105115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:31.105764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:31.106423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:31.117085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.120365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.120869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.121567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.121991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.122456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.123207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.126204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.126537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.126689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.127147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.129907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.688737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:31.704981 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19247a69-8279-4a21-a489-347efaa28d6b tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.603528 Aug 27 21:12:31.715751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2551/4983] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:31 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:31.726179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:31.728346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:31.735522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.736528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.737593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.738674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:31.739289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:31.739924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:31.788505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:31.800562 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8d46046-a1ac-45d4-a67c-7a9feedddaf5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1672 microversion: 2.1 time: 0.702406 Aug 27 21:12:31.801154 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2433/4984] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:31 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1672 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:31.989838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2075300250", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:32.067080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:32.068011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:32.068778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:32.069393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:32.070063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:32.093417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.093908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.094524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.096213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.097344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.097965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.124916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Getting quotas for project 1144d8b2695745c8a81018bee53d131f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:12:32.135722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Getting quotas for user c33f114379a04818b131e97cd634e82e and project 1144d8b2695745c8a81018bee53d131f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:12:32.151751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:12:32.155787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:12:32.239983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b06791b2-fe4e-4e4d-b5fa-38ade33454f7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.437710 Aug 27 21:12:32.244195 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2434/4985] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:12:32.257594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:32.260828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:32.481143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:32.509888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:32.515529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:32.519007 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d432ea6-6a05-4362-a968-c91b909fb95d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 200 len: 1278 microversion: 2.47 time: 0.265424 Aug 27 21:12:32.520121 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2435/4986] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:32 2022] GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:32.605846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2005006356", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:32.690477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:32.690993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:32.692525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:32.693347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:32.695131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:32.756453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.757380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.757981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.780964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:32.788025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.791474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3454905d-ea05-430a-b4ae-ccdeda6907fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 1.069485 Aug 27 21:12:32.793462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.794263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.798659 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2552/4987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:31 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:32.818480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157016a8-4962-4863-b68c-45a6b51338eb", "name": "network-vif-deleted", "tag": "81b0f137-1e28-4675-9179-b8940cbfe8a7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:32.857676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Getting quotas for project 1144d8b2695745c8a81018bee53d131f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:12:32.859925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.860975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.862613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.864704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Getting quotas for user c33f114379a04818b131e97cd634e82e and project 1144d8b2695745c8a81018bee53d131f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:12:32.879080 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] Creating event network-vif-deleted:81b0f137-1e28-4675-9179-b8940cbfe8a7 for instance 157016a8-4962-4863-b68c-45a6b51338eb on nch1-master-1 Aug 27 21:12:32.885370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6f9bff17-980c-486d-8101-fd46c5f35415 req-39390475-278d-45fd-93c6-fccc11369965 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084058 Aug 27 21:12:32.886372 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2553/4988] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:12:32.894551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:32.895531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:32.897573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:12:32.900714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:12:32.903545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.904388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.905008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.905981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:32.906591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:32.907413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:32.917204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:33.016666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9bb9d2f6-77c9-4364-8c0c-e0628ad4dc32 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.416404 Aug 27 21:12:33.018996 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2436/4989] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 21:12:33.030766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:33.035463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:33.053182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:33.053871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:33.054475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:33.055603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:33.057328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:33.068163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:33.151377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:33.152672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:33.153383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:33.153997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid 157016a8-4962-4863-b68c-45a6b51338eb {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:33.294882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:33.303355 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2807faf0-068f-4a49-b6e0-63e99f574916 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1339 microversion: 2.1 time: 0.283065 Aug 27 21:12:33.307564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2437/4990] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:33 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:33.312816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3eadfd1-9e22-4f9b-a2f4-915a8d1f7e2b tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:33.341939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3eadfd1-9e22-4f9b-a2f4-915a8d1f7e2b tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:33.351289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:33.422683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:33.434732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:33.446904 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50abc7c9-b332-451a-b725-ff0e781491f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.559088 Aug 27 21:12:33.451121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2554/4991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:32 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:33.474653 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3eadfd1-9e22-4f9b-a2f4-915a8d1f7e2b tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "PUT /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 992 microversion: 2.47 time: 0.165555 Aug 27 21:12:33.477167 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2438/4992] 10.222.0.40 () {62 vars in 1297 bytes} [Sat Aug 27 21:12:33 2022] PUT /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 992 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:12:33.495077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:33.495807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:33.587290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:33.601455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:33.603036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:33.608071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-463765d4-2cbd-4eb2-a453-cc283893ed15 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1278 microversion: 2.47 time: 0.116952 Aug 27 21:12:33.620067 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2555/4993] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:33 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:33.825572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:33.826261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:33.835858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:33.837037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:33.837759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:33.839484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:33.840765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:33.841380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.097466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.106950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d10e034-16e4-4b12-aa7b-03902b814860 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.286576 Aug 27 21:12:34.107564 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2439/4994] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:33 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:34.328708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:34.329974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:34.338160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.339297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.340714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.341667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.342344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.342979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.388466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.389825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.390540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.391220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid 157016a8-4962-4863-b68c-45a6b51338eb {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:34.474827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:34.477569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:34.501206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.504480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.505015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.511273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.514109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.515087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.558850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.572028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62c15eb2-8321-4656-8758-c2ef3a44f513 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1339 microversion: 2.1 time: 0.247904 Aug 27 21:12:34.579416 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2556/4995] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:34 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:34.634694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:34.635377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:34.648744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.650054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.650751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.651770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.652510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.653145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.804413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.814308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.815779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.816963 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a4270780-1bad-4c76-bd07-858feee438ae tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1330 microversion: 2.47 time: 0.186937 Aug 27 21:12:34.824435 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2557/4996] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:34 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:34.831007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:34.831682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:34.837835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:34.853218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.854074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.856165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.857477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:34.864397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:34.864606 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3209728f-1a5b-437b-b851-3becd9862de1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.394027 Aug 27 21:12:34.865240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:34.878526 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2440/4997] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:34 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:35.011224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lazy-loading 'services' on Instance uuid f08894f9-51d1-4343-ac4d-194a49f114e9 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:35.114534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments/61a807d3-b11f-43f6-965d-0da042564d73" status: 202 len: 0 microversion: 2.1 time: 0.288436 Aug 27 21:12:35.118282 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2558/4998] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:12:34 2022] DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments/61a807d3-b11f-43f6-965d-0da042564d73 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:35.129338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:35.130218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:35.140336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.140835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.141277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.141987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.142613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.143596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.408531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:35.420025 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3eed9ad3-2350-423f-932c-c633904dea75 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.296400 Aug 27 21:12:35.434411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2441/4999] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:35 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:35.611091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:35.611918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:35.623446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.624949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.625412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.626149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.626596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.627026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.690437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.691393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.692011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.692940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lazy-loading 'fault' on Instance uuid 157016a8-4962-4863-b68c-45a6b51338eb {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:35.761407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee686b708a849c9a2e59a0ddba908e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795a623882274b06a65971bfe1398e29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:35.770760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbf089af-0e94-47b4-aef1-900aeab506d5 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 200 len: 1339 microversion: 2.1 time: 0.179038 Aug 27 21:12:35.771386 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2559/5000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:35 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:35.846612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:35.847455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:35.856889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.857733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.858335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.859208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.859765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.860320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.890296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:35.890914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:35.899519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.902204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.903721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.906837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:35.907324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:35.907783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:35.960661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:35.975941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:35.979528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:35.983260 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-53a5c95d-d14e-43d3-989e-e170901c7d75 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1338 microversion: 2.47 time: 0.140825 Aug 27 21:12:35.984972 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2442/5001] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:35 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:36.112164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:36.123933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81829caf-e164-4827-9400-2d3c7462efce tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.238355 Aug 27 21:12:36.124879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2560/5002] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:35 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:36.443696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:36.444935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:36.452203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:36.453193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:36.454235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:36.455397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:36.456105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:36.456974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:36.633410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:36.643687 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c331be71-a141-4ca6-9834-b6006c99492b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.205176 Aug 27 21:12:36.645267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2443/5003] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:36 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:36.793151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:36.795220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] [instance: 157016a8-4962-4863-b68c-45a6b51338eb] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:36.803198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:36.804110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:36.804780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:36.805752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:36.806444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:36.807099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:36.824393 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] HTTP exception thrown: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Request method failure captured: Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb HTTP/1.1 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCodkrZ6t2-28cfaSkItrMzxcB3j2Ki8YPP1YrIowChs1K-PK_kcUi_c3p7qsZtW9Q0VmJKBzXKC1SoIRAMUyj7oTKD5mK5KTjnYaOLkkubuWzqHkFEyHQoRMIwHyF4f1xIakvBkKlL3PUnfJNRy61iIF4Qq9A31NEU_laHMqJc3iHKo Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/795a623882274b06a65971bfe1398e29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_795a623882274b06a65971bfe1398e29", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/795a623882274b06a65971bfe1398e29"}]}] Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkBasicOps-229216701 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 795a623882274b06a65971bfe1398e29 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkBasicOps-229216701 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: eee686b708a849c9a2e59a0ddba908e6 Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkBasicOps-229216701-project Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '157016a8-4962-4863-b68c-45a6b51338eb'} Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:12:36.826681 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. Aug 27 21:12:36.830915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:12:36.833179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Returning 404 to user: Instance 157016a8-4962-4863-b68c-45a6b51338eb could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:12:36.834365 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7246686d-050b-42c7-864c-0d8a8176d92f tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb" status: 404 len: 111 microversion: 2.1 time: 0.045949 Aug 27 21:12:36.835094 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2561/5004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:36 2022] GET /compute/v2.1/servers/157016a8-4962-4863-b68c-45a6b51338eb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:12:37.014016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:37.019295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:37.035510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.036016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.036133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cb4cd23-9010-45cd-967c-00d1a3ac85f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] Calling method '.version_select at 0x7ff84f8ca160>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:37.038354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.041988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.046881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.047605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.066705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cb4cd23-9010-45cd-967c-00d1a3ac85f8 tempest-TestNetworkBasicOps-229216701 tempest-TestNetworkBasicOps-229216701-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1195794736" status: 202 len: 0 microversion: 2.1 time: 0.034312 Aug 27 21:12:37.069368 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2562/5005] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 21:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1195794736 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:37.145128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:37.145800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:37.154364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.154870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.155318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.156092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.156551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.156986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.224660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:37.233906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:37.236930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:37.236930 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-846e6439-74a1-46bd-a71c-a193a31a8898 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1338 microversion: 2.47 time: 0.227342 Aug 27 21:12:37.237626 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2444/5006] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:37 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:37.522894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:37.531844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc7a4525-c51f-4519-be86-7dc3b6efc95a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.390689 Aug 27 21:12:37.532726 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2563/5007] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:37 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:37.664764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:37.665669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:37.674458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.674980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.681622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.682543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:37.683042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:37.683601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:37.966105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:37.976812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e947a80-e547-4b7d-8cee-315e4fa01e3f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.315831 Aug 27 21:12:37.988836 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2445/5008] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:37 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:38.270213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:38.271901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:38.286825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:38.290012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:38.291067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:38.292102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:38.292864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:38.293544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:38.511997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:38.538231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:38.548040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:38.552365 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5652cd4d-c755-4025-85f5-6e1cf94122a6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1336 microversion: 2.47 time: 0.288575 Aug 27 21:12:38.553794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2564/5009] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:38 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1336 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:38.572619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:38.574870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:38.603035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:38.603974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:38.606323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:38.608912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:38.609803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:38.614115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:38.879245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160b9cf-bbaf-4c51-a428-8eaad209f824", "name": "network-vif-plugged", "status": "completed", "tag": "6374bc3f-fbcd-437a-9e44-a1327f377c25"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:38.903334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:38.904098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:38.907767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:38.949513 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] Creating event network-vif-plugged:6374bc3f-fbcd-437a-9e44-a1327f377c25 for instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 on nch1-master-1 Aug 27 21:12:38.967441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3687bfb1-fc97-4ab9-9a17-12794d6ade4f req-43a76a94-30e1-41c2-b127-fd21a9838144 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087910 Aug 27 21:12:38.969465 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2565/5010] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:12:39.005584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:39.007436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:39.034345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.035787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.036656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.037868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.038511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.039115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.517230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:39.540541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1166e449-b4ea-450d-8da1-647c47aeb758 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.990126 Aug 27 21:12:39.541248 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2446/5011] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:38 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:39.589231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:39.597416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:39.601287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:39.615395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.616356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.617587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.618521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.619301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.627813 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-184e83e3-b071-4563-9d7c-99811b688822 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.629756 Aug 27 21:12:39.629139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2566/5012] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:38 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:39.631442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.643585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:39.662670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.668416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.674931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.758711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:12:39.836265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-676300c0-77d9-4570-bf6e-9ffe5e8637c5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action" status: 202 len: 0 microversion: 2.1 time: 0.205240 Aug 27 21:12:39.840259 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2567/5013] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:39 2022] POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:39.856377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:39.858592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:39.868201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.869241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.869951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.872745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:39.873434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:39.874187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:39.891986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:39.923141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:39.924983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:39.933910 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-04bb202b-2b9a-4f3b-bf03-a9cdaaacc72e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1336 microversion: 2.47 time: 0.353951 Aug 27 21:12:39.935628 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2447/5014] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:39 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1336 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:40.184383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:40.204984 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f79d725e-df48-4ef9-beb4-a3a5616cb5ad tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.358895 Aug 27 21:12:40.210007 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2568/5015] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:39 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:40.437026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:40.437818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:40.453034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.454723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.455177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:40.460043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.460580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.462448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:40.478158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:40.537531 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-857f0af5-2de0-4260-a3e2-dd9d4d262280 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/ips" status: 200 len: 151 microversion: 2.20 time: 0.106990 Aug 27 21:12:40.550045 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2448/5016] 10.222.0.40 () {60 vars in 1289 bytes} [Sat Aug 27 21:12:40 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/ips => generated 151 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:12:40.564164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:40.564880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:40.576916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.583089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.584162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:40.585410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.586415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.587070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:40.657930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:40.658554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:40.662520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:40.680515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.681266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.684723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:40.686541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:40.687235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:40.688686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:41.040633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.053479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d563c650-3ed8-48be-a196-44e2fd5f0ef6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.494273 Aug 27 21:12:41.054948 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2569/5017] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:40 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:41.063848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:41.065258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:41.079710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:41.080463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:41.081102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:41.082367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:41.083377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:41.083841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:41.300322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.318119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-502ad6d1-d1f6-411d-88e6-72c9faf3a671 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1318 microversion: 2.1 time: 0.665790 Aug 27 21:12:41.333680 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2449/5018] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:40 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:41.340383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:41.341226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:41.347631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.349783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:41.350450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:41.351031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:41.352408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:41.353029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:41.353610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:41.364942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.366420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.368000 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a8b26a7-a87f-4cb5-a427-2083df7c7b60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1336 microversion: 2.47 time: 0.311881 Aug 27 21:12:41.379638 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2570/5019] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:41 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1336 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:41.667691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:41.681152 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49b54906-a38f-4ab7-aa3e-d1a2e1214b81 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.346168 Aug 27 21:12:41.682004 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2450/5020] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:41 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:42.078434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:42.079520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:42.101126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.102782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.103965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.105865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.107464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.109615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.344563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:42.345531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:42.359382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:42.363169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:42.369811 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-116937d2-3f6d-4fd2-b67c-3b8c91d1f853 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.295396 Aug 27 21:12:42.371457 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2571/5021] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:42 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:42.387267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.388171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.389095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.389877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.390697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.391536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.394567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:42.395321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:42.416754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:42.832313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:42.883593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=16 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:43.458448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:43.477949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:43.480503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:43.482478 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f36d26a4-b7c0-44c1-800b-9d11ff5d3a27 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1336 microversion: 2.47 time: 1.093754 Aug 27 21:12:43.483858 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2572/5022] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:42 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1336 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:43.491251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:43.492370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:43.500856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.502561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.503259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.504254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.504938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.505604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.519733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:43.530173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ae4e776-6a86-4a97-bc07-ca8de3414833 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1509 microversion: 2.1 time: 1.190123 Aug 27 21:12:43.542468 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2451/5023] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:42 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1509 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:43.553641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:43.554430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:43.564740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.567920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.569701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.570823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.575187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.578340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.601456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:43.631198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lazy-loading 'flavor' on Instance uuid eafef7f1-0bed-4a72-8ab4-2bec00006e79 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:12:43.778382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:43.789929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6894e2f6-4089-472c-9d52-39f968ddfd38 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.304693 Aug 27 21:12:43.790638 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2573/5024] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:43 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:43.811868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:43.812902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:43.822054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.822957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.823699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.824709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:43.825391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:43.826033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:43.984819 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c74084c4-4300-4ed3-bf1b-49a9463a8833 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/action" status: 202 len: 0 microversion: 2.20 time: 0.440399 Aug 27 21:12:43.986176 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2452/5025] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 21:12:43 2022] POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:12:43.992540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:43.993419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.002317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.002981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.003570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.004776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.005356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.005891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.064652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.086575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8d1e466-1663-4d59-8f2e-99abeac16b58 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.294183 Aug 27 21:12:44.086892 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2574/5026] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:43 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:44.105792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:44.106838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.114426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.115328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.115900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.116879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.117448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.118006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.303710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.314354 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-661a3612-162c-4daf-9038-ab1eeb9e2489 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1509 microversion: 2.1 time: 0.326033 Aug 27 21:12:44.315653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2453/5027] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:43 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:44.342429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:44.345495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.369071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.369578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.370017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.370821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.371281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.371740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.416320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.432542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.435470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.437619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa4a0b24-80d2-4cf9-83ed-d4601f78c67b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.349226 Aug 27 21:12:44.438707 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2575/5028] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:44 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:44.469757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:44.470177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:44.470736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:44.471048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:44.471580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:44.510715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:44.512807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.524983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.526306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.527025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.530014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.530483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.530896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.614935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.633716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.635447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.636379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.638519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.641686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.642475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.663231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.674272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.675752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:44.676950 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad569b5f-856e-48f0-9b07-a5edf10990c2 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1357 microversion: 2.47 time: 0.171665 Aug 27 21:12:44.683761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2576/5029] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:44 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:44.707898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:44.711463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.721104 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3f21f8a-340c-4ace-a941-56b002964392 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "POST /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824/action" status: 202 len: 1111 microversion: 2.1 time: 0.389375 Aug 27 21:12:44.721955 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2454/5030] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:44 2022] POST /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824/action => generated 1111 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 27 21:12:44.740300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:44.741044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:44.752110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.753398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.753865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.754752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.757811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.757985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.758513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.759251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.761074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.763633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:44.764188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:44.778814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:44.955660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:12:44.957592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:12:44.958278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:12:44.958912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:12:44.960365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:12:45.055229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:45.063363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.064367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.065122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.066294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.067167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.068069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.159332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.169484 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5f249c68-e515-4b6a-a0a9-f4d70c7ebcf6 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "POST /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4/action" status: 202 len: 1079 microversion: 2.47 time: 0.470950 Aug 27 21:12:45.170137 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2577/5031] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 21:12:44 2022] POST /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4/action => generated 1079 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 21:12:45.175080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-112dbb33-1c62-489c-bac8-f4c999a5f0be tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.435882 Aug 27 21:12:45.187638 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2455/5032] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:44 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:45.188068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:45.188068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:45.193139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:45.196196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:45.206351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.206865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.207321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.208091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.209514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.211246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.211647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.211798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.212204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.212930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.213760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.214189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.575685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.589219 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-253884b6-61df-4912-a24b-59b3ca51dec2 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.417009 Aug 27 21:12:45.605491 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2578/5033] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:45 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:45.611436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:45.612343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:45.622828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.623852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.624746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.626463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.627082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.627736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.785856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.795387 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ebba9642-813f-412e-83ce-5a3238bb7b37 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1504 microversion: 2.1 time: 0.614917 Aug 27 21:12:45.810030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.813585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2456/5034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:45 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:45.818736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:45.819636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:45.828356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.829207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.830010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.831012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:45.831846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:45.832715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:45.835729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.841108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:45.843868 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5bc378ed-6100-4422-a172-327d6ca05177 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.235749 Aug 27 21:12:45.844473 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2579/5035] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:45 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:46.097392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:46.112666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:46.114068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:46.115258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eca6079f-b09a-4501-8600-8cb823f2b5f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.300594 Aug 27 21:12:46.116227 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2457/5036] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:45 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:46.198008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:46.198659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:46.206307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.206804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.207358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.208069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.208764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.209553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.393635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:46.411687 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1bac607b-1bec-477f-9667-a96386cad025 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.217203 Aug 27 21:12:46.423907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2580/5037] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:46 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:46.615293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:46.615944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:46.625410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.625936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.626503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.627262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.627846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.628696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.821845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:46.822412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:46.830130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.830621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.831269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.833535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.834258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.834860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.847258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:46.862670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f27d5d07-64ca-495d-9ec0-a9fd08447134 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.253676 Aug 27 21:12:46.884063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2458/5038] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:46 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:46.894141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:46.894818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:46.913831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.914635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.915270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:46.916355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:46.917021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:46.917694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.011253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.024014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.028152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.029786 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8f014f9-1c35-42c9-9fad-ba53f2337add tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.144168 Aug 27 21:12:47.030605 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2459/5039] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:46 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:47.089696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.100323 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6bd21f8e-bd7b-4668-855c-648a1446fb35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1504 microversion: 2.1 time: 0.283301 Aug 27 21:12:47.100927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2581/5040] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:46 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:47.139041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:47.140109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:47.146633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.147626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.148138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.149088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.149622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.150269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.295542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.304898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.306547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.308141 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dfadb87c-06a2-4308-8669-c19fb2b65efb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.173060 Aug 27 21:12:47.308999 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2460/5041] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:47 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:47.435646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:47.436394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:47.444072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.444690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.445132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.445896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.446360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.446868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.594361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:47.603123 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a8b3743-b29e-42ce-9b75-e63fdb829803 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.173056 Aug 27 21:12:47.603935 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2582/5042] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:47 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:47.890863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:47.893322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:47.901945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.902704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.904048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.904795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:47.905260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:47.906129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:47.910773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:48.054763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.055652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.064747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.065701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.066536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.067848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.068635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.069353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.078277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.088002 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd0e691a-6cd8-4536-a33e-d81dfb07b95a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.202658 Aug 27 21:12:48.089340 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2461/5043] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:47 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:48.125081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.126209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.133168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.133967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.134827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.136912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.137836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.138527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.163438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.177019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.179334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.181471 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dade53c2-02c5-43b5-aee0-737c84258cb7 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.131266 Aug 27 21:12:48.199516 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2583/5044] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:48.327259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.331110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.331845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.336036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb8e0613-9f20-4427-a25e-f26343f8f87a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 200 len: 1507 microversion: 2.1 time: 0.216205 Aug 27 21:12:48.336616 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2462/5045] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:48.338767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.339442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.340591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.341310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.341772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.342205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.358493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.363221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.372395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.378057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.378687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.381051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.381608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.382731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.649045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.658774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.660923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.662130 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c4e7744-841c-4625-80de-e7da46d4b3dd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.335221 Aug 27 21:12:48.675495 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2584/5046] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:48.675495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766afc8f-1c84-4de6-98eb-523a66fecb55", "name": "network-vif-unplugged", "status": "completed", "tag": "9c2a927f-20eb-4af3-b1ec-abe5516af6b9"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:48.682907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.693742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.694108 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d01d0bef-71c4-463a-bc72-aed4e1919962 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.340091 Aug 27 21:12:48.694254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.694682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.695501 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2463/5047] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:48.700312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.701394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.706925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.707467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.707902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.708949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.709196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.709462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.720695 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] Creating event network-vif-unplugged:9c2a927f-20eb-4af3-b1ec-abe5516af6b9 for instance 766afc8f-1c84-4de6-98eb-523a66fecb55 on nch1-master-1 Aug 27 21:12:48.726613 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b111b864-0bc6-409c-b1d2-db176932d9ac req-99b1de87-a44a-47c5-849d-9f218517c765 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062125 Aug 27 21:12:48.727301 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2585/5048] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:12:48.736317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.737027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.744940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.745592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.746386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.747841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.748313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.748750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.922340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.937450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:48.938881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea138a20-fe03-4563-857c-4ee32edb686d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.242728 Aug 27 21:12:48.946062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fab03f8c-2b9c-404d-95bb-04e98ea520f2 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.214103 Aug 27 21:12:48.947029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2586/5049] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:48.952634 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2464/5050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:48.972529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:48.973389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:48.981817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.982301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.982809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.983826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:48.984286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:48.984717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:48.989640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:49.111244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.112345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.119031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.119883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.120608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.122105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.122754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.123382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.131010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.148264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9541c840-04d0-4c49-b0ea-f0a842e956e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.180019 Aug 27 21:12:49.149013 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2587/5051] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:48 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:49.169809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.170725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.177202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.177704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.178153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.178898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.179376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.180042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.343111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.352883 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-301f9063-bbf5-4156-b0a8-676f73d150f4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.246156 Aug 27 21:12:49.353574 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2465/5052] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:49.358961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.359634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.366064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.366841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.367649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.368770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.369475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.370128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.376821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.385931 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84dc9116-fd58-4f45-84d9-347fa3a4f60a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.220181 Aug 27 21:12:49.386561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2588/5053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:49.409018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:49.415927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.416484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.417001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.441886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.451427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.452297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:12:49.452900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.454105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9ce44d3-84d6-4f1f-aa4d-c13d48bacf19 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.099404 Aug 27 21:12:49.454675 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2466/5054] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:49.498665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d90c65ca-61ba-4a26-b66c-21b13c4029ee tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.094540 Aug 27 21:12:49.499187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2589/5055] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:49 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:12:49.508115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.508737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.516348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.516953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.517525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.519004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.519517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.519951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.664413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.672509 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9c5c099-1b83-4488-98f6-5e811cb56be0 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.168741 Aug 27 21:12:49.673100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2467/5056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:49.690017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.690883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.697652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.698237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.698774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.699697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.700153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.700577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.834217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.843988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.845265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:49.846442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09b0fd65-b90b-4afb-b3f7-8f0db52cf2f0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.161370 Aug 27 21:12:49.847009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2590/5057] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:49.962355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:49.962943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:49.971134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.971801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.972283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:49.973107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:49.973601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:49.974063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.117626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.127519 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-999e8743-f332-4b73-8cd5-548e6b263bf0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.168292 Aug 27 21:12:50.128109 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2468/5058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:49 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:50.374831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:50.375477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:50.382454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.382964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.383446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.384187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.384654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.385088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.478164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:50.479205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:50.486253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.486790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.487434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.488399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.488943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.489563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.536771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.548792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab4862dd-b442-4d72-8eb9-d999aa94c583 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.178512 Aug 27 21:12:50.549659 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2591/5059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:50 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:50.566384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.576080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.577482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.579595 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fad53c8f-7b8a-401f-9f0f-d17b8fee0b18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.105334 Aug 27 21:12:50.580566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2469/5060] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:50 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:50.694783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:50.695439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:50.700559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:50.705632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.706140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.706590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.707302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.707791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.708226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.853739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:50.862072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8254b5b3-2070-44d6-a36c-215acdf8cad9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.171674 Aug 27 21:12:50.862662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2592/5061] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:50 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:50.869566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:50.870202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:50.876899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.877450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.877892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:50.878593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:50.879046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:50.879507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.023847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.033754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.035249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.036470 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-df15a028-0d09-47de-bdcc-fe16403f2524 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.170937 Aug 27 21:12:51.037030 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2470/5062] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:50 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:12:51.149067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:51.149690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:51.156291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.156976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.157423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.158130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.158589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.159021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.303822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.314294 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c133f589-c31d-4187-9696-9b05ab1aac91 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.169364 Aug 27 21:12:51.314892 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2593/5063] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:51 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:51.570316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:51.570938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:51.579011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.579526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.579943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.580637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.581084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.581503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.606189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:51.607137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:51.616508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.617104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.617613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.618397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.618927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.619435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.716455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.726198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.727814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.729521 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a7a2d276-f811-47a6-8a33-135012720eaf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.129408 Aug 27 21:12:51.730168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2594/5064] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:51 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:51.754964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:51.763438 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ecd9066-c44c-46a5-a519-35a2fea3cbe0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1677 microversion: 2.1 time: 0.197046 Aug 27 21:12:51.763966 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2471/5065] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:51 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:51.884272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:51.885030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:51.892621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.893122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.893561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:51.894555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:51.895056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:51.895978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.037396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.046051 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f66eedd8-26a8-4503-b24e-34ca7116d1ec tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.166141 Aug 27 21:12:52.046989 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2595/5066] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:51 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:52.060920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:52.061877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:52.068702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.069281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.069886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.070414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.070879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.071311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.214232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.224831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.226760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.228017 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-97abde50-c921-446a-8c2d-7c57e2508214 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.171966 Aug 27 21:12:52.228595 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2472/5067] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:52 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:52.336991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:52.337846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:52.345999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.346600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.347048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.347792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.348254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.348686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.496718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.507283 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c78cb652-1b5e-4070-9d14-76784e3ac784 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.174579 Aug 27 21:12:52.507937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2596/5068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:52 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:52.754681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:52.755553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:52.762269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.763004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.763945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.764656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.765214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.765996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.786571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:52.787236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:52.794983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.795748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.796365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.797258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.797719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.798308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.839297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.847912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.849374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.850578 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db62d419-91a2-4f3b-a0a5-e42844096a4c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.100001 Aug 27 21:12:52.851391 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2473/5069] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:52 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:52.937357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:52.946841 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f32abff0-4ade-4cec-9955-d62e1e921b46 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1654 microversion: 2.1 time: 0.165623 Aug 27 21:12:52.947619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2597/5070] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:52 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:52.968230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:12:52.974825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:52.975326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:52.975796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:52.999884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Going to try to start instance {{(pid=140433) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:12:53.048065 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00a5eaa4-ef50-4bd9-8ffc-046d238d7463 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action" status: 202 len: 0 microversion: 2.1 time: 0.083620 Aug 27 21:12:53.048538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2474/5071] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:12:52 2022] POST /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:12:53.057476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:53.058298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:53.069093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.070002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:53.070692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.070920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:53.071939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.072952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.074483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.075380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.079003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.079527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.079962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.080667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.081147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.081569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.303603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.314766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd9d3bc7-0cf2-4383-9a6d-02223001057a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.249632 Aug 27 21:12:53.315803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2475/5072] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:53 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:53.323046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:53.324250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:53.333596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.334501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.335029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.335512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.336402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.336869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.342842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.348157 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3238e600-6953-42b3-83aa-799f2a325cfb tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1663 microversion: 2.1 time: 0.294729 Aug 27 21:12:53.349093 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2598/5073] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:53 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1663 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:53.481753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.485938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:53.491886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.493318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.494523 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60bc86da-5ce0-439a-9399-472910f5552d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.177163 Aug 27 21:12:53.495771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2476/5074] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:53 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:53.529836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:53.530589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:53.537361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.537938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.538449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.539380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.539842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.540274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.702192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.715758 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc1cea28-55e6-4118-997d-15734e1effa7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.190291 Aug 27 21:12:53.717408 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2599/5075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:53 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:53.876945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:53.877636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:53.885615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.886530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.887181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.888239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:53.888928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:53.889441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:53.964000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.972632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.974098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:53.975287 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e181c10-0edf-468a-8aa3-e225a87fed79 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.103428 Aug 27 21:12:53.975887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2477/5076] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:53 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:54.337426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:54.338222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:54.347447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.348281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.349152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.349918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.350383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.350818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.370195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:54.371375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:54.379079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.379991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.380645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.381818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.382484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.383389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.575187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.582430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.590980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e53ed31c-f001-4f20-9d4f-fdee5938f190 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.257427 Aug 27 21:12:54.591868 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2600/5077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:54 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:54.596734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:54.597344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:54.600665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5337c6f-9e4e-4fa0-b203-36caf8bab6fa tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1663 microversion: 2.1 time: 0.233879 Aug 27 21:12:54.601373 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2478/5078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:54 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:54.608353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.608909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.609322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.610215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.610526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.610958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.738750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:54.739388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:54.746359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.746965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.747832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.748634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:54.749127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:54.749515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:54.767295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.776275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.777729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.778999 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc1c59c9-807b-4bb7-9863-d8757fbaaa5a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.185906 Aug 27 21:12:54.780713 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2601/5079] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:54 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:54.898843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:54.907757 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-534c9cf8-f138-4d7f-bd36-ad8d560b8b02 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.173023 Aug 27 21:12:54.908308 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2479/5080] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:54 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:54.998843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:54.999513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:55.005794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.006287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.006768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.007519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.007962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.008388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.077513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:55.081158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:12:55.086406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:55.087941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:55.089501 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64c3cdb3-e9b6-4763-b7ae-c8bb84bcc2d4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.094832 Aug 27 21:12:55.090065 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2602/5081] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:54 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:55.613802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:55.614408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:55.621909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:55.622584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:55.635063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.635467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.635909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.636630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.637047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.637458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.644286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.644960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.645393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.646305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.646640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.647123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.865138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:55.868483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:55.873740 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a29f244-fbee-4806-bbc3-7af691239426 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.264186 Aug 27 21:12:55.874583 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2480/5082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:55 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:55.879306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:55.880039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:55.884018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0bdfeb7f-da09-4fb5-9085-74cfe71546b8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1667 microversion: 2.1 time: 0.266260 Aug 27 21:12:55.887858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.888692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.889271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.890054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.890723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.891212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.895806 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2603/5083] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:55 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1667 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:55.928851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:55.929464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:55.935690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.936438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.936878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:55.937600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:55.938023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:55.938448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:56.093986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.102604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.104091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.105283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7af5ee5f-d71b-4ffc-9107-987e8d34919f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.229559 Aug 27 21:12:56.105860 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2481/5084] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:55 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:56.116116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:56.116820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:56.125015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:56.125512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:56.125959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:56.126671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:56.127120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:56.127597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:56.129361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.137462 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f67e5126-2bd9-44e1-a606-decfd1228a71 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.212435 Aug 27 21:12:56.138270 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2604/5085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:55 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:56.197456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.206280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.207752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:56.208929 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce239f1e-9ed4-4a71-afde-8d3b18ae632f tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.096621 Aug 27 21:12:56.209495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2482/5086] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:56 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:56.895741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:56.896335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:56.903519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:56.904066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:56.904838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:56.905404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:56.905884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:56.906312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.048131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.056373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc6123e7-5acc-4bc3-a376-a214d8582a19 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.164636 Aug 27 21:12:57.056962 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2605/5087] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:56 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:57.128707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:57.129274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:57.136829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.137385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.137828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.139228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.139638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.140078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.160630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:57.161249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:57.167863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.168352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.168834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.169991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.170792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.171224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.379028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.383231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.392416 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-562b3694-55c6-422f-b6f3-b02dc3a151bb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.235921 Aug 27 21:12:57.393172 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2606/5088] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:57 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:12:57.400142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.400142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.400142 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aeb89943-6c0d-49b0-bdb5-89cc83bfb42d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.272957 Aug 27 21:12:57.400142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2483/5089] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:57 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:57.406409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:57.407363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:57.414698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.415193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.415698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.416399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:57.416855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:57.417279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:57.490408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.499026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.500557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:57.501762 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5543007b-7ada-4824-a7ab-57c696d07477 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.107486 Aug 27 21:12:57.502343 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2607/5090] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:57 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:58.078484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:58.079109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:58.085327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.085829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.086272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.086976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.087462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.087902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.232403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.241862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0504df38-c453-45b4-b228-e9b5da1a5603 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.167527 Aug 27 21:12:58.242441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2484/5091] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:58 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:58.417539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:58.417539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:58.420965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:58.421669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:58.424474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.425101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.425538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.426249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.426702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.427124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.429070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.429536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.430199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.430923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.431376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.431843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.620755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.629761 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8d6deff2-1db5-45be-9d0b-6ef6bfbf7c5f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.218841 Aug 27 21:12:58.631077 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2608/5092] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:58 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:58.636247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:58.636939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:58.643693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.644301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.644988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.645990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:58.646829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:58.647532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:58.655739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.665677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.668507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.671731 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8be6ce39-9414-4c76-a291-a202a062d255 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.254046 Aug 27 21:12:58.679763 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2485/5093] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:58 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:58.731584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.743283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.744896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:58.746521 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6bb671e-9959-48fa-8fd9-2b880c9affa8 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.113881 Aug 27 21:12:58.763092 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2609/5094] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:58 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:59.264288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:59.267855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:59.272126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.272648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.273081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.273826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.274346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.274867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.421115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:59.429331 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cca675cf-49f5-4e6c-9004-2d905bbfedbc tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1678 microversion: 2.1 time: 0.169128 Aug 27 21:12:59.429908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2486/5095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:59 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:59.653804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:59.654507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:59.662109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.662587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.663019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.663758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.664204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.664623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.695504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:59.696364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:59.703464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.704213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.704657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.705369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.705834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.706263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.911217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:59.922238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b90ad7f5-06c1-40ce-9d9b-fd89e93c65dc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.272278 Aug 27 21:12:59.922921 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2610/5096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:12:59 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:12:59.935645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:12:59.939223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:12:59.939448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:59.949773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:59.953782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.954679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:12:59.956045 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed5d2ea0-b99f-47a8-a08c-a7e93f919361 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.264443 Aug 27 21:12:59.956834 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2487/5097] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:59 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:12:59.956987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.957495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:12:59.959029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:12:59.959520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:12:59.960043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.047737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:00.057329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:00.059053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:00.060952 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-033584f4-7729-4600-a7aa-129e513e4500 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.129870 Aug 27 21:13:00.073705 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2611/5098] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:12:59 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:00.452446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:00.453548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:00.462486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.462994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.463840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.464567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.465032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.465467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.762943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "name": "network-vif-plugged", "status": "completed", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:00.778571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.779401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.779846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.792602 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] Creating event network-vif-plugged:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:13:00.797959 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-13ab868b-e881-4bd2-b077-535cbe667c57 req-cb2261eb-21a5-4496-80e8-c0d69395f4ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041668 Aug 27 21:13:00.798767 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2612/5099] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:00.874501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:00.882622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06696fb5-f70e-49f6-a575-d2f2f53e5e00 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1655 microversion: 2.1 time: 0.434801 Aug 27 21:13:00.883246 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2488/5100] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:00 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1655 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:00.904556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:00.910934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.911459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.911895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.937413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Going to try to start instance {{(pid=140434) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:13:00.945692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:00.946459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:00.953251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.953984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.954773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.955561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:00.956031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:00.956594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:00.989162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92c7bb8e-d4c5-4b3e-b52a-a4eecb36ebb9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.088706 Aug 27 21:13:00.994362 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2613/5101] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:13:00 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:13:00.997300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:00.998920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:01.006877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.007521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.008127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.009086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.009547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.010175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.215052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.229219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c97702ed-d74c-4172-b674-a06c778b9de1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.288713 Aug 27 21:13:01.230432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2489/5102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:00 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:01.238627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:01.239537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:01.248649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.249668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.250449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.251534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.252367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.252994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.340134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.354039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.357588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.360821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a5b21de-e867-403e-bfa9-68bee87d06c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.367928 Aug 27 21:13:01.377136 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2614/5103] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:00 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:01.387085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:01.387824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:01.395414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.396068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.396615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.397760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:01.398327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:01.399012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:01.521978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.533344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.539137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.546535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:01.547838 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f2a7f438-c026-4808-8caf-a1858d797f3e tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.168648 Aug 27 21:13:01.548947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2615/5104] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:01 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:01.569790 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1de704aa-a96c-43f3-9394-b0337c667e69 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1664 microversion: 2.1 time: 0.337909 Aug 27 21:13:01.571910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2490/5105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:01 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1664 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:02.253029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:02.253835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:02.261988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.262510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.263222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.265125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.265613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.266053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.390325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:02.391051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:02.398071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.398611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.399832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.400692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.401161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.401596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.549011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.558771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-418b76ec-3671-4e71-b6bc-713a9d0f030d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.309879 Aug 27 21:13:02.578512 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2616/5106] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:02 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:02.584274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:02.585077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:02.592521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.593306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.593838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.594563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.595023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.595489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.682727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.684214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.696480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.696690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.697965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.698766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:02.699186 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61c10762-8010-434c-80e7-2c5b3b3c0e75 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1743 microversion: 2.20 time: 0.313293 Aug 27 21:13:02.700915 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-057de1a8-e762-49cf-b44f-4901913b7148 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.120679 Aug 27 21:13:02.701706 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2617/5107] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:02 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:02.712590 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2491/5108] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:02 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1743 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:02.718504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:02.719456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:02.726935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.728076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.729419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.730299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:02.732995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:02.734484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:02.986121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:03.001454 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d39d039-0d67-461f-93cc-b74db4dcead6 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.298120 Aug 27 21:13:03.001975 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2618/5109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:02 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:03.027299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.030428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.038779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.039458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.040028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.041219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.041942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.042470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.238179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:03.250034 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-617cd4d2-758c-404a-8d68-375c731c533e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.226930 Aug 27 21:13:03.250891 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2492/5110] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:03.288381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.289217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.298748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.300223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.301756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.303001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.303564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.304253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.313743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:03.536018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:03.545813 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1343d8f0-b004-472d-9e40-b8a0da35d45a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.269712 Aug 27 21:13:03.547290 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2619/5111] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:03.570609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.571415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.586320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.587194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.592617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.593134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.598005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.599030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.600169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.601368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.602183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.602321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.602755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.603254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.603839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.604515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.648321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:03.910126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:03.918323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:03.921023 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3bc39020-53a5-4825-999b-cd4ccb5e469e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.338484 Aug 27 21:13:03.925089 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2620/5112] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:03.931850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.933482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.942810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3036a093-388c-4529-a2cb-24b13c221342 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.376218 Aug 27 21:13:03.955533 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2493/5113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:03.955533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:03.955533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:03.957436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.958614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.959061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.959812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.960444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.961020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.965260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.965871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.967272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:03.968126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:03.968682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:03.969208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.115855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.130354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.132376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.134008 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9ae80b5-3433-4f40-911c-fafb22fece3d tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.189289 Aug 27 21:13:04.134836 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2494/5114] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:04.156804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:04.157704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:04.170426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.171225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.171982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.173054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.173685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.174498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.224595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.244296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.248434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.251430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-60712ea3-a0ce-44ad-b006-0bda36fa1231 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.325150 Aug 27 21:13:04.254257 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2621/5115] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:03 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:04.445698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.468189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf326b74-32d5-41cc-9ac3-418ee44e6b2e tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.331817 Aug 27 21:13:04.478400 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2495/5116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:04 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:04.507593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:04.514161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:04.527760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.528664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.529289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.530333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.530957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.531575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.571679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lazy-loading 'flavor' on Instance uuid 550cd635-d377-4101-b61d-6e5ca147b826 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:04.701305 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-def569bb-567e-45a2-a773-aad551f93174 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.212874 Aug 27 21:13:04.702470 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2622/5117] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:13:04 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:13:04.714066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:04.715056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:04.724694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.725702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.726614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.727797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.728442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.729108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.943191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:04.944422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:04.954476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.955131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.955710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.956560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:04.957122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:04.957998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:04.970978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:04.981944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90b52c59-d40b-44d7-9942-fc5661b59f61 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1676 microversion: 2.1 time: 0.274266 Aug 27 21:13:04.982956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2496/5118] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:04 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:05.157857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:05.158416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:05.160353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:05.173536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:05.174354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:05.176880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:05.178273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:05.180184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:05.186402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:05.245520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.255502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b724e834-d6ef-462c-be39-4778ed14cd26 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.316697 Aug 27 21:13:05.259678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2623/5119] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:04 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:05.282069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:05.282877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:05.299197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:05.299853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:05.300308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:05.301086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:05.302165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:05.302165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:05.335935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.349130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.350604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.351866 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1bfcb45c-5d81-43f0-85be-e6a986ffceff tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.198291 Aug 27 21:13:05.355047 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2497/5120] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:05 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:05.604618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.614979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.616494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:05.617681 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e12176f-1d4b-4502-a813-f97528fe1761 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.341177 Aug 27 21:13:05.618256 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2624/5121] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:05 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:06.006271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:06.007732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.020354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.020908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.021302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.022023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.022480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.022915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.260838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:06.271034 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4b8610b-c539-427b-976d-33d824fbcd35 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1659 microversion: 2.1 time: 0.269641 Aug 27 21:13:06.283908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2498/5122] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:05 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1659 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:06.290437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:06.290788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.299788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:06.300828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.306503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.308344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.309043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.310749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.312035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.313015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.327462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.328229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.328856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.329735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.330353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.331038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.492628 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10077627-3907-45f0-8ed4-3381e53b34c1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action" status: 202 len: 0 microversion: 2.1 time: 0.200420 Aug 27 21:13:06.493338 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2499/5123] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:13:06 2022] POST /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:13:06.505976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:06.506789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.517384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.518180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.518882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.520240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.522537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.523216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.629631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:06.640519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:06.649561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:06.652330 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8c7a9e7d-ecd4-4b58-9884-4be97ab28acf tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.152080 Aug 27 21:13:06.663742 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2500/5124] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:06 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:06.676617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:06.678048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.697022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.697528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.697987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.698682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.699132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.699632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.783943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:06.806909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc8df666-c743-4906-be64-a7f9b1774423 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.524542 Aug 27 21:13:06.807657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2625/5125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:06 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:06.823488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:06.824467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:06.839315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.840604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.842267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:06.843517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:06.844238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:06.844855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:07.142573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.154016 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-678ca9b0-f948-4e27-aa79-a532d4fd083d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1665 microversion: 2.1 time: 0.487902 Aug 27 21:13:07.155405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2501/5126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:06 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1665 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:07.319853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.330720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.332474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.333972 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fda38d11-1773-49cc-90b1-2bf898322b2d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.525123 Aug 27 21:13:07.335081 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2626/5127] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:06 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:07.686259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:07.688866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:07.695661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:07.696336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:07.696979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:07.697798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:07.698329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:07.699322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:07.822808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.834464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:07.835166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:07.849946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:07.852411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.853187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:07.853602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:07.854395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:07.854829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:07.856954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:07.860115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:07.863836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4a3eff3-2c2f-41a3-bc4f-4943c27cd868 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.185654 Aug 27 21:13:07.868079 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2502/5128] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:07 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:08.178653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:08.180079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:08.197265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.198030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.198947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.199860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.200509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.201096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.536524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.549479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.551084 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77722950-771f-419d-94d0-60cd0d49e964 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.720554 Aug 27 21:13:08.565176 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca7ddf3f-6b55-4517-98b2-9380087f5e04 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1665 microversion: 2.1 time: 0.391147 Aug 27 21:13:08.566357 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2627/5129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:07 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:08.568183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2503/5130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:08 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1665 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:08.576836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:08.577770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:08.589604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.590196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.590945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.591959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.592539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.592963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.794500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.804177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.805836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.807092 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8f20aed9-b570-48ac-b0bb-01e7bf7f0091 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.239409 Aug 27 21:13:08.808092 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2628/5131] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:08 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:08.889584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:08.890523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:08.898896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.899332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.899799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.903035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:08.903758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:08.904248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:08.986765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:08.998052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:09.000112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:09.001665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f03f8f2-7fd7-496b-814b-b660d36d35a9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.116158 Aug 27 21:13:09.002470 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2504/5132] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:08 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:09.576022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:09.577504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:09.585920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.586653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.587315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.588604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.589216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.589844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.600979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:09.603483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:09.614952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.617076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.617728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.618714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.619378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.620033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.870766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:09.879528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:09.888583 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8fec1e90-b133-4f8a-8230-aa46bf820fe1 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.300686 Aug 27 21:13:09.889188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2505/5133] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:09 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:09.891705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a288f6b8-cd75-4c36-933c-2596fc51dac8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.319405 Aug 27 21:13:09.903548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:09.905325 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2629/5134] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:09 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:09.908827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:09.921363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:09.922052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:09.930115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.930654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.931165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.931728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.931894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.932456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.932644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.932921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.933354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:09.933892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:09.934508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:09.935158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.268950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.285652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.287378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.288925 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e165b3f-b9dd-4b5a-96b5-34fdde01b564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.398788 Aug 27 21:13:10.289491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.308743 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2506/5135] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:09 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:10.324085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a6704a9c-3e7e-4991-b8c7-0b50dbf966e4 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1668 microversion: 2.1 time: 0.406805 Aug 27 21:13:10.332929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:10.334025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:10.340385 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2630/5136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:09 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1668 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:10.342622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.343398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.344062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.345016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.345672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.346296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.361311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:10.361883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:10.375297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.375831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.376273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.380367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.384520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.385045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.429782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:10.436830 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Working on deleting snapshot 45ba830d-2b1a-43bf-a108-f8c7bf6e07ab from shelved instance... Aug 27 21:13:10.492450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.504695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.507022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:10.510128 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-054123d7-75a5-441a-9fc4-7210fdc79059 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.199596 Aug 27 21:13:10.510914 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2507/5137] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:10 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:10.916860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:10.920312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:10.946672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.953612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.954351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:10.955312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:10.956087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:10.956758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.208233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.223289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92607ef9-1049-4781-8181-d282a7f4ee77 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1516 microversion: 2.1 time: 0.310145 Aug 27 21:13:11.225668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2508/5138] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:10 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:11.327856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:11.336906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:11.347248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:11.360062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:11.360691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.361725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:11.362482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:11.363146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.395004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:11.543614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Doing local delete in cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) {{(pid=140434) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 21:13:11.545283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:11.545858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:11.546425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.546899 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 21:13:11.551671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] deallocate_for_instance() {{(pid=140434) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 21:13:11.581391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.591413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.596932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.607574 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c89642d-6f4d-471b-b308-5167a12ce95b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.289460 Aug 27 21:13:11.608292 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2509/5139] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:11 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:11.627824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:11.629168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:11.636583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:11.637318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:11.638157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.639051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:11.639862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:11.640898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:11.803472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.827462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.830376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:11.836768 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-280e3083-67a3-4d6e-9628-d82230dd690a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.220266 Aug 27 21:13:11.837730 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2510/5140] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:11 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:12.246213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:12.248496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:12.266100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.267730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.268356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.269458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.270836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.273429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.287206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Updating instance_info_cache with network_info: [] {{(pid=140434) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 21:13:12.327093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:12.498056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:12.509476 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5fad0ce8-79f7-44a3-ace6-b79c584c7b7e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.266436 Aug 27 21:13:12.510499 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2511/5141] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:12 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:12.516511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766afc8f-1c84-4de6-98eb-523a66fecb55", "name": "network-vif-deleted", "tag": "9c2a927f-20eb-4af3-b1ec-abe5516af6b9"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:12.529632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.530420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.531030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.571795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.compute.server_external_events [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] Unable to find a host for instance 766afc8f-1c84-4de6-98eb-523a66fecb55. Dropping event network-vif-deleted {{(pid=140433) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 21:13:12.572985 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-877cfde5-325c-4ad5-8813-2df1dd881643 req-154fb69f-e789-4f40-a3cd-8d18d2d93d54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061270 Aug 27 21:13:12.581388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2512/5142] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 21:13:12.631038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:12.631876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:12.649398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.652546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.653026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.654846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.655578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.657642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.740001 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b5d29b7d-571a-4e26-8a71-370453476c0d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 204 len: 0 microversion: 2.1 time: 2.385224 Aug 27 21:13:12.741210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2631/5143] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:10 2022] DELETE /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 0 bytes in 2387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:13:12.770597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:12.773582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 766afc8f-1c84-4de6-98eb-523a66fecb55] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:12.789609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.790137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.790592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.791331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.795664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.798100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.839917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 HTTP/1.1 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '766afc8f-1c84-4de6-98eb-523a66fecb55'} Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:12.845372 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 404 to user: Instance 766afc8f-1c84-4de6-98eb-523a66fecb55 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:12.850477 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8158784-e465-476c-965e-b0d9632d62f9 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55" status: 404 len: 111 microversion: 2.1 time: 0.091170 Aug 27 21:13:12.851208 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2632/5144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:12 2022] GET /compute/v2.1/servers/766afc8f-1c84-4de6-98eb-523a66fecb55 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:13:12.870075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:12.870668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:12.888477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.888994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.889449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.893345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:12.893878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:12.895585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:12.968500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:13.046376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.060892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.063620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.066122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81f7a0c2-690a-41e8-ba1b-4677e3f28d5f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.439842 Aug 27 21:13:13.067440 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2513/5145] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:12 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:13.088584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:13.089498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:13.089835 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-869a6087-c924-4777-aa08-e6263a8e8f47 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 204 len: 0 microversion: 2.1 time: 0.224915 Aug 27 21:13:13.092452 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2633/5146] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:12 2022] DELETE /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:13:13.099225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.099656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.100977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.102316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.102872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.103576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.106256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:13.107977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:13.118169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.118763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.119211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.119967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.120427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.120864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.221734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.230934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.232983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.234363 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bdddc661-1738-487c-9a65-a233c0ae9636 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.166029 Aug 27 21:13:13.247366 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2514/5147] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:13 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:13.248286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.259433 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a8b5edab-c5ca-4647-8e00-9e7a5b0bd67a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1465 microversion: 2.1 time: 0.162606 Aug 27 21:13:13.260330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2634/5148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:13 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:13.536847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:13.537489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:13.545755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.546708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.547379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.548290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:13.548866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:13.549465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:13.744919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:13.755355 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-985e7204-9d81-4591-ad1f-9dd4def5cbe1 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.223747 Aug 27 21:13:13.770214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2515/5149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:13 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:14.090592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:14.092111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:14.096974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:14.112056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.112975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.113568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.114443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.115063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.115712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.266682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:14.268262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:14.279638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.281687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.282383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.287367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.318532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.319317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.417919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.434220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.448660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.450374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.452051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.453313 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-957b791a-659c-4abb-b4d8-ac4853f8e204 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.367126 Aug 27 21:13:14.469319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.473539 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-866acd19-bf83-4539-903c-4a8a457e7bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.216541 Aug 27 21:13:14.488569 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2635/5150] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:14 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:14.493488 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2516/5151] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:14 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:14.496046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:14.496858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:14.504791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.505582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.506203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.507626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.508092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.509202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.659192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:14.674538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1e1041f-3aff-4c8f-ade3-0506cfb1c4bf tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1465 microversion: 2.1 time: 0.180101 Aug 27 21:13:14.675540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2636/5152] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:14 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:14.777707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:14.778381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:14.789298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.794839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.795699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:14.796626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:14.797251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:14.797845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.021922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.033064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec64869b-0c55-412c-a8d4-63bca5b17472 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.259135 Aug 27 21:13:15.048562 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2517/5153] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:14 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:15.480671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:15.482807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:15.497050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.498484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.500235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.500932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:15.501570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:15.502355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.503578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.504172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.511705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.512213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.512832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.513840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.515963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.516441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.669510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.682745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.684636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.687585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7eedafd5-129d-44db-9966-b33fa62b15ea tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.190313 Aug 27 21:13:15.689122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2518/5154] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:15 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:15.722422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:15.725313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:15.735611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.737023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.737689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.739543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.740217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.740863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.806840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.818727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.822724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.825406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbe7a083-a80e-490b-bc87-f990a0613d86 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.349494 Aug 27 21:13:15.827161 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2637/5155] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:15 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:15.849198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec28951b-e437-4514-8883-7bea491d7967", "name": "network-vif-deleted", "tag": "73d2d278-43b8-4742-9e2a-2ce12a8912c5"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:15.861066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:15.861324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:15.861947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:15.878901 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] Creating event network-vif-deleted:73d2d278-43b8-4742-9e2a-2ce12a8912c5 for instance ec28951b-e437-4514-8883-7bea491d7967 on nch2-master-1 Aug 27 21:13:15.885760 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4c3c78fb-0ab7-489a-970d-36369e2c793a req-13a18a9f-95e7-49d1-ab72-09a98aae617b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039702 Aug 27 21:13:15.887150 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2638/5156] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:15.971298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:15.985978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc678c50-2a19-45c3-8fc4-f6ad79b1b220 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1465 microversion: 2.1 time: 0.280453 Aug 27 21:13:15.992863 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2519/5157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:15 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1465 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:16.055293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:16.056046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:16.066839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.072875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.073610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.074367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.074824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.075361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.367787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:16.380456 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-471245dd-c266-4f80-a81d-283dfa490cb5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.329804 Aug 27 21:13:16.381656 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2639/5158] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:16 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:16.716002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:16.716640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:16.724015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.724507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.724937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.725998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.726714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.727146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.823571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:16.842382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160b9cf-bbaf-4c51-a428-8eaad209f824", "name": "network-vif-unplugged", "status": "completed", "tag": "6374bc3f-fbcd-437a-9e44-a1327f377c25"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:16.856740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:16.859792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:16.861502 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c49fb925-8d0e-43f8-9a8a-c3b51d27e4a4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1366 microversion: 2.47 time: 0.150219 Aug 27 21:13:16.863085 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2520/5159] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:16 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:16.868266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:16.870136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:16.875021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.876473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.877813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.883319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.884208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.884886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.885852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:16.886553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:16.887733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:16.900421 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] Creating event network-vif-unplugged:6374bc3f-fbcd-437a-9e44-a1327f377c25 for instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 on nch1-master-1 Aug 27 21:13:16.910095 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-bbc6d6f1-2132-4322-981d-f030f31950a2 req-b17b469e-ab3a-45f9-9cd3-a305e71a7c31 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073694 Aug 27 21:13:16.911941 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2640/5160] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:13:17.010409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:17.011534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:17.019396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.020024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.020695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.021557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.022125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.022660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.074396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.075764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.076014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.076733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lazy-loading 'fault' on Instance uuid ec28951b-e437-4514-8883-7bea491d7967 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:17.149817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:17.167997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:17.170731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:17.172535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8dea633b-ceb6-4de4-90bf-11e19f4784b1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.308007 Aug 27 21:13:17.173924 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2521/5161] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:16 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:17.203333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:17.219582 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9242dcd8-d188-414a-a6db-f82e57ac8d0f tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 200 len: 1305 microversion: 2.1 time: 0.215024 Aug 27 21:13:17.221725 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2641/5162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:17 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 1305 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:17.405141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:17.406344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:17.419836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.420696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.421303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.422212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.422953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.423572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.663261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:17.675831 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f75972f-1b4b-47cc-8e36-81373a9fd036 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.276721 Aug 27 21:13:17.679388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2522/5163] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:17 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:17.891663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:17.893203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:17.903129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.904251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.905434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:17.906794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:17.907585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:17.908269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.027021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.038686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.041123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.042665 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fa611f7a-6a7d-443f-95be-6487ab8025ac tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1384 microversion: 2.47 time: 0.157555 Aug 27 21:13:18.045087 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2642/5164] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:17 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1384 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:18.201644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:18.203130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:18.214930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.216179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.216864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.217498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.218054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.218737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.246240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:18.247497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: ec28951b-e437-4514-8883-7bea491d7967] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:18.256138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.257134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.257818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.258758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.259470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.260177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.287786 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 HTTP/1.1 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ec28951b-e437-4514-8883-7bea491d7967'} Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:18.289803 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 404 to user: Instance ec28951b-e437-4514-8883-7bea491d7967 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:18.295216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-30725c47-29a7-4037-9e41-155a442b41e8 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967" status: 404 len: 111 microversion: 2.1 time: 0.055333 Aug 27 21:13:18.295858 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2643/5165] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:18 2022] GET /compute/v2.1/servers/ec28951b-e437-4514-8883-7bea491d7967 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:13:18.304322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:18.304836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:18.312676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.314416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.315053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.316551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.317188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.317948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.354656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:18.374435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:UPDATE=14,nova_cell1:SELECT=83,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:18.397488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.408560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.412941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.415676 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94716929-517c-4340-834c-7b5521dcff3c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1738 microversion: 2.20 time: 0.219729 Aug 27 21:13:18.416460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2523/5166] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:18 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:18.484703 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-28e18d21-5e34-4190-a9f2-e865e7be3262 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 204 len: 0 microversion: 2.1 time: 0.183855 Aug 27 21:13:18.485817 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2644/5167] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:18 2022] DELETE /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:13:18.495850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:18.496871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:18.504113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.505163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.506238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.507299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.508148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.508740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.703276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:18.704355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:18.711699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.712375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.712910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.714096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.714754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.715425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.737028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.764207 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c642bf02-fd17-4a2e-921e-0d33f982e622 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1508 microversion: 2.1 time: 0.273994 Aug 27 21:13:18.764847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2524/5168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:18 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:18.945137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:18.953488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "name": "network-vif-unplugged", "status": "completed", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:18.954984 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24b0b72d-6bdf-40f5-87ec-cd3af2dc2ecb tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.257518 Aug 27 21:13:18.956059 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2645/5169] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:18 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:18.977525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:18.978108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:18.978714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:18.991216 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] Creating event network-vif-unplugged:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:13:18.996600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5a6b0a65-81dd-4033-97bd-31988ff7b4f9 req-a5b6e887-0ac0-4de0-8ac6-ea95ce8f86a7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047056 Aug 27 21:13:18.998078 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2525/5170] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:13:19.070097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:19.071044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:19.077945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.078445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.078886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.079622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.080082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.080510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.148002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.157106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.158720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.160151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a4f778b2-d1fb-4cc5-a3c1-430514277dba tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1372 microversion: 2.47 time: 0.094280 Aug 27 21:13:19.160733 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2646/5171] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:19 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:19.442432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:19.444156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:19.451247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.452129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.452626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.453414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.454080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.454515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.614527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.624430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.625800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.627034 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e15713f8-a1f0-43df-9739-57cf08771f2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1720 microversion: 2.20 time: 0.190093 Aug 27 21:13:19.627604 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2526/5172] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:19 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:19.785728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:19.786341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:19.792803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.793296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.793785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.794539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.795125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.795611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.935760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:19.943912 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a94f5e1-26ed-4d27-abc1-7125baff820c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1508 microversion: 2.1 time: 0.162228 Aug 27 21:13:19.944503 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2647/5173] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:19 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:19.977083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:19.977702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:19.984361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.984852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.985296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.986009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:19.986467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:19.986893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:19.991373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:20.137345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.146919 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75ee8ce3-3966-4595-a235-f7fc4fd3698c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.173798 Aug 27 21:13:20.147749 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2527/5174] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:19 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:20.185455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:20.186148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:20.192680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:20.193241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:20.193740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:20.194794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:20.195471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:20.196075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:20.275452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.295231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.297437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.299767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc3eafdf-825b-4018-9444-03593fa7e457 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1372 microversion: 2.47 time: 0.118512 Aug 27 21:13:20.301231 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2648/5175] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:20 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:20.652482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:20.653163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:20.659810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:20.660354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:20.660866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:20.661702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:20.662166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:20.662599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:20.819471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.831781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.833519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:20.834880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2479d38f-e47b-49ad-98e9-dfbec4aa7ec8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1720 microversion: 2.20 time: 0.187766 Aug 27 21:13:20.836012 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2528/5176] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:20 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:21.023072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160b9cf-bbaf-4c51-a428-8eaad209f824", "name": "network-vif-plugged", "status": "completed", "tag": "6374bc3f-fbcd-437a-9e44-a1327f377c25"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:21.053402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.054260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.054929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.075998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] Creating event network-vif-plugged:6374bc3f-fbcd-437a-9e44-a1327f377c25 for instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 on nch1-master-1 Aug 27 21:13:21.096258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-af7df2ba-5fb2-4624-b7b5-c4742d368a62 req-20f419a7-ffc0-4f6b-87d8-1f6b4883ba6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078716 Aug 27 21:13:21.097221 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2529/5177] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:21.170358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:21.171501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:21.183204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.184222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.185810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.187287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.188019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.188718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.276114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:21.276762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:21.287940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.288388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.289070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.290228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.291152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.291634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.957636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:21.966245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-428ea796-454b-4df2-8be0-d434ff133e33 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.801456 Aug 27 21:13:21.967206 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2530/5178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:21 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:21.972500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:21.973865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:21.980342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.980342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.980736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:21.981757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:21.982280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:21.982711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:22.006473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.014996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94933434-6dd1-4074-b251-8f96236db959 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1508 microversion: 2.1 time: 1.051908 Aug 27 21:13:22.015620 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2649/5179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:20 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1508 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:22.020817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:22.021408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:22.027569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:22.028073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:22.028702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:22.029600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:22.030067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:22.030538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:22.074001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.083110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.084757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.086031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-85fffb63-a4dc-4276-b2b8-fd26e75c9c6a tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1372 microversion: 2.47 time: 0.118087 Aug 27 21:13:22.086662 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2531/5180] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:21 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:22.226964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.235940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.237591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:22.239018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-33c897f3-17d7-45e8-845c-841b9604c4f1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1720 microversion: 2.20 time: 0.222172 Aug 27 21:13:22.239627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2650/5181] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:22 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:22.993946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:22.994729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:23.009477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.010868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.011754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.014613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.015532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.016243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.038376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:23.039648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:23.051375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.052311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.053657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.054662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.056052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.056876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.161728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.170615 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38e6a866-d4d0-4cde-b252-8da5d7e50f4d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1466 microversion: 2.1 time: 0.139172 Aug 27 21:13:23.172246 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2651/5182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:23 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:23.177427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504bc862-6df4-47e1-a903-fb2d6a8c21b0", "name": "network-vif-deleted", "tag": "85f316b0-706f-4175-99aa-bd7df7690ec3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:23.187553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.188039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.188474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.199978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] Creating event network-vif-deleted:85f316b0-706f-4175-99aa-bd7df7690ec3 for instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 on nch2-master-1 Aug 27 21:13:23.205251 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c6f631d0-8f28-4324-b7a5-fa1135c9364b req-8c3d7b0f-01fc-493a-83c8-49b9d921150e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Aug 27 21:13:23.205870 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2652/5183] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:23.210944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:23.211670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:23.218485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.218978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.219444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.220152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.220604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.221031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.310363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.322042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.323542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.324712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4966e7d9-e4b8-45aa-9c6f-37189dab0502 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1372 microversion: 2.47 time: 0.117704 Aug 27 21:13:23.325384 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2653/5184] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:23 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:23.329775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:23.330383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:23.336524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.337081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.337233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.337643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.338725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:23.339194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:23.339656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:23.348526 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a29d8b6-20de-4b5c-aff4-897efdfe17cf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1522 microversion: 2.1 time: 0.360075 Aug 27 21:13:23.362246 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2532/5185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:22 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:23.615151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.626548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.633233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:23.636073 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d77da8b2-b63e-4937-8438-3f510bade603 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1720 microversion: 2.20 time: 0.309728 Aug 27 21:13:23.640335 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2654/5186] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:23 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1720 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:24.193206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.193786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:24.200883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.201378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.201819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.202529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.202980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.203422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.239399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.239897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.240344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.240800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lazy-loading 'fault' on Instance uuid 504bc862-6df4-47e1-a903-fb2d6a8c21b0 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:24.303985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.312444 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4b05ddd-a8d9-4a02-94ca-451e38fdde7a tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1305 microversion: 2.1 time: 0.123181 Aug 27 21:13:24.313170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2533/5187] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:24.349899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.350483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:24.358441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.359077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.359565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.360276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.360733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.361162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.370507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.371270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:24.379613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.380243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.381028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.381862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.382390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.383063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.440346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.449059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.450505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.451960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb617e3b-264c-4524-9cc2-e0a6b3a75c18 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1357 microversion: 2.47 time: 0.105883 Aug 27 21:13:24.452283 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2655/5188] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:24.476943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.482012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.483616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Searching by: {'deleted': False, 'project_id': '1144d8b2695745c8a81018bee53d131f'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:13:24.496671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.497206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.497737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.498365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.498806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.499252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.623628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:13:24.631849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.640728 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d421fc2a-96a5-4dfc-860c-5742ba051b4d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1507 microversion: 2.1 time: 0.274583 Aug 27 21:13:24.641322 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2534/5189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:24.663599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.664493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:24.671790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.672298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.672744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.673463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.673925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.674361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.708405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.718068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.718564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.719004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.730362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.731893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:24.811283 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e94e57e-3fe6-4f2c-b23b-9e36f186ef89 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.339514 Aug 27 21:13:24.811951 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2656/5190] 10.222.0.40 () {60 vars in 1187 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:24.827324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:24.828720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:24.843083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.843726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.844169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:24.844882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:24.845377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:24.845732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.021115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.029946 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79fc0b11-7516-42e3-9ae4-86dd63a0b960 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 200 len: 1507 microversion: 2.1 time: 0.370771 Aug 27 21:13:25.030502 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2535/5191] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:25.035238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:25.035767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:25.041728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.042219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.042651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.043394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.044005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.044699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.071551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:25.091551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.101495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.103118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.104506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5a2b35de-9fd0-4234-a837-e6f1add04d29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1720 microversion: 2.20 time: 0.284064 Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2657/5192] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:24 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.121553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.148056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:25.174604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e3ef2d0-fd96-417d-b999-4cd5e519f926 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 204 len: 0 microversion: 2.47 time: 0.141654 Aug 27 21:13:25.175227 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2536/5193] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:13:25 2022] DELETE /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:13:25.187771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:25.189512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:25.196645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.197317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.198314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.199065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.199720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.200198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.202101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:25.244983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd1944fc-0b31-43c9-9d68-64d54b2de1a9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 204 len: 0 microversion: 2.1 time: 0.136484 Aug 27 21:13:25.245587 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2658/5194] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:25 2022] DELETE /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:13:25.305758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.317439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.319633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.321828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-de434b22-58db-42aa-bbe7-97dbfdbd2139 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1363 microversion: 2.47 time: 0.141148 Aug 27 21:13:25.323726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2537/5195] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:25 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:25.340175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:25.341306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:25.347765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.348268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.348745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.349451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.349909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.350355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.377997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-724170990", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "1e8609f2-9aa0-4ab0-9237-6d4b63aae40f"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:25.385175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.385774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.386286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.386806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lazy-loading 'fault' on Instance uuid 504bc862-6df4-47e1-a903-fb2d6a8c21b0 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:25.434856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] validate_networks() for [('1e8609f2-9aa0-4ab0-9237-6d4b63aae40f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:13:25.442080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:25.450275 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa5bf3f1-55fa-463b-841f-402ff76d4ab7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 200 len: 1305 microversion: 2.1 time: 0.120116 Aug 27 21:13:25.450836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2659/5196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:25 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:25.947832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:13:25.950768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:13:25.951388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:13:25.951887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:13:25.952386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:13:25.965779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.966277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.966948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.967901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:25.968367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:25.968785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:25.989408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:13:25.996198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for user 879bc0b8cc764e5ca6f7c75a34a86d5f and project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:13:26.011038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:26.013381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:13:26.016059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:13:26.080348 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fffd7b0a-295b-466c-b723-2eaec286db5c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706234 Aug 27 21:13:26.081337 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2538/5197] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:13:26.095207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aee1e93a-d893-48e3-86fb-dd466c616d65 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.097587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aee1e93a-d893-48e3-86fb-dd466c616d65 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.130017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.130997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.147748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.150458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.150780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.154071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.156516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.157042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.235609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aee1e93a-d893-48e3-86fb-dd466c616d65 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.246185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aee1e93a-d893-48e3-86fb-dd466c616d65 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1217 microversion: 2.1 time: 0.156633 Aug 27 21:13:26.261419 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2660/5198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:26 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:26.347325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.347917 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.354246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.354814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.355163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.356022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.357105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.357608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.483751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.495790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.499583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.508484 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a90185e-ae75-4f3d-b566-d7cdbbd5686c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1363 microversion: 2.47 time: 0.165423 Aug 27 21:13:26.508842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.510706 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2661/5199] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:26 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:26.529532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.529532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.529532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7b41b07-b057-44bf-9dea-da4579b10035 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1723 microversion: 2.20 time: 0.397818 Aug 27 21:13:26.529532 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2539/5200] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:26 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:26.531107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.531997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 504bc862-6df4-47e1-a903-fb2d6a8c21b0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.541220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.541793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.542299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.543084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.544774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.545047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.548100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ebdf631-522c-4ca4-8edd-98bd7239f81e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:26.550796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.559406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.561566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.562493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.563310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.563810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.564242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.567177 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 HTTP/1.1 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '504bc862-6df4-47e1-a903-fb2d6a8c21b0'} Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:26.570725 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 404 to user: Instance 504bc862-6df4-47e1-a903-fb2d6a8c21b0 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:26.575584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ffdda0b-27c7-45b8-99f3-594a1725cc9c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0" status: 404 len: 111 microversion: 2.1 time: 0.049098 Aug 27 21:13:26.579708 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2540/5201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:26 2022] GET /compute/v2.1/servers/504bc862-6df4-47e1-a903-fb2d6a8c21b0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:13:26.586219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.587465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.596675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.597270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.598334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.599199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.599965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.600613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.637039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:26.747919 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47989134-7f53-44f2-8a37-8c5c11f24b26 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 204 len: 0 microversion: 2.1 time: 0.166794 Aug 27 21:13:26.751812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2541/5202] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:26 2022] DELETE /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:13:26.757144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:26.757858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:26.765629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.766143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.766732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.767989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:26.768462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:26.769044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:26.773670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:26.925319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:26.936533 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e39b85bc-fe68-43fd-ac2a-1e7b22c24cb5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1494 microversion: 2.1 time: 0.182869 Aug 27 21:13:26.938086 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2542/5203] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:26 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1494 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:26.954838 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8b234e9-2177-41f6-8c11-a1c883ac2198 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.412213 Aug 27 21:13:26.955716 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2662/5204] 10.222.0.40 () {62 vars in 1364 bytes} [Sat Aug 27 21:13:26 2022] POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments => generated 188 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:13:27.085779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:27.086371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:27.093306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.093799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.094237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.094933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.095417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.096497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.144890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140433) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 21:13:27.242903 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94714fba-ffb2-488d-bc38-022bc5be62dc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/action" status: 202 len: 0 microversion: 2.20 time: 0.156481 Aug 27 21:13:27.247194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2543/5205] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 21:13:27 2022] POST /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:13:27.254118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:27.254930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:27.269172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.269654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.270089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.273840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:27.274811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:27.275490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.276045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.276495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.295494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.296145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.297729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.299683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.318462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.319001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.590315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.601005 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f060334-50c7-4d3b-a492-50d3be75b741 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1221 microversion: 2.1 time: 0.331423 Aug 27 21:13:27.610715 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2544/5206] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:27 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1221 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:27.616047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:27.616862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:27.626437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.626753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.627144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.627878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.628497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.628743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.741225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.756879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.758461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.770713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b64a40e-b067-4478-822e-90bbfa70d634 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1363 microversion: 2.47 time: 0.150734 Aug 27 21:13:27.772037 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2545/5207] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:27 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:27.866610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.876663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.878098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:27.879291 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08691424-27eb-4110-8796-2863b5bb201b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1809 microversion: 2.20 time: 0.630576 Aug 27 21:13:27.891934 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2663/5208] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:27 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1809 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:27.960185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:27.961154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:27.970787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.971584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.972244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:27.973138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:27.973775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:27.974747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.234704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:28.251751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4433e51-514a-4c49-ae8c-8a31e0374a56 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1494 microversion: 2.1 time: 0.290281 Aug 27 21:13:28.256009 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2546/5209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:27 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:28.607766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7160b9cf-bbaf-4c51-a428-8eaad209f824", "name": "network-vif-deleted", "tag": "6374bc3f-fbcd-437a-9e44-a1327f377c25"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:28.627838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:28.633338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:28.638230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.638744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.640163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.646972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.648018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.648686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.650691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.652323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.654313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.672470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] Creating event network-vif-deleted:6374bc3f-fbcd-437a-9e44-a1327f377c25 for instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 on nch1-master-1 Aug 27 21:13:28.680741 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-670c8711-03ea-44d7-ab2a-108e61405651 req-46345a45-3e16-44e3-aec2-f602dda7606f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078401 Aug 27 21:13:28.684948 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2664/5210] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:28.801431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:28.802249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:28.830835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.831398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.831861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.832622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.833081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.841835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.855676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:28.879015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11ae05d1-f55a-4add-8de3-1dc97993fbe0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1287 microversion: 2.1 time: 0.255066 Aug 27 21:13:28.883197 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2547/5211] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:28 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1287 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:28.911714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:28.915712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:28.941490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.942000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.942446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:28.943172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:28.943665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:28.944099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.001071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.003994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.005608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.008556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lazy-loading 'fault' on Instance uuid b5c5879f-0798-4aef-86e1-42fe1deb33a4 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:29.202247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.221902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.226694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.230805 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a36b7cd-dbb3-4182-b1a7-1f115472ac60 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 200 len: 1368 microversion: 2.47 time: 0.435868 Aug 27 21:13:29.255728 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2665/5212] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:28 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 1368 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:29.279394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:29.280044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:29.297707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.298333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.299578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.303690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.304196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.306355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.540784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.546996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.561903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.563863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:29.565494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e92e26f-946a-4835-8b79-18cc72549d54 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1749 microversion: 2.20 time: 0.664473 Aug 27 21:13:29.566485 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2548/5213] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:28 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1749 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:29.581909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5c8524c-4c48-473a-93c6-487aa1bbbc38 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 200 len: 1452 microversion: 2.1 time: 0.294652 Aug 27 21:13:29.589198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2666/5214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:29 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 1452 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:29.603822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96fe773-6577-4b0d-880b-aaf09a1b551f", "name": "network-vif-deleted", "tag": "032f81cf-50f5-4613-ac38-b95fdb811a08"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:29.620587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.621341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.621998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.649809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] Creating event network-vif-deleted:032f81cf-50f5-4613-ac38-b95fdb811a08 for instance d96fe773-6577-4b0d-880b-aaf09a1b551f on nch1-master-1 Aug 27 21:13:29.673051 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-70594fa9-227b-4d28-ab4a-1bcd02a1b9e0 req-676e2acb-8282-4811-aad6-ffe2a4495fd6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101792 Aug 27 21:13:29.674706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2549/5215] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:29.905570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:29.906874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:29.929478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.935848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.936708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:29.937678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:29.938311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:29.938893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.119154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:30.129827 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-749f3d65-e18d-4e4b-a7d7-30cea1f58326 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1275 microversion: 2.1 time: 0.230610 Aug 27 21:13:30.132559 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2667/5216] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:29 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:30.264868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.265826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: b5c5879f-0798-4aef-86e1-42fe1deb33a4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.287861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.288885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.289553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.290561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.291246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.292433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.313412 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] HTTP exception thrown: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Request method failure captured: Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 HTTP/1.1 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi_BMj49ZbAlcg8tTKdaC4pejYcazbNm1Mde3zqfBrw6sS_QmvYrlk7foFY7z1csByryf9_P-ojPUJE4HNFpFc82z5Ivy-MgdsU2CaU0C7_SRtqmYvkC1Cs9WwZRXlsbaNbD9MAQk5BkvTDwpMX0DBk2wXyzDQxVUMJ2BLTXG-ynnY Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 1144d8b2695745c8a81018bee53d131f Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1144d8b2695745c8a81018bee53d131f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1144d8b2695745c8a81018bee53d131f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1144d8b2695745c8a81018bee53d131f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1144d8b2695745c8a81018bee53d131f"}]}] Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 1144d8b2695745c8a81018bee53d131f Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerShowV247Test-1693160541-project Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c33f114379a04818b131e97cd634e82e Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerShowV247Test-1693160541-project Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b5c5879f-0798-4aef-86e1-42fe1deb33a4'} Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:30.315422 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. Aug 27 21:13:30.320707 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.322492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Returning 404 to user: Instance b5c5879f-0798-4aef-86e1-42fe1deb33a4 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:30.323624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1562c1af-80b3-43ad-986e-44eb866297c4 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4" status: 404 len: 111 microversion: 2.47 time: 0.064672 Aug 27 21:13:30.324847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2550/5217] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:30 2022] GET /compute/v2.1/servers/b5c5879f-0798-4aef-86e1-42fe1deb33a4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:13:30.332876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.333380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.340753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.341245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.341681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.342670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.343280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.343948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.378233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:30.510619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fda0a87b-375c-4504-acb2-a5df2044ee0c tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "DELETE /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 204 len: 0 microversion: 2.47 time: 0.179597 Aug 27 21:13:30.516831 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2668/5218] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:13:30 2022] DELETE /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:13:30.527550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.528930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.544275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.545184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.545945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.546923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.547407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.549454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.595059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.596307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.614935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.617077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.623914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.624770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.626043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.626499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.760598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:30.776678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:30.779206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:30.780719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a96a8a56-e2f1-4dcb-b7ca-8d71c4177bb1 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 200 len: 1363 microversion: 2.47 time: 0.259255 Aug 27 21:13:30.802585 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2551/5219] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:30 2022] GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:30.811614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.813253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: d96fe773-6577-4b0d-880b-aaf09a1b551f] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.823677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.824188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.825089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.825872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.827381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.828850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.867556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f HTTP/1.1 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'd96fe773-6577-4b0d-880b-aaf09a1b551f'} Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:30.869313 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 404 to user: Instance d96fe773-6577-4b0d-880b-aaf09a1b551f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:30.873890 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0771773d-4e00-4697-9ab2-4e38b98cc8e5 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f" status: 404 len: 111 microversion: 2.1 time: 0.066479 Aug 27 21:13:30.875625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2552/5220] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:30 2022] GET /compute/v2.1/servers/d96fe773-6577-4b0d-880b-aaf09a1b551f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:13:30.885030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:30.885548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:30.924637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.925629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.926708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.929627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:30.930595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:30.931247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:30.966298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:13:31.092730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.117981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.123528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.125879 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2044c4fb-b8b8-4fb1-a2e7-a49c346d5128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1751 microversion: 2.20 time: 0.535301 Aug 27 21:13:31.143083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2669/5221] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:30 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1751 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:31.158275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:31.160162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:31.170422 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56ae57fa-1584-4443-bed7-cb24a874f504 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 204 len: 0 microversion: 2.1 time: 0.293860 Aug 27 21:13:31.171384 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2553/5222] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:13:30 2022] DELETE /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:13:31.174688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.181538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:31.183119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:31.183473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.184217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.186099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.186988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.190106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.198105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.201479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.202634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.204824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.206684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.209695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.592060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.603692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0673dd5c-7ee6-4e37-be1e-61fae0dd692b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.452633 Aug 27 21:13:31.604623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2670/5223] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:31 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:31.608696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.619972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e7fbf06-1700-47cf-98b6-1cadcf834fdd tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1674 microversion: 2.1 time: 0.443617 Aug 27 21:13:31.621062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2554/5224] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:31 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1674 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:31.809269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:31.810365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:31.813044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:31.822009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.822498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.822941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.823830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:31.824528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:31.825257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:31.902617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.907965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:31.913966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.915494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:31.916914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b8d18f7-e311-4602-8749-965fa5b726ab tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 200 len: 1363 microversion: 2.47 time: 0.112508 Aug 27 21:13:31.924368 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2671/5225] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:31 2022] GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 1363 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:32.154918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:32.155676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:32.163187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.163714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.164404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.165130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.165586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.165973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.508971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:32.520170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:32.521793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:32.523258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-551d137f-3667-4994-9f5a-766d8aeca7de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1751 microversion: 2.20 time: 0.373206 Aug 27 21:13:32.535720 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2555/5226] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:32 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1751 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:32.625887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:32.627259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:32.641663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:32.642456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:32.650363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.651824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.653070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.653942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.654895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.655648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.657741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.658458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.659121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.660115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:32.664195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:32.664816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:32.982024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.001511 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68bc2d61-cbf7-4c3d-88bc-2d4839589e76 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1674 microversion: 2.1 time: 0.355048 Aug 27 21:13:33.003749 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2556/5227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:32 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1674 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:33.011985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:33.021691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:33.061525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.062472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.063843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:33.067355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.072426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.073654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:33.155245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.163902 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-410edfa3-0db7-4066-b925-db6647f5d74e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.542321 Aug 27 21:13:33.181058 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2672/5228] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:32 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:33.189711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.190223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.190638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:33.191099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lazy-loading 'fault' on Instance uuid 43c656e8-399d-4f69-89ee-59d5931cc9e1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:13:33.251688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.255291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:33.261755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.263623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33f114379a04818b131e97cd634e82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1144d8b2695745c8a81018bee53d131f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.264852 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0fa1ecd-556f-4ce6-a5d6-744cc55840ce tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 200 len: 1368 microversion: 2.47 time: 0.259351 Aug 27 21:13:33.265600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2557/5229] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:33 2022] GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:33.546743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:33.547367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:33.555669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.556176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.556622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:33.557346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.557807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.558216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:33.693452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.703968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.705411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:33.706614 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de59afa4-109a-463e-9bdf-d284e9939c31 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.164154 Aug 27 21:13:33.707164 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2673/5230] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:33 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:33.981089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf6f0c6-298b-4a42-b82d-2550ac31cad0", "tag": "c35613fc-96d7-4a01-83b4-a05561fedd72"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:33.992762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:33.993241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:33.993670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.006233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] Creating event network-changed:c35613fc-96d7-4a01-83b4-a05561fedd72 for instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 on nch1-master-1 Aug 27 21:13:34.011813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0b691d1f-965b-4489-9cd3-804e43858f6b req-1561e512-dbb4-4c97-aa11-0be7aa32f44d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035331 Aug 27 21:13:34.013030 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2558/5231] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:34.121363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:34.122123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:34.128502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.128993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.129423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.130112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.130580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.131007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.186331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:34.187747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:34.194547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.195204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.195473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.196567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.197066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.197750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.348040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:34.357524 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6482d002-7d40-41b8-8cad-b73d690f2ee7 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1674 microversion: 2.1 time: 0.239944 Aug 27 21:13:34.358136 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2674/5232] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:34 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:34.363216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:34.363909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] [instance: 43c656e8-399d-4f69-89ee-59d5931cc9e1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:34.372290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.372785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.373219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.373932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.374383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.374805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.387785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:34.391116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] HTTP exception thrown: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Request method failure captured: Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 HTTP/1.1 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoi_BMj49ZbAlcg8tTKdaC4pejYcazbNm1Mde3zqfBrw6sS_QmvYrlk7foFY7z1csByryf9_P-ojPUJE4HNFpFc82z5Ivy-MgdsU2CaU0C7_SRtqmYvkC1Cs9WwZRXlsbaNbD9MAQk5BkvTDwpMX0DBk2wXyzDQxVUMJ2BLTXG-ynnY Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 1144d8b2695745c8a81018bee53d131f Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1144d8b2695745c8a81018bee53d131f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1144d8b2695745c8a81018bee53d131f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1144d8b2695745c8a81018bee53d131f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1144d8b2695745c8a81018bee53d131f"}]}] Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 1144d8b2695745c8a81018bee53d131f Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerShowV247Test-1693160541 Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerShowV247Test-1693160541-project Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c33f114379a04818b131e97cd634e82e Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerShowV247Test-1693160541-project Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '43c656e8-399d-4f69-89ee-59d5931cc9e1'} Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:34.392893 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] Returning 404 to user: Instance 43c656e8-399d-4f69-89ee-59d5931cc9e1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d59459d-196d-480a-b2d0-47b2859ce7b9 tempest-ServerShowV247Test-1693160541 tempest-ServerShowV247Test-1693160541-project] 10.222.0.40 "GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1" status: 404 len: 111 microversion: 2.47 time: 0.034929 Aug 27 21:13:34.397237 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2675/5233] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:34 2022] GET /compute/v2.1/servers/43c656e8-399d-4f69-89ee-59d5931cc9e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:13:34.403181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dd5a7d2-9d02-41b8-8b16-8df2710ac728 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.221723 Aug 27 21:13:34.403825 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2559/5234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:34 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:34.730512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:34.731218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:34.734130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:34.741292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.742007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.742642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.743577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:34.744338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:34.744945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:34.984772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:34.996687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:34.999088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:35.000744 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfdd61c1-7e50-435e-855e-b56bf88d2c81 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.274209 Aug 27 21:13:35.016022 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2676/5235] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:34 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:35.381217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:35.382330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:35.399839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:35.404005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:35.404892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:35.405873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:35.407909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:35.408636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:35.425151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:35.425768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:35.436838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:35.437344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:35.437786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:35.438495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:35.441056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:35.444211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:35.605546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:35.615963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db8871bd-1c2b-444e-a020-b824fd69aa9d tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1606 microversion: 2.1 time: 0.239581 Aug 27 21:13:35.626995 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2560/5236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:35 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1606 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:35.786858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:35.799391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec24050f-1da3-49af-ad39-2f7576ed5175 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.378417 Aug 27 21:13:35.803096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2677/5237] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:35 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:36.028097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:36.028846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:36.030934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:36.037964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:36.041202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550cd635-d377-4101-b61d-6e5ca147b826", "name": "network-vif-deleted", "tag": "26a08e7c-c2e7-4d59-8998-f31cc1cbba87"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:36.049586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.052495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.053262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.054071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.054961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.056169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.062929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.063472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.063912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.081774 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] Creating event network-vif-deleted:26a08e7c-c2e7-4d59-8998-f31cc1cbba87 for instance 550cd635-d377-4101-b61d-6e5ca147b826 on nch1-master-1 Aug 27 21:13:36.107375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-76beed3f-c4bd-4205-89f5-684120ca48ba req-498914b5-f331-4c98-9401-c4b872facccb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068413 Aug 27 21:13:36.114021 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2678/5238] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:13:36.363513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:36.378121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:36.379965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:36.381570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70380905-abe9-48d6-8c2c-213f36d03955 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.357919 Aug 27 21:13:36.383081 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2561/5239] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:36 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:36.640697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:36.641787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:36.650261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:36.655280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.656351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.657028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.658221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.658979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.660088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.768019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:36.779058 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-edc08f0d-796d-4168-9b81-ae403f908227 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1606 microversion: 2.1 time: 0.142999 Aug 27 21:13:36.791513 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2679/5240] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:36 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1606 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:36.829604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:36.831329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:36.842571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.843515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.844067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:36.844964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:36.845521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:36.846429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:37.069336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:37.079060 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-08e49d5f-02af-40f9-a4e2-c08420b43ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.258385 Aug 27 21:13:37.079932 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2562/5241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:36 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:37.411683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:37.412423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:37.430342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:37.430997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:37.431563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:37.432338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:37.432806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:37.434322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:37.705279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:37.732969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:37.748573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:37.751429 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0161ca7f-87f8-4401-8705-668c5781eccf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.345468 Aug 27 21:13:37.752524 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2680/5242] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:37 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:37.805211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:37.806395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:37.815632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:37.816442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:37.817068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:37.817950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:37.818561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:37.819536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:38.001962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf68fad783694a4499b32ae1a9370966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'facef93eae3a467c8d965bb563e3c523', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:38.014218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-612e81ba-441a-4558-93fe-a3a47638385c tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 200 len: 1323 microversion: 2.1 time: 0.215513 Aug 27 21:13:38.028962 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2563/5243] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:37 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:38.102980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:38.104335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:38.114861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:38.117771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:38.118395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:38.120315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:38.122152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:38.123606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:38.414316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:38.424526 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8a97b5f-19ba-4eb4-8777-48a3aecc905a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.325318 Aug 27 21:13:38.435380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2681/5244] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:38 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:38.780448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:38.781595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:38.803237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:38.804219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:38.804835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:38.807748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:38.811280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:38.811984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:39.043133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:39.044623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] [instance: 550cd635-d377-4101-b61d-6e5ca147b826] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:39.056291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:39.057238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:39.058017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:39.059523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:39.060324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:39.061033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:39.083711 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] HTTP exception thrown: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Request method failure captured: Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 HTTP/1.1 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoaZbAOzAav6yLyAS8FkDHwYet8EInI-Mf7MZ4q5xzlu4Tv6kGVQRrAASgw9TB_vdRKvgAJ-k4uPkltVKah6mecl9byyTGJblW326ZvoYtxngwwxTsvbiq2SD61gq62McXzjv4O2gKOPhBK4WRCYj1iMxU1inZDEenkgqSAS6MIKKK0 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/facef93eae3a467c8d965bb563e3c523"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_facef93eae3a467c8d965bb563e3c523", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/facef93eae3a467c8d965bb563e3c523"}]}] Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: facef93eae3a467c8d965bb563e3c523 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-369705348 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: cf68fad783694a4499b32ae1a9370966 Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-369705348-project Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '550cd635-d377-4101-b61d-6e5ca147b826'} Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:13:39.086796 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. Aug 27 21:13:39.093331 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:13:39.096843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Returning 404 to user: Instance 550cd635-d377-4101-b61d-6e5ca147b826 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:13:39.099678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4aeaff25-9a2f-46be-aecc-296b883b0379 tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826" status: 404 len: 111 microversion: 2.1 time: 0.064670 Aug 27 21:13:39.100956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2682/5245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:39 2022] GET /compute/v2.1/servers/550cd635-d377-4101-b61d-6e5ca147b826 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:13:39.109884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1d6bbb5-add3-4e1a-98d2-296306f6c7ad tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] Calling method '.version_select at 0x7ff84dd18ca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:39.118012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:39.132813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:39.139767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1d6bbb5-add3-4e1a-98d2-296306f6c7ad tempest-ServerActionsTestJSON-369705348 tempest-ServerActionsTestJSON-369705348-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135449054" status: 202 len: 0 microversion: 2.1 time: 0.032663 Aug 27 21:13:39.140770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:39.142718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3909173-6c90-420c-8420-1b85488cad95 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.367809 Aug 27 21:13:39.145656 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2683/5246] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135449054 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:13:39.146286 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2564/5247] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:38 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:39.452841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:39.454359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:39.487594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:39.488709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:39.490394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:39.495377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:39.496314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:39.497187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:39.761764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:39.773102 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-121bf469-5cd9-4ab6-929a-9ac0c6994cd2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.328377 Aug 27 21:13:39.777509 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2684/5248] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:39 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:40.173959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:40.174700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:40.191811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:40.192688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:40.197478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:40.198363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:40.201997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:40.202555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:40.488487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:40.499383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:40.502880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:40.508896 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-665e28b1-445a-48b4-bd32-9a69cecd695e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.340727 Aug 27 21:13:40.509845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2565/5249] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:40 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:40.729250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6f0c6-298b-4a42-b82d-2550ac31cad0", "name": "network-vif-plugged", "status": "completed", "tag": "c35613fc-96d7-4a01-83b4-a05561fedd72"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:40.763133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:40.765043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:40.766291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:40.796547 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] Creating event network-vif-plugged:c35613fc-96d7-4a01-83b4-a05561fedd72 for instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 on nch1-master-1 Aug 27 21:13:40.807219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:40.808682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:40.827120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:40.830398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:40.831949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:40.834893 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9d4b5d44-56af-4ce1-9ee0-43d5fb121b3b req-f853c398-5394-44cf-8e18-3d19b79e34e4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105884 Aug 27 21:13:40.835785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:40.838719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:40.841992 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2685/5250] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:40.842195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:41.288350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:41.307776 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17475644-d095-43b7-b47e-c34adf2381e8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.506332 Aug 27 21:13:41.309045 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2566/5251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:40 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:41.558062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:41.563477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:41.594449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:41.595668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:41.596953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:41.599663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:41.605580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:41.607267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:42.115896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:42.143054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:42.148200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:42.149538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a12c71f-4d0d-4e15-a744-9dc09553f459 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.614178 Aug 27 21:13:42.201400 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2686/5252] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:41 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:42.340302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:42.340945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:42.375043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:42.377872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:42.378712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:42.381080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:42.384897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:42.385644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:43.138252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:43.164615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c21ee200-2911-4be9-86a3-429ffbb21af5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1317 microversion: 2.1 time: 0.828935 Aug 27 21:13:43.175515 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2567/5253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:42 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:43.211707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:43.212336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:43.232183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:43.232712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:43.233170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:43.233918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:43.234382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:43.234822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:44.186996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:44.187698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:44.200250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:44.203896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:44.204548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:44.205454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:44.207234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:44.208954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:45.040252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:45.068942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:45.070814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:45.073576 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64791145-3c13-44c4-8aac-ae2ceb856f16 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 1.865819 Aug 27 21:13:45.089343 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2687/5254] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:43 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:45.818358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:45.837023 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bcf9887f-df12-485d-b4d0-887cb517f7df tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1508 microversion: 2.1 time: 1.654570 Aug 27 21:13:45.840239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2568/5255] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:44 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1508 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:45.859920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:45.861115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:45.876681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:45.878902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:45.882893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:45.885857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:45.886543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:45.889886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:46.102904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:46.103611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:46.130632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:46.133048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:46.134333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:46.136817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:46.138139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:46.140016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:46.990288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:47.009393 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc811bff-635b-4ee1-91e0-000a32960ecd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1508 microversion: 2.1 time: 1.154173 Aug 27 21:13:47.010779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2688/5256] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:45 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1508 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:47.031306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:47.034557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:47.042140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.044387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.045056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:47.046093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.074931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.075777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:47.141605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:47.166510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:47.169345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:47.171981 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9c1bf28-ac7f-43e9-87f0-ff3bff1ce564 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 1.075047 Aug 27 21:13:47.190303 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2569/5257] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:46 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:47.256531 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e76131fd-d172-4d53-bee5-542c07ed2760 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "PUT /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1080 microversion: 2.1 time: 0.228003 Aug 27 21:13:47.264397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2689/5258] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:13:47 2022] PUT /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1080 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:47.280527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:47.281539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:47.309751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.313487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.314935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:47.316428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.318456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.320209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:47.806528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:47.816988 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2eff4e52-c85f-4953-a3c2-42d0d8e106ac tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1506 microversion: 2.1 time: 0.540910 Aug 27 21:13:47.818393 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2570/5259] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:47 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:47.844168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:47.844874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:47.861544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.863409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.863884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:47.868573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:47.869300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:47.871203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:48.204780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:48.206357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:48.215093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:48.223963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:48.224575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:48.225453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:48.226173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:48.226756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:48.660894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:48.688624 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81828e36-c12c-417b-8052-67430643765e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1506 microversion: 2.1 time: 0.854412 Aug 27 21:13:48.689280 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2690/5260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:47 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:48.725814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:48.742434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:48.749015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:48.749515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:48.749959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:48.750674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:48.751126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:48.757253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:48.789025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:48.890376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:13:48.891176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:13:48.891754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:13:48.892273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:13:48.898142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:13:49.031507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:49.043908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:49.045805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:49.047443 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-84c8a335-fbd4-4db1-9149-61e8e16beca1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.846666 Aug 27 21:13:49.048689 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2571/5261] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:48 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:49.057535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:49.067946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:49.068786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:49.069574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:49.070565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:49.071221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:49.072090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:49.120190 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-258aaff0-ab25-4b38-ad8f-a772e627a8c0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "POST /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0/action" status: 202 len: 1112 microversion: 2.1 time: 0.410650 Aug 27 21:13:49.143998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2691/5262] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:13:48 2022] POST /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0/action => generated 1112 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 21:13:49.158871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:49.160303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:49.184025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:49.186352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:49.189762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:49.191069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:49.191965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:49.194548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:49.466078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-615327542", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:49.590268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] validate_networks() for [('d9208a18-551f-4b8c-a16f-084f27b88dfe', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:13:49.677173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:49.694458 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17de70c8-82e3-4629-a455-406f246c55c6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.544656 Aug 27 21:13:49.695364 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2572/5263] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:49 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:50.075465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:50.076425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:50.082951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.083759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.084420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.085329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.086545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.087520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.896462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:50.900952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:13:50.901482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:13:50.902109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:13:50.902744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:13:50.903512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:13:50.910286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:50.912190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:50.925079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.925512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c2896b4b-5c99-47e4-8c2c-97a0faf20549 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.854051 Aug 27 21:13:50.925643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.925997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.926173 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2573/5264] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:50 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:50.935688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.935688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.935688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.939619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:50.941687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:50.953605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.954430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.955204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.956168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:50.956856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:50.957448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:50.985009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Getting quotas for project 30cc1bb296014690bb72ae59829e5218. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:13:50.998745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Getting quotas for user fe51e589dc00446cb71cc2c4b3cdbc3f and project 30cc1bb296014690bb72ae59829e5218. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:13:51.039937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:13:51.054842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:13:51.160933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-65a98ec7-f747-4df4-b083-841725233565 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905922 Aug 27 21:13:51.163959 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2692/5265] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:13:51.177216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f513e3d-0797-405e-9b8a-542c8f3b96b5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:51.178089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f513e3d-0797-405e-9b8a-542c8f3b96b5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:51.282438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0f513e3d-0797-405e-9b8a-542c8f3b96b5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:51.302728 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f513e3d-0797-405e-9b8a-542c8f3b96b5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1216 microversion: 2.1 time: 0.128643 Aug 27 21:13:51.316459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2693/5266] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:51 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:51.329190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:51.346328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c13e29e-c452-4290-9a4c-879935e924fe tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.414629 Aug 27 21:13:51.346970 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2574/5267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:50 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:51.955911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:51.956370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:51.970103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:51.970730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:51.974397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:51.975386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:51.978670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:51.979267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:52.289831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:52.317260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:52.320322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:52.325171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:52.325710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:52.326078 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77de203c-0847-42f9-af99-4aad81998ba8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.375945 Aug 27 21:13:52.327242 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2694/5268] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:51 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:52.341163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:52.341702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:52.342131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:52.342864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:52.343328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:52.343783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:52.348428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:52.380567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:52.381317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:52.388472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:52.388964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:52.396092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:52.404089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:52.404839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:52.405291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:52.539983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:52.561375 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4eb7a15e-f123-4e8b-8f28-e0c6f133af55 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1220 microversion: 2.1 time: 0.241367 Aug 27 21:13:52.562621 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2575/5269] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:52 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1220 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:52.774174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:52.789870 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f6cbfcff-c990-4b90-b1fd-964257c9c0cc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.420978 Aug 27 21:13:52.790480 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2695/5270] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:52 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:53.350658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:53.352047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:53.356406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:53.363979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.364490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.364951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:53.365904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.366566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.367153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:53.582648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:53.583405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:53.592354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.592853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.593308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:53.594004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.594456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.594881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:53.600083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:53.613952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:53.616115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:53.617972 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-960c37b8-36c6-4b4a-9ca2-ea8f6dbb1f47 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.271875 Aug 27 21:13:53.618947 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2576/5271] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:53 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:53.760325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:53.773768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e5fad45-f15d-4354-9e3c-ae7b8cb3a421 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1212 microversion: 2.1 time: 0.195349 Aug 27 21:13:53.781945 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2696/5272] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:53 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:53.820516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:53.821547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:53.838937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.842137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.843623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:53.844590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:53.845055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:53.847264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:54.145894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:54.157196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e881f86d-2fbe-493f-8a04-6e7c1d101f6c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.348572 Aug 27 21:13:54.168069 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2577/5273] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:53 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:54.641719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:54.642974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:54.650419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:54.650921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:54.651384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:54.652107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:54.652636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:54.653069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:54.803696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:54.809859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:54.823491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:54.826541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:54.827182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:54.829299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:54.830860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:54.832318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:54.949504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:54.959578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:54.971513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:54.977476 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8239f126-b72c-4959-9e04-3e336aa9131b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.339570 Aug 27 21:13:54.978897 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2697/5274] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:54 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:54.999229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:55.010933 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-daac683b-2be1-4cec-b41c-7c6c1f3d93bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1276 microversion: 2.1 time: 0.210840 Aug 27 21:13:55.013750 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2578/5275] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:54 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:55.184511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:55.185326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:55.197611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:55.198192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:55.199364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:55.201229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:55.202116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:55.202726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:55.252934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1927153473", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": "none"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:55.321289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:13:55.321804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:13:55.322376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:13:55.322873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:13:55.323476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:13:55.335317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:55.335939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:55.336449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:55.337251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:55.337783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:55.338649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:55.358206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Getting quotas for project 81795f5e2c404467a5b67f817e22f654. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:13:55.363858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Getting quotas for user b504c000bf7a47a0810394eaa8c21088 and project 81795f5e2c404467a5b67f817e22f654. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:13:55.373118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:55.378291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:13:55.380569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:13:55.382281 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3783c3a0-6813-4829-bfec-da535e7bd900 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.205051 Aug 27 21:13:55.382872 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2579/5276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:55 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:55.433310 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b53d16e4-04a4-4905-bacd-2b140b0fbf31 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.378362 Aug 27 21:13:55.434123 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2698/5277] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:13:55.446467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:55.447244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:55.520328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:55.541878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:55.544132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:55.547043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1470d82d-c515-4ecd-ac04-54c7735b00f3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1278 microversion: 2.54 time: 0.105466 Aug 27 21:13:55.547919 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2580/5278] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:55 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:56.005145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:56.005752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:56.015695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.016500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.017331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.018285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.019230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.019862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.037826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:56.038465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:56.050202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.056818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.057469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.058528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.060047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.060718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.207152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.219275 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0084a7a-41df-47d8-8e3c-6672f41a5866 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1274 microversion: 2.1 time: 0.185509 Aug 27 21:13:56.220251 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2581/5279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:56 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:56.289094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.303550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.305428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.306832 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1bd3ebb5-4029-45d1-8d2d-24d968b89995 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.307278 Aug 27 21:13:56.323025 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2699/5280] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:55 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:56.403786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:56.405819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:56.426056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.426374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.426731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.427491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.428127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.428738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.571568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:56.572554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:56.579713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.580602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.581264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.582215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:56.582901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:56.583595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:56.599550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.611965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b94e0c03-de35-4097-a59c-9b986ed48a2f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.212273 Aug 27 21:13:56.614876 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2582/5281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:56 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:56.666255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.675457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.677077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:56.678561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-627fd734-6e29-4ecc-ab57-842254625bd0 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1330 microversion: 2.54 time: 0.110725 Aug 27 21:13:56.683487 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2700/5282] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:56 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:13:57.242273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:57.243669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:57.258701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.259208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.264242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.265068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.265889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.273281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.335329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:57.337110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:57.360207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.361230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.362206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.367616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.369268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.370181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.723004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.733356 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f813c09-64d7-4d60-b33d-6d38a851198d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.495002 Aug 27 21:13:57.740559 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2583/5283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:57 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:57.746218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:57.747199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:57.755783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.770573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.771295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.772112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.772396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.773343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.773938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.774272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.775040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.775231 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b92b5ce5-d953-4781-a15f-0847e1d16169 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.444965 Aug 27 21:13:57.780454 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2701/5284] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:57 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:57.795119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:57.796374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:57.813262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.815488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.815488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.815488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:57.815488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:57.816643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:57.932248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.947278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.949486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:57.950714 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a92788d-520c-48da-a4d5-331ef59bbf4e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1336 microversion: 2.54 time: 0.169197 Aug 27 21:13:57.951534 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2702/5285] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:57 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:58.083441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:58.097721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b76fc40b-3d44-4ba3-b16b-5bdb83fb64d9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.355610 Aug 27 21:13:58.105038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2584/5286] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:57 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:13:58.342610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:58.349128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:13:58.358453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:58.358940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:58.359854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:58.372719 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] Creating event network-changed:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:13:58.378324 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b9df1428-9b11-4aa3-8851-5abe97891650 req-42d7591f-2eb6-4b3a-a402-dce0d5fe36a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040045 Aug 27 21:13:58.378930 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2703/5287] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:58.756598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:58.758024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:58.766012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:58.766895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:58.767620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:58.768564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:58.769226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:58.769866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:58.799988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:58.801095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:58.818104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:58.821327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:58.821852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:58.822983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:58.825973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:58.827880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.223289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.241622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10b698cb-98d7-4eea-934a-e54c5ea574e1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.488847 Aug 27 21:13:59.242242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2585/5288] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:58 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:13:59.244592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.248500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:59.249226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:59.256340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:59.257137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:59.258089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.258625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.259556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.259894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:59.260541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:59.260736 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-810b463a-63aa-4d2d-a4e9-4a4cf8bcc3e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.465673 Aug 27 21:13:59.261891 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2704/5289] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:58 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:59.268701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.275306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:13:59.277320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:13:59.301387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:59.301888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:59.302330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.303060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:59.304770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:59.304770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.427661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.439907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.441522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.442879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e6210f3-ac98-48a6-9bf5-14017cc30c41 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1336 microversion: 2.54 time: 0.199327 Aug 27 21:13:59.449429 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2586/5290] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:13:59 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:13:59.454882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "name": "network-vif-plugged", "status": "completed", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:13:59.466660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:13:59.467730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:13:59.468419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:13:59.481415 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] Creating event network-vif-plugged:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:13:59.488398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-448995ef-8906-4b63-826a-4a96b967101c req-4c4dbe93-cba7-406a-8f28-1769ccce03db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037676 Aug 27 21:13:59.489364 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2587/5291] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:13:59.549991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:13:59.558506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72564ed5-9a2c-42da-8b7f-8a737cd16e18 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.295205 Aug 27 21:13:59.559475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2705/5292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:13:59 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:00.267967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:00.268660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:00.276023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.276867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.279183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.279183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.279183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.279183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.291843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:00.293390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:00.320680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.321527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.322258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.323247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.324018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.324793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.712171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.725438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.727877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.736365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4bb77f67-c408-4ebf-bc0b-e57ba4354863 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.473663 Aug 27 21:14:00.736980 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2588/5293] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:00 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:00.737954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.739432 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be8f1287-a4bc-437f-814c-b67fb38b7381 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.456604 Aug 27 21:14:00.740191 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2706/5294] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:00 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:00.752605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:00.752605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:00.766581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:00.767216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:00.767562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.768251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.770672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.771662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.774570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.775083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.775256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.775961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.776782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.777736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:00.778355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:00.778933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:00.896563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.906902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.909291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:00.910751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b337d26e-7378-4caf-9f91-0f2ca069252f tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1336 microversion: 2.54 time: 0.172604 Aug 27 21:14:00.922905 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2589/5295] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:00 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:01.039459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:01.049474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa243d2e-b76d-4736-ba10-e4dd7e87f6ee tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.293843 Aug 27 21:14:01.051264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2707/5296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:00 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:01.758675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:01.759492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:01.766612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:01.767465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:01.768068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:01.768423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:01.768898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:01.769208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:01.769635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:01.769790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:01.781161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:01.781672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:01.782120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:01.782837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:01.783292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:01.783750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.009855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.019414 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-525540a4-2572-43f5-9de1-987686e3bc41 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.265310 Aug 27 21:14:02.023629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.033452 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2590/5297] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:01 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:02.038676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:02.039521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.039653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.041139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.042492 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8536578c-aeaf-40ab-a8bc-5d1be83b1a6a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.278216 Aug 27 21:14:02.043154 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2708/5298] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:01 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:02.047725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.048739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.049348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.050269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.050892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.051522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.074902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:02.075568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.083504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.084512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.084982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.085705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.086171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.086605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.126535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:02.146625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.166693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.168882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.170818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a663e17-88c0-454f-8073-8bfb8db883ea tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1357 microversion: 2.54 time: 0.136016 Aug 27 21:14:02.171607 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2591/5299] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:02 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1357 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:02.199486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-191a738a-1ab1-4e75-82c7-9786cb90cc15 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Action: 'create', calling method: .version_select at 0x7ff857cf63a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-657269319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8Po3lmCYtunqQOIwUF/cpksdkoZkaMh7OdRw0titC8T7hCJpzH2R2gwWu6CW72dDi4ZbydUJZcnsx5lVclau90JJ0/Q6iwHETXp1M4/hvrLX/Cumfur8KX/jCfrcm2yA=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:02.228789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-191a738a-1ab1-4e75-82c7-9786cb90cc15 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Getting quotas for project 81795f5e2c404467a5b67f817e22f654. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:14:02.244266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-191a738a-1ab1-4e75-82c7-9786cb90cc15 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Getting quotas for user b504c000bf7a47a0810394eaa8c21088 and project 81795f5e2c404467a5b67f817e22f654. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:14:02.290567 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-191a738a-1ab1-4e75-82c7-9786cb90cc15 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.094332 Aug 27 21:14:02.292208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2592/5300] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 21:14:02 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 21:14:02.306454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.310894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-657269319", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:02.314645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.316934 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f8bcfd7-12d6-425c-94db-304a6c09e49f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.247924 Aug 27 21:14:02.322805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.323242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.323741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.324748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.324945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.325382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.331446 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2709/5301] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:02 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:02.438431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:14:02.438932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:14:02.439670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:14:02.440431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:14:02.441054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:14:02.472078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:02.494194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:02.498230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.511247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.514214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.514712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.515566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.517945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.518480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.577180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.596439 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93fbd2fa-9747-4bf9-a976-ef982c0f5345 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106462 Aug 27 21:14:02.596842 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2710/5302] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:14:02 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 21:14:02.597221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.597886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.598348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.599090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.599612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.600051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.672671 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89a6fad6-7dd8-41b3-a301-f6171ca6805c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "POST /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6/action" status: 202 len: 1139 microversion: 2.54 time: 0.372690 Aug 27 21:14:02.673335 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2593/5303] 10.222.0.40 () {62 vars in 1320 bytes} [Sat Aug 27 21:14:02 2022] POST /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6/action => generated 1139 bytes in 374 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 21:14:02.703410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:02.704656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.709699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:02.710320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:02.718017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.718535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.718973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.720543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.722383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.722598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.722729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.722831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.723141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.723892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:02.724693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:02.727358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:02.774484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:02.853001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.889105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.891083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:02.903935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-58c2fe81-1fb5-4620-a7f0-4c326330070c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.198354 Aug 27 21:14:02.905103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2594/5304] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:02 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:02.989742 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1580917e-886e-4c6a-957b-5873f16406a8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 204 len: 0 microversion: 2.1 time: 0.290458 Aug 27 21:14:02.990563 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2711/5305] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:02 2022] DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:14:02.999903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:03.000525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:03.022474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.022984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.023447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.024272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.024603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.025031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.043736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:03.044570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:03.062432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.062949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.067354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.068629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.070211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.070951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.371376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.379747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0caf22d3-7081-48b7-ab54-54d058dda1aa tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.342141 Aug 27 21:14:03.380330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2712/5306] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:03 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:03.397763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:03.398449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:03.420724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.421098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.421553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.421934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.423164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.438149 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c962e7f-2e14-4180-9319-688bf8a6c387 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1673 microversion: 2.1 time: 0.443070 Aug 27 21:14:03.438299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.438683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.439555 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2595/5307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:02 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1673 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:03.445105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:03.445925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:03.453793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.455323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.455851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.456599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.457568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.457998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.691244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.693830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.703786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.706411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:03.708037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8984c669-6d23-4d2b-bb60-9cc32f6c2356 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.322063 Aug 27 21:14:03.708543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2713/5308] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:03 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:03.718004 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0bbe06f-99f6-498d-81b2-75d3f4852f70 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.276802 Aug 27 21:14:03.718753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2596/5309] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:03 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:03.930617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:03.931455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:03.943244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.943786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.944553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:03.945435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:03.945996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:03.946554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.036682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.045388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.046837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.048040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f91dee9e-a28b-40cb-9a18-c9cd64ed6222 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.122325 Aug 27 21:14:04.048611 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2714/5310] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:03 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:04.401494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:04.402204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:04.409809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.410287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.410750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.411482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.411935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.412360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.461817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:04.462520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:04.479189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.479728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.480226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.480970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.481654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.482202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.598709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.607859 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-007b56fd-66e2-43f3-b40a-416e07f9add3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.210252 Aug 27 21:14:04.608530 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2597/5311] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:04 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:04.654887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.662970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05bcf1a9-1f1f-419e-af2f-0d1409df87ab tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1673 microversion: 2.1 time: 0.205779 Aug 27 21:14:04.663581 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2715/5312] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:04 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:04.732195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:04.733108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:04.739061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:04.739767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.739900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:04.740381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.740885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.741626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.742288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.742714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.747542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.748159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.748741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.749631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:04.750095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:04.750656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:04.958099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.961021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.968966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fc8e866-d912-4910-8614-58d228ef8756 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.233666 Aug 27 21:14:04.971975 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2716/5313] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:04 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:04.987117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.988702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:04.989959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ea218496-4e90-4e16-9c5e-0d1403ffad41 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1807 microversion: 2.20 time: 0.261937 Aug 27 21:14:04.990596 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2598/5314] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:04 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:05.073195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:05.074231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:05.080906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.081563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.082109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.082921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.083520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.084078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.156642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "name": "network-vif-plugged", "status": "completed", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:05.160466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:05.169074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.170005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.170908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.171977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:05.173761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:05.175153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba471ac8-b147-4b4d-9274-02b9959f7546 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.106732 Aug 27 21:14:05.176507 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2717/5315] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:05 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:05.187655 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] Creating event network-vif-plugged:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:14:05.194155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-907d9bba-168b-42f5-965e-c4c314f59de3 req-84689013-f1fa-4423-b018-0ae2f437e073 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042328 Aug 27 21:14:05.194804 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2599/5316] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:14:05.629094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:05.629705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:05.631834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:05.632497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:05.639276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.639806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.640285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.641027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.641530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.642422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.685705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:05.686424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:05.693437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.693851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.694288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.695057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:05.695538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:05.696134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:05.833673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:05.842979 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-845955e1-6e03-4016-a426-2f4bb49443d3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.217796 Aug 27 21:14:05.856345 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2718/5317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:05 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:05.887047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:05.895764 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-adae8f84-976b-448e-a033-bae6b8aad4c9 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1673 microversion: 2.1 time: 0.215134 Aug 27 21:14:05.896363 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2600/5318] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:05 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:05.992409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:05.993110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:06.000692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.001195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.001642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.002373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.002816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.003251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.014827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:06.015622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:06.023191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.024056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.024566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.025361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.025895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.026413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.213189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.222581 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd062ad3-c7a4-4f9a-a97e-17aa7bd28e72 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.234094 Aug 27 21:14:06.223650 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2719/5319] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:05 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:06.235540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.240488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.240488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.241462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d35778a-a49c-40a8-9483-5063286ba53e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1794 microversion: 2.20 time: 0.231204 Aug 27 21:14:06.242052 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2601/5320] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:06 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1794 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:06.243687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:06.244312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:06.251125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.251660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.252101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.252810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.253269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.253693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.324692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.334017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.335500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:06.336718 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-779d1d9e-dfb0-4959-9bb8-b2dae5c6a3c4 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.099621 Aug 27 21:14:06.337276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2720/5321] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:06 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:06.863559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:06.864301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:06.871881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.872456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.872965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.873739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.874269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.874782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.918385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:06.919011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:06.926538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.927131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.927708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:06.928506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:06.931322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:06.931322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.001715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.011745 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a99d513-0d91-4018-8e23-d488f29de393 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1605 microversion: 2.1 time: 0.097139 Aug 27 21:14:07.012982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2721/5322] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:06 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:07.082849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.091804 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-549e7831-1074-47e6-9649-0c7fb8442849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1316 microversion: 2.1 time: 0.232151 Aug 27 21:14:07.092396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2602/5323] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:06 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:07.248810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:07.250752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:07.262588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:07.263408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:07.264715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.265703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:07.266416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:07.267840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.360967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:07.362049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:07.378729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:07.379333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:07.380188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.381456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:07.382172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:07.382816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.543275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.552785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.563981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.565472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00db5c81-7b6a-4ee5-8cb3-c19ba71c081e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.208965 Aug 27 21:14:07.566267 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2603/5324] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:07 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:07.589870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08894f9-51d1-4343-ac4d-194a49f114e9", "name": "network-vif-deleted", "tag": "77c78cae-b84d-44f1-8005-fb9bb991ab77"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:07.607112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:07.615515 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79db96b2-977f-48a3-9aff-3e7072e69458 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.370972 Aug 27 21:14:07.616314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:07.616723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2722/5325] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:07 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:07.630224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:07.630224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:07.640379 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] Creating event network-vif-deleted:77c78cae-b84d-44f1-8005-fb9bb991ab77 for instance f08894f9-51d1-4343-ac4d-194a49f114e9 on nch2-master-1 Aug 27 21:14:07.646971 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-40a85c42-c560-4d58-9f2f-65a36b1ec550 req-4619313c-ac44-4dec-87ed-64eb5c547b8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079101 Aug 27 21:14:07.647811 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2604/5326] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:08.034363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:08.035004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:08.044906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.045745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.046385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.047299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.048097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.048737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.089598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.090349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.090996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.091551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lazy-loading 'fault' on Instance uuid f08894f9-51d1-4343-ac4d-194a49f114e9 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:14:08.113102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:08.113836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:08.121890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.122395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.122894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.123633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.124337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.125114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.158505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:08.163139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:08.174049 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-86def2f4-8c4c-4318-8489-671d7025490f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 200 len: 1327 microversion: 2.1 time: 0.143551 Aug 27 21:14:08.175576 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2723/5327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:08 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 1327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:08.391704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:08.400950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-69b0563c-6c92-4272-a6ab-7e72e723f600 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.292465 Aug 27 21:14:08.401538 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2605/5328] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:08 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:08.523866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-451755907", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:08.588787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] validate_networks() for [('d9208a18-551f-4b8c-a16f-084f27b88dfe', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:14:08.596059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:08.596890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:08.611551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.612444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.613375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.614444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.615113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.615757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.704703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:08.719547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:08.723285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:08.726284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21d43c31-ebd0-4e85-80fd-b8fcc45866e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.135569 Aug 27 21:14:08.728777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2606/5329] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:08 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:08.746171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:08.746847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:08.764288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.766241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.766756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:08.767550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:08.768666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:08.769183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.050878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:09.070968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f44eb933-d142-409e-8481-122c7de7bf68 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.339973 Aug 27 21:14:09.073697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2607/5330] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:08 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:09.198233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:09.200177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:09.208244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.209107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.209826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.210835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.211559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.212214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.227956 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 HTTP/1.1 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f08894f9-51d1-4343-ac4d-194a49f114e9'} Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:09.230185 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:14:09.235029 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:09.236986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:09.238128 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-38cbccec-7d2e-46ce-a47a-a6f1e0e886a5 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 404 len: 111 microversion: 2.1 time: 0.044321 Aug 27 21:14:09.238804 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2608/5331] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:09 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:14:09.248803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ffe3076b-ede1-4c57-8b50-659058193ff0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '.version_select at 0x7ff84f5103a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:09.272523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:14:09.273170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:14:09.273463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:14:09.273950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:14:09.274409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:14:09.275641 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ffe3076b-ede1-4c57-8b50-659058193ff0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373016131" status: 202 len: 0 microversion: 2.1 time: 0.031232 Aug 27 21:14:09.276271 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2609/5332] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1373016131 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:14:09.286299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.288227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.288827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.290119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.290805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.291586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.329905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Getting quotas for project 30cc1bb296014690bb72ae59829e5218. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:14:09.337636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Getting quotas for user fe51e589dc00446cb71cc2c4b3cdbc3f and project 30cc1bb296014690bb72ae59829e5218. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:14:09.359275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:14:09.362785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:14:09.424404 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b5f5c75-8b3d-40d5-b036-212075ffac1f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905585 Aug 27 21:14:09.425540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2724/5333] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:14:09.444781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99ee72dd-9e22-4e5d-8759-66da19f93201 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:09.445423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99ee72dd-9e22-4e5d-8759-66da19f93201 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:09.565392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-99ee72dd-9e22-4e5d-8759-66da19f93201 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:09.578277 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99ee72dd-9e22-4e5d-8759-66da19f93201 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1216 microversion: 2.1 time: 0.140966 Aug 27 21:14:09.582879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2610/5334] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:09 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:09.753944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:09.754882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:09.770058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.770871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.771592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.772877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:09.773521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:09.774115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:09.943564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:09.979653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:09.984278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:09.987930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2feae0d7-9398-436d-891b-d983cb0fa853 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.237686 Aug 27 21:14:09.992363 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2725/5335] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:09 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:10.111032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:10.112309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:10.120531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:10.121146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:10.121702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:10.122521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:10.123092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:10.123638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:10.437366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:10.448674 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a7ceb8f1-f978-47ed-8e33-f54e835cc9e3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1517 microversion: 2.1 time: 0.350102 Aug 27 21:14:10.450147 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2611/5336] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:10 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:10.527641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4f4b595c-bce1-4f6b-820f-0ae6d101ed4d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: .version_select at 0x7ff84dc88280>, body: {"keypair": {"name": "tempest-keypair-1480491318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFTGfYqwDqKeS7t/49oEPpFs11K1576tgL6K4dF3cVOfKIApsCSU0dzzpbCMhCwcVpXRlYxZVXLKsr0Q7KkZGY2l73LzjhX9XSZ8XyjeES+oinKi6KwGgsJVnCAO+WXfw=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:10.546561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-4f4b595c-bce1-4f6b-820f-0ae6d101ed4d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:14:10.553487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-4f4b595c-bce1-4f6b-820f-0ae6d101ed4d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for user 7266d6f3c5f44e758e222cf97e0cda65 and project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:14:10.581817 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4f4b595c-bce1-4f6b-820f-0ae6d101ed4d tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060015 Aug 27 21:14:10.582483 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2726/5337] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:14:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:10.604200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:10.604880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:10.615898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:10.616583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:10.617210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:10.618085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:10.618711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:10.619139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:10.740642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:10.747222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:10.756787 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3fa07bb-876d-438e-a5d2-c42210ab7d8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1268 microversion: 2.1 time: 0.156538 Aug 27 21:14:10.757709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2612/5338] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:10 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:11.015554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:11.016330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:11.034764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.035815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.036383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:11.037235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.038636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.045040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:11.187723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:11.204684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:11.207550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:11.209306 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf44dcbc-adee-4b95-8fa5-ccaec1c9e428 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.199562 Aug 27 21:14:11.210583 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2727/5339] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:11 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:11.471910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:11.473297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:11.500010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.502396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.503823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:11.504825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.505565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.506680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:11.780442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:11.782639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:11.795842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.797271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.797948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:11.799944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:11.800748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:11.801580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:12.064111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:12.071997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-72acb88f-4f9d-4ad0-9f60-53be1522b8c6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1274 microversion: 2.1 time: 0.297729 Aug 27 21:14:12.085908 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2728/5340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:11 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:12.192315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:12.202309 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ecd19115-a2f7-4cb2-bb7a-759273aa04bc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.734614 Aug 27 21:14:12.207617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2613/5341] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:11 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:12.237337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:12.237990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:12.247654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:12.248412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:12.249494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:12.250405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:12.252153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:12.252813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:12.383835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:12.402290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:12.404422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:12.406361 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2aabfd56-a03b-4845-a349-c365aad088bf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.172975 Aug 27 21:14:12.407316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2729/5342] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:12 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:13.093377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:13.094799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:13.108444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.108871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.109324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.110067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.112867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.113708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.183495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1655482401", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a0137230-a7d5-4748-8e88-a9a054ef6657"}], "security_groups": [{"name": "tempest-securitygroup--1582973083"}], "key_name": "tempest-keypair-1480491318", "user_data": "}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:13.319913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:13.330421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9e70f84-62d2-4ba2-95f9-b4b4601247c3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.240973 Aug 27 21:14:13.344023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] validate_networks() for [('a0137230-a7d5-4748-8e88-a9a054ef6657', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:14:13.344350 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2614/5343] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:13 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:13.346766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:13.347707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:13.352062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:13.356881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.357682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.358385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.359328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.360006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.360637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.567667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:13.580087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-00903fea-0212-463a-a610-1e916da7aad7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.239942 Aug 27 21:14:13.597939 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2615/5344] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:13 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:13.603304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:13.604239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:13.611188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.611940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.612549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.613476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.614111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.614706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.776153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:13.790218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:13.792035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:13.797735 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cbeff10d-14d7-4402-9240-65f78172b565 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.198298 Aug 27 21:14:13.804194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2616/5345] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:13 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:13.818145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58099dc-f5d9-4350-989e-7c990c10442a", "tag": "d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:13.834528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.835015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.838395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.860612 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] Creating event network-changed:d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22 for instance a58099dc-f5d9-4350-989e-7c990c10442a on nch2-master-1 Aug 27 21:14:13.867587 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-3fd76d33-f707-453c-864a-a15ca7df978e req-c61f66e6-5bee-429f-b77c-0c69661bd20c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067937 Aug 27 21:14:13.871375 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2617/5346] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:13.909325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6f0c6-298b-4a42-b82d-2550ac31cad0", "name": "network-vif-unplugged", "status": "completed", "tag": "c35613fc-96d7-4a01-83b4-a05561fedd72"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:13.920295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:13.921307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:13.921307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:13.945048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] Creating event network-vif-unplugged:c35613fc-96d7-4a01-83b4-a05561fedd72 for instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 on nch1-master-1 Aug 27 21:14:13.957269 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1b8a2be1-3006-42ea-87d7-9b694e6e55c2 req-fd64124a-33ed-4769-a115-9f5f82669eaf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053226 Aug 27 21:14:13.958674 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2618/5347] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:14.123103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:14:14.123770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:14:14.124839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:14:14.125255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:14:14.125662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:14:14.146548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.147386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.148019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.148979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.149656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.150177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.168659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:14:14.174446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Getting quotas for user 7266d6f3c5f44e758e222cf97e0cda65 and project a854ce08e212478fbc2bb8eb7d78b145. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:14:14.187814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:14:14.190742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:14:14.221116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:14.240727 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1344087f-e5f4-492b-923c-a7a77fe942fc tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.061740 Aug 27 21:14:14.241995 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2730/5348] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:14:14.260169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-30307744-edff-4ede-add8-5c11e246c539 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:14.265183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-30307744-edff-4ede-add8-5c11e246c539 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:14.351697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:14.368933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:14.377367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.377806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.378241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.378950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.385705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.385705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.517267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-30307744-edff-4ede-add8-5c11e246c539 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.525147 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-30307744-edff-4ede-add8-5c11e246c539 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1238 microversion: 2.1 time: 0.270640 Aug 27 21:14:14.529997 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2619/5349] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:14 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1238 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:14.602673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:14.606423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:14.615413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.617902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.622175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.622598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.623581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.624116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.624796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.633278 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ecf7e5c1-3e64-4b28-acba-8d10664cbad7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.285424 Aug 27 21:14:14.633873 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2731/5350] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:14 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:14.792715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.804932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7d998fd-d487-432d-b394-ac8c181b40ea tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.206289 Aug 27 21:14:14.812203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2620/5351] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:14 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:14.830255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:14.830901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:14.837411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.838243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.838870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.839990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:14.840685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:14.841279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:14.934630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.950489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.951999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:14.953267 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8276d967-0610-4580-a1e3-89871e502605 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.127479 Aug 27 21:14:14.954215 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2732/5352] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:14 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:15.551496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:15.552438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:15.564597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.565099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.565545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.566611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.566865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.567421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.656179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:15.657654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:15.667750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.668607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.669271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.670233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.670937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.671612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.702633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:15.716990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0971231-c0f8-4817-b1b4-5634dd7f5980 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1298 microversion: 2.1 time: 0.169534 Aug 27 21:14:15.718129 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2621/5353] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:15 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:15.844927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:15.845673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:15.857861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.860857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.861351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.863887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:15.864585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:15.866111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:15.922865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:15.935062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56efa8c4-4881-4c1d-a516-e331d50ecd2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.281428 Aug 27 21:14:15.936137 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2733/5354] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:15 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:15.980362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:15.981184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:16.005160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.005672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.006122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:16.006851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.007312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.007777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:16.114152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:16.129924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:16.135153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:16.136819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-231f5085-1d95-4171-a3fc-db8c40bd2529 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.162193 Aug 27 21:14:16.151449 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2734/5355] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:15 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:16.151834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:16.153657 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b8ed03c-d508-4707-9856-045b94099e38 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.324465 Aug 27 21:14:16.154011 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2622/5356] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:15 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:16.742275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:16.743080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:16.750642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.751532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.752246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:16.753258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.753945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.754596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:16.840370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:16.849118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a0a84571-afb6-42b4-b202-16ad9a446302 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1296 microversion: 2.1 time: 0.110677 Aug 27 21:14:16.849820 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2735/5357] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:16 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:16.959034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:16.960488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:16.968917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.969761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.970575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:16.971542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:16.972214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:16.972848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.161743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:17.162682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:17.172492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.174474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.175226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.176521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.177295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.177930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.280145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:17.330852 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4c0bb079-08a6-43aa-9fbc-57a92ff04c5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.373157 Aug 27 21:14:17.343393 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2623/5358] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:16 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:17.356126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:17.357404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:17.360268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:17.369177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:17.374599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:17.377362 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d4ae744-9fd3-4b2e-8717-58b8549fe4e3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.219671 Aug 27 21:14:17.380060 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2736/5359] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:17 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:17.380825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.381392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.381956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.382698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.383159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.383723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.699391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:17.709789 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25a3d3cc-609d-4769-9933-8a6d2bb9243b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.375773 Aug 27 21:14:17.710393 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2624/5360] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:17 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:17.870845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:17.872130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:17.886903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.887766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.888427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:17.889192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:17.889658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:17.896646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.003736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6f0c6-298b-4a42-b82d-2550ac31cad0", "name": "network-vif-plugged", "status": "completed", "tag": "c35613fc-96d7-4a01-83b4-a05561fedd72"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:18.026367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.028312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.029306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.055064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] Creating event network-vif-plugged:c35613fc-96d7-4a01-83b4-a05561fedd72 for instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 on nch1-master-1 Aug 27 21:14:18.062987 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ab48f3d0-f472-446d-b2d0-c5d03d8221ec req-569ecc26-8250-4658-b171-459aef8075b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062822 Aug 27 21:14:18.063991 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2625/5361] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:14:18.227196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.237023 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b87eaa7-dcd2-4f49-9584-247bb7fc7476 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.370619 Aug 27 21:14:18.240342 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2737/5362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:17 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:18.334257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d914b2-3d53-4cd5-920c-a5014c1cb579", "tag": "ae49cf36-2770-4b28-bdeb-0dc93c0a2f39"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:18.357835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:18.358791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:18.369409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.371629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.373470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.374137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.374848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.376335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.378196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.382119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.382815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.406110 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] Creating event network-changed:ae49cf36-2770-4b28-bdeb-0dc93c0a2f39 for instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 on nch1-master-1 Aug 27 21:14:18.418940 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cd153994-2c39-4059-aef3-9979e5bded58 req-7c219664-df6a-4da8-8304-a5e83af18d26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088587 Aug 27 21:14:18.422740 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2626/5363] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:18.436602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:18.441315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:18.458497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.459301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.461858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.463290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.467492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.468202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.594255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.612840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.614287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.615512 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ef9b101-6bcb-479f-b4d6-3d054dbef78b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.191280 Aug 27 21:14:18.616090 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2627/5364] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:18 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:18.707661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.716673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4e4b2a64-dd2d-4759-a0a1-280d81378bad tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.364823 Aug 27 21:14:18.717565 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2738/5365] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:18 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:18.739122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:18.740148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:18.747218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.747764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.748202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.749090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:18.749715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:18.750318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:18.939956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:18.955536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2f454fb-6f98-4b86-a0dc-e6fd0cdd5d47 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1523 microversion: 2.1 time: 0.222282 Aug 27 21:14:18.956870 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2628/5366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:18 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:19.260213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:19.260988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:19.268510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.268986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.269427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.270471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.270934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.271376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.559752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:19.602083 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76181766-bd6f-4a7b-9394-7d9c091601b0 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.344049 Aug 27 21:14:19.602083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2739/5367] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:19 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:19.639290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:19.640671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:19.649128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.649982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.651248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.652351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.653655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.654395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.745277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:19.746234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:19.756949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:19.776288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.777000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.777466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.778175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:19.778822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:19.779501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:19.779632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:19.783568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:19.787289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-522cb772-2c89-4925-ad9b-703d9e62584e tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.151921 Aug 27 21:14:19.790415 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2629/5368] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:19 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:19.981640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:19.983254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:20.021129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.021691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.022145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.023470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.023940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.024603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.033455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:20.041708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad79e674-c132-44ab-b8fd-a644a56310f8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.300484 Aug 27 21:14:20.043652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2740/5369] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:19 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:20.211461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:20.221196 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-105b646d-7753-426d-8291-feda6bdf45a3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1508 microversion: 2.1 time: 0.247319 Aug 27 21:14:20.221974 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2630/5370] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:19 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:20.242362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:20.243609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:20.250195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.250688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.251197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.251952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.252394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.252856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.278795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58099dc-f5d9-4350-989e-7c990c10442a", "name": "network-vif-plugged", "status": "completed", "tag": "d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:20.289604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.290097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.290534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.309048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] Creating event network-vif-plugged:d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22 for instance a58099dc-f5d9-4350-989e-7c990c10442a on nch2-master-1 Aug 27 21:14:20.317809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8518e94a-e3e4-4379-b5bb-c4c20b9873da req-0e2da90a-410e-412f-89b5-7eeea2c522e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042876 Aug 27 21:14:20.318657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2631/5371] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:14:20.628683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:20.629398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:20.638762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.639668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.640245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.641003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.641514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.642025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.878837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:20.889643 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-045c15d7-ade6-4dde-9397-01e03881ce2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 200 len: 1508 microversion: 2.1 time: 0.651181 Aug 27 21:14:20.890221 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2741/5372] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:20 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:20.894968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:20.895801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:20.903155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.904047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.905511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:20.908874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:20.909458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:20.909901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.006318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:21.009883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:21.016223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:21.017922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:21.019348 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-536d7133-8112-45b4-a163-ac3c65e1bfcb tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.128004 Aug 27 21:14:21.031365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2742/5373] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:20 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:21.031365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:21.031365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:21.033745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.034511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.035123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.036136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.036802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.037397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.071267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:21.114614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:21.123770 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-315ab14b-3908-4ccb-ac81-354a1c2f7910 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.499517 Aug 27 21:14:21.124694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2632/5374] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:20 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:21.140040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:21.140653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:21.147157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.147693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.148212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.148923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.149417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.150038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.232469 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-708b7922-872c-4fa1-bb80-6e3e96d715d5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 204 len: 0 microversion: 2.1 time: 0.210539 Aug 27 21:14:21.233075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2743/5375] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:21 2022] DELETE /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:14:21.353421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:21.358819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:21.368022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1088894897", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "1e8609f2-9aa0-4ab0-9237-6d4b63aae40f"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:21.369833 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d209083b-66b7-4713-8914-3e886a8afd2b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1316 microversion: 2.1 time: 0.244066 Aug 27 21:14:21.370673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2633/5376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:21 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:21.428205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] validate_networks() for [('1e8609f2-9aa0-4ab0-9237-6d4b63aae40f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:14:21.851906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:14:21.852432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:14:21.852898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:14:21.853312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:14:21.853728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:14:21.865243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.865646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.866090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.866823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:21.867299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:21.867816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:21.887015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:14:21.892685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Getting quotas for user 879bc0b8cc764e5ca6f7c75a34a86d5f and project b5e3c77a63d84df4a75a5fd94d02d23f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:14:21.905746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:14:21.908221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:14:21.957972 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9f38d15-efa5-4129-afe1-2f50be2aca9c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596096 Aug 27 21:14:21.958980 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2744/5377] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:14:21.971543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d84ecfa-7885-429a-9839-fcbf35e98921 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:21.973501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2d84ecfa-7885-429a-9839-fcbf35e98921 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.045685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:22.046762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.050886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2d84ecfa-7885-429a-9839-fcbf35e98921 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.053327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=11 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:22.058772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.059432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.060257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.060666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2d84ecfa-7885-429a-9839-fcbf35e98921 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1218 microversion: 2.1 time: 0.093950 Aug 27 21:14:22.062100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2634/5378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:21 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:22.062420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.063076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.063880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.147885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:22.148686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.154575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.157567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.158068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.158892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.159963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.161042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.161857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.164503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.165957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.167197 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6615ca0b-8258-4649-8765-ca043b4096cc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.125941 Aug 27 21:14:22.177427 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2745/5379] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:22 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:22.358269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.370032 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49a48cfe-925d-4464-b103-74ca0c80c525 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.224371 Aug 27 21:14:22.371025 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2635/5380] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:22 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:22.393957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:22.395787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.424495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.428475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.429884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.430529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.431094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.434025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.625910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.634792 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c90008c4-e047-412a-8925-f1e27e882b24 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1506 microversion: 2.1 time: 0.246337 Aug 27 21:14:22.636652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2746/5381] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:22 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:22.656412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:22.656999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.663526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.664125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.664770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.665689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.666356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.666867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.693824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:22.783181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-40c90a02-5d2c-4056-b2bf-f4da19211df2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 204 len: 0 microversion: 2.1 time: 0.130167 Aug 27 21:14:22.784642 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2636/5382] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:22 2022] DELETE /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:14:22.793638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:22.794683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:22.803380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.804308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.804851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.805666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:22.806173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:22.806919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:22.961413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:22.970937 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e90176bd-8902-4026-82fe-cb8ce57eb715 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1512 microversion: 2.1 time: 0.181639 Aug 27 21:14:22.971860 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2747/5383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:22 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:23.087216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:23.088532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:23.096277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.096813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.097484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.098347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.098820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.099242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.170716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:23.180055 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f801c44-033f-4faa-9b07-df8ab8cd6e0d tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1270 microversion: 2.1 time: 0.097239 Aug 27 21:14:23.180908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2637/5384] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:23 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:23.191717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:23.196417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:23.214974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.217106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.217564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.218303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.218758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.219189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.293633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:23.308745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:23.312137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:23.317193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c1fa542-6e8d-45e7-b278-de104fcd48da tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.126542 Aug 27 21:14:23.318168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2748/5385] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:23 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:23.391650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:23.393096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:23.399868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.400706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.401463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.403026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:23.403720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:23.404792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:23.554029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:23.563552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef709745-9af4-4cf9-a34d-fc3c683d9120 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.176092 Aug 27 21:14:23.564155 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2638/5386] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:23 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:23.992345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:23.992973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:24.006750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.007303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.007749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.008470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.011756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.011756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.203722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:24.205113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:24.211723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.212647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.213692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.214609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.215328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.215975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.378992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.392112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.394576 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c43eef76-3502-4ca0-82a4-31fbab4e0283 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1270 microversion: 2.1 time: 0.195964 Aug 27 21:14:24.396336 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2639/5387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:24 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:24.403238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6365b4a-a1d6-4867-862f-3321faab5544 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1512 microversion: 2.1 time: 0.414860 Aug 27 21:14:24.403859 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2749/5388] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:23 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:24.415028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:24.416745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:24.435680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.439510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.441038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.442434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.443179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.444014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.573574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.584878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:24.585519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:24.592936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.593161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.593426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.593856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.594458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.594696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:24.595154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:24.595600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:24.595774 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86e50f32-b27c-4f9a-88bd-486a01ff33dc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.198090 Aug 27 21:14:24.611261 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2640/5389] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:24 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:24.900010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:24.914622 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b7256544-4a42-406f-9a22-571deb32c763 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.333869 Aug 27 21:14:24.927371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2750/5390] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:24 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:24.999123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf6f0c6-298b-4a42-b82d-2550ac31cad0", "name": "network-vif-deleted", "tag": "c35613fc-96d7-4a01-83b4-a05561fedd72"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:25.020788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.031446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.032131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.063077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] Creating event network-vif-deleted:c35613fc-96d7-4a01-83b4-a05561fedd72 for instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 on nch1-master-1 Aug 27 21:14:25.070604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ad3f30ef-6e97-4b54-b468-12ab49a1d271 req-7ea98ee4-ce40-4f0d-8b9b-9e98c3b4f7e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075546 Aug 27 21:14:25.071205 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2641/5391] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:25.421213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:25.424165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:25.430158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:25.431662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:25.433058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.433710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.434303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.435237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.435865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.436496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.442380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.442890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.443481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.444202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.444663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.445098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.525864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:25.540829 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d27cf577-be7b-404f-88ab-0758d45f6940 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1276 microversion: 2.1 time: 0.123159 Aug 27 21:14:25.541715 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2751/5392] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:25 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:25.618511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:25.619132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:25.625829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.626326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.626978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.627922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.628208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.628804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.630626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:25.641242 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a9885b6-56f3-4369-b677-822a73e092c8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1512 microversion: 2.1 time: 0.216109 Aug 27 21:14:25.642465 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2642/5393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:25 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:25.697855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:25.709312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:25.712230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:25.714024 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aeb9b65a-9203-4294-8a4c-8957b42f99fc tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.099358 Aug 27 21:14:25.715831 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2752/5394] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:25 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:25.941043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:25.941721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:25.957060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.957685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.959904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:25.960710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:25.963491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:25.964259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.266332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d914b2-3d53-4cd5-920c-a5014c1cb579", "name": "network-vif-plugged", "status": "completed", "tag": "ae49cf36-2770-4b28-bdeb-0dc93c0a2f39"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:26.305272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.308050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.309080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.311138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.322284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa892c19-17ec-46d5-bb6c-ae283fb01836 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.388246 Aug 27 21:14:26.332238 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2643/5395] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:25 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:26.357824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] Creating event network-vif-plugged:ae49cf36-2770-4b28-bdeb-0dc93c0a2f39 for instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 on nch1-master-1 Aug 27 21:14:26.372433 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8378ee11-7408-482c-a2e8-e133a5c8d34b req-3dbe742a-4898-4ea9-908b-c62175b497cd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112795 Aug 27 21:14:26.373430 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2753/5396] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:14:26.565937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:26.566698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:26.573693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.575293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.575835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.576749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.577205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.577619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.665091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:26.666436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:26.674709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.675408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.676000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.676936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.677682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.678303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.722641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.723387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.724254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.724882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'fault' on Instance uuid a58099dc-f5d9-4350-989e-7c990c10442a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:14:26.807481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.819395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1d80484-514d-4a55-8004-007fd9976e2c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 200 len: 1306 microversion: 2.1 time: 0.160702 Aug 27 21:14:26.820182 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2754/5397] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:26 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:26.838912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:26.839971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:26.846771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.847584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.848284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.849345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:26.849989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:26.850569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:26.858777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.869760 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f40b87e9-0ea4-498f-bd96-d1a4ce9fb1ff tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.308580 Aug 27 21:14:26.892198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2644/5398] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:26 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:26.953419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.963604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.965181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:26.966392 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aaef5197-6377-4b37-a9d8-04cff01d9a5a tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.145112 Aug 27 21:14:26.966967 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2755/5399] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:26 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:27.104754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58099dc-f5d9-4350-989e-7c990c10442a", "name": "network-vif-deleted", "tag": "d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:27.122437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.123307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.123905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.137543 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] Creating event network-vif-deleted:d9a2aa43-7cc4-4a96-8e92-7c1fe0bf0a22 for instance a58099dc-f5d9-4350-989e-7c990c10442a on nch2-master-1 Aug 27 21:14:27.142951 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-61d9840a-1917-4d65-a629-3dabe570b3a7 req-02df4373-ce40-4027-8f23-39b256993883 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043762 Aug 27 21:14:27.143911 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2645/5400] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:14:27.344829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:27.345589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:27.352195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.352852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.353390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.354190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.354949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.355661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.537026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:27.546425 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91e1acb9-d83b-46a1-bdba-8dc0d4ae740a tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1364 microversion: 2.1 time: 0.205569 Aug 27 21:14:27.547252 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2756/5401] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:27 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:27.851826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:27.852711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:27.863014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.865384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.865957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.867297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.867784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.868219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.886396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a HTTP/1.1 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a58099dc-f5d9-4350-989e-7c990c10442a'} Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:27.888417 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eea1ffcd-523c-4ef9-a5a8-8825083f87e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 404 len: 111 microversion: 2.1 time: 0.046928 Aug 27 21:14:27.894561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2646/5402] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:27 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:27.900692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:27.901461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:27.909400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.910086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.910329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:27.910871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.911084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:27.911790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.912314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.912965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.918824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.918824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.918824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:27.919847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:27.920373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:27.920872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.196006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.200125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.210442 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fd312f61-e830-4061-9fbf-44c3c4085a69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.303984 Aug 27 21:14:28.223364 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-726b210f-5edc-4d0f-a970-fe7fe9e051f9 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.315133 Aug 27 21:14:28.223364 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2757/5403] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:27 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:28.224157 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2647/5404] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:27 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:28.233118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:28.234356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:28.244438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.245326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.246694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.247674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.248424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.249006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.334114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.338216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:28.344541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.345508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed8cc925-ae20-450f-9c2d-eb86570cca40 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:28.345999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.347197 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1cf63024-f0ab-4f29-9ea3-b4dc5f5a846b tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.131297 Aug 27 21:14:28.347986 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2758/5405] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:28 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed8cc925-ae20-450f-9c2d-eb86570cca40 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 163 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": 12345, "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 12345 Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:28.349947 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 21:14:28.355258 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:28.357866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed8cc925-ae20-450f-9c2d-eb86570cca40 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:28.358809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed8cc925-ae20-450f-9c2d-eb86570cca40 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019277 Aug 27 21:14:28.359868 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2648/5406] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:28 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:28.368952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:28.369579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:28.377096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.377711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.378245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.379028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.379592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.380090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.545365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.554014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fed46d3f-9108-485c-9ee0-72d7d1e1364e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.189132 Aug 27 21:14:28.554804 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2759/5407] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:28 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:28.578291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:28.579251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:28.579881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:28.580783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:28.586620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.587601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.588405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.589226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.589685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.590321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.607078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.609111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.609798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.611799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.612905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.614384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.847722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.864068 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b9d0ef2e-ea98-4a01-b5a2-59b502325516 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.289640 Aug 27 21:14:28.865440 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2760/5408] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:28 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:28.870193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:28.887841 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e42cea64-92c6-4d11-bd62-1c35e7544886 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1549 microversion: 2.1 time: 0.318844 Aug 27 21:14:28.889035 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2649/5409] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:28 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1549 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:28.913674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:28.914387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:28.922255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.922606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.923047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:28.923792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:28.924245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:28.924663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.185089 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bb2914e-88cf-4d2f-96eb-cd02e83834f8 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275648 Aug 27 21:14:29.189535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2ecb37-e181-478a-879d-0b6967486c8a", "tag": "ed989c8b-76c5-45e7-a222-2e17e79b9b25"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:29.199546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2761/5410] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:14:28 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-interface => generated 285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:29.223776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:29.224263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:29.224696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.237016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:29.238313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:29.254073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:29.254566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:29.254995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.257784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:29.258584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:29.262643 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] Creating event network-changed:ed989c8b-76c5-45e7-a222-2e17e79b9b25 for instance 5a2ecb37-e181-478a-879d-0b6967486c8a on nch2-master-1 Aug 27 21:14:29.263494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.282036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-26adf737-71be-499d-9dc6-b999bdb0499a req-153a8134-cff6-4b5e-a95e-50c74a381e86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101936 Aug 27 21:14:29.284208 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2650/5411] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:29.375269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:29.377355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:29.385638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:29.386793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:29.388293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.389950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:29.391049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:29.392033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:29.629271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:29.669239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:29.678919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:29.681992 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1d6aa7b-0fa9-4a0f-8efc-10a8a4808fda tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1408 microversion: 2.54 time: 0.313527 Aug 27 21:14:29.682826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2651/5412] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:29 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:29.872937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:29.890103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bcb01968-ce74-4312-95ee-4dd2015259f5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.658797 Aug 27 21:14:29.896044 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2762/5413] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:29 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:30.709928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:30.710718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:30.721847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:30.724760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:30.727227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:30.728378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:30.731283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:30.731995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:30.810729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc001123-b476-401b-8869-7e09a759b0ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929013870", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "243c58b5-d48f-4f79-bb94-6ae6a0febe12", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:30.955200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:30.976940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:30.982594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:30.986770 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a6f6939-fa4b-4ce4-bb8c-4b4e452859e5 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1414 microversion: 2.54 time: 0.281849 Aug 27 21:14:30.990081 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2652/5414] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:30 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1414 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:31.007761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:31.008688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:31.019926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.020724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.021346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.022556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.023491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.024966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.084453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-dc001123-b476-401b-8869-7e09a759b0ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. Aug 27 21:14:31.093673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc001123-b476-401b-8869-7e09a759b0ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 357 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-929013870", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "243c58b5-d48f-4f79-bb94-6ae6a0febe12", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: exception: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-929013870', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '243c58b5-d48f-4f79-bb94-6ae6a0febe12'}], 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:31.096606 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc001123-b476-401b-8869-7e09a759b0ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Block Device 243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not bootable. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:31.101911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc001123-b476-401b-8869-7e09a759b0ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.302194 Aug 27 21:14:31.103526 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2763/5415] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:31.108931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:31.109555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:31.124991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.125496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.125939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.126654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.133987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.134843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.313642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:31.332681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f642b267-7a37-4edb-aca1-e28e844dc5b6 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.338761 Aug 27 21:14:31.333588 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2653/5416] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:30 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:31.351731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d914b2-3d53-4cd5-920c-a5014c1cb579", "tag": "ae49cf36-2770-4b28-bdeb-0dc93c0a2f39"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:31.362081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.362838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.363517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.377238 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] Creating event network-changed:ae49cf36-2770-4b28-bdeb-0dc93c0a2f39 for instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 on nch1-master-1 Aug 27 21:14:31.382876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e25c84d4-d776-41ac-b257-9cefb4c18eac req-1e4cdaff-dd5e-47fc-8cf6-9c601160ebd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Aug 27 21:14:31.384397 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2654/5417] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:31.397878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:31.412944 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-680fff04-7d36-46cd-9eb6-5f30541506f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.309217 Aug 27 21:14:31.434330 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2764/5418] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:31.443844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:31.445904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:31.454063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.454958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.455210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.456423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:31.457014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:31.457696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:31.635901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:31.647142 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3af86fd4-0c8e-4ab0-9703-16bf50d9eb8c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.209647 Aug 27 21:14:31.648156 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2655/5419] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:32.016574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:32.017774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:32.027111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:32.029165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=22 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:32.031785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:32.035993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:32.038592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:32.040451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:32.041146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:32.041875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:32.153643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:32.164116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:32.171894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:32.179700 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cd24147-6edc-4692-95f8-39013d5222b8 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1414 microversion: 2.54 time: 0.167507 Aug 27 21:14:32.183186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2765/5420] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:32 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:14:32.354374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:32.355159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:32.384751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:32.388294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:32.389029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:32.389554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:32.390450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:32.390931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:32.391683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:32.580016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:32.589663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7b27703-f4ae-4590-bfcc-7dcf2eff5f6b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.239178 Aug 27 21:14:32.590935 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2656/5421] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:32 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:33.211581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:33.212670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:33.232172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.234233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.235879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.240180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.241125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.241836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.276888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66001d37-d427-4e7f-87c4-df5941ab9325 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1032010220", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "destination_type": "local"}, {"source_type": "volume", "uuid": "7df4d62a-058f-4e7c-ac49-6e122cfad404", "destination_type": "invalid"}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66001d37-d427-4e7f-87c4-df5941ab9325 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 495 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1032010220", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "destination_type": "local"}, {"source_type": "volume", "uuid": "7df4d62a-058f-4e7c-ac49-6e122cfad404", "destination_type": "invalid"}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1032010220', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '7df4d62a-058f-4e7c-ac49-6e122cfad404', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:33.281694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:33.286461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66001d37-d427-4e7f-87c4-df5941ab9325 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:33.293397 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66001d37-d427-4e7f-87c4-df5941ab9325 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.025053 Aug 27 21:14:33.320069 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2657/5422] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:33 2022] POST /compute/v2.1/servers => generated 155 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:33.326294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:33.328001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:33.352681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.353195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.353653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.354454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.360985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.361541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.522031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:33.531661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:33.533099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:33.534294 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb0dce79-6a0f-44c4-b540-a20e07f6abaf tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1414 microversion: 2.54 time: 0.328559 Aug 27 21:14:33.547972 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2766/5423] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:33 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1414 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:33.610354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:33.611410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:33.621432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.622179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.622774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.623705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.624315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.624894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.674461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:33.682793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2e7bafd-1ebe-4269-b119-f55266569443 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.360792 Aug 27 21:14:33.683441 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2658/5424] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:33 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:33.709820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:33.710513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:33.719532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.720189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.721075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.721906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:33.722713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:33.723251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:33.955825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:33.964917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f05c0d63-7d4f-406f-9feb-90d9fd242ebd tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.358263 Aug 27 21:14:33.966083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2767/5425] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:33 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:34.038345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.048201 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fdad0c55-4550-41ca-a39b-d369171845cb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.342838 Aug 27 21:14:34.059438 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2659/5426] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:33 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:34.116537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9abae63-4090-4159-86a7-888697f202e0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-727741547", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9abae63-4090-4159-86a7-888697f202e0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 491 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-727741547", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-727741547', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.121935 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9abae63-4090-4159-86a7-888697f202e0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9abae63-4090-4159-86a7-888697f202e0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.012158 Aug 27 21:14:34.129254 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2768/5427] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:34.136115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:34.137177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:34.143490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.144050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.144553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.145384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.145826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.146351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.358633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.368725 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-809e3150-6c12-4163-ab1a-22f43083d5d6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.237708 Aug 27 21:14:34.382412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2660/5428] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:34 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:34.392615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:34.394701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:34.400585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:34.408065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.408765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.409216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.409941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.410402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.410882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.559609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:34.560231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:34.567563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.568059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.568484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.569401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.569860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.570288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.602663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.612539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb828f11-fe69-4975-97a8-ae5b34209279 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.225005 Aug 27 21:14:34.613260 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2769/5429] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:34 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:34.644015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.652945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.654656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:34.657189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a5ef9e9-033b-44a4-adb4-404e13c2c8f9 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1414 microversion: 2.54 time: 0.102443 Aug 27 21:14:34.658067 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2661/5430] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:34 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:34.696014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1f21bac-c6d8-4c71-95f2-0adfc84475a1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1f21bac-c6d8-4c71-95f2-0adfc84475a1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 416 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.699853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:14:34.704297 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:34.707797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1f21bac-c6d8-4c71-95f2-0adfc84475a1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:34.708876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1f21bac-c6d8-4c71-95f2-0adfc84475a1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.017318 Aug 27 21:14:34.709470 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2770/5431] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:34 2022] POST /compute/v2.1/servers => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:34.718658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:34.719460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:34.723758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:34.729905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.730631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.731456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.732763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:34.734190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:34.734830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:34.986827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:34.987384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.016190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.017016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.017676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.018588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.019214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.019848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.053656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.063099 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cad0a073-49ed-4403-a9e8-4a1955820100 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.348575 Aug 27 21:14:35.068487 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2662/5432] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:34 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:35.093383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.094298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.101895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.102397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.102837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.103603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.104315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.104819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.335890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.345289 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8653a815-58d8-42a9-b894-01c3ff3ecfa2 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.361744 Aug 27 21:14:35.345997 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2771/5433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:34 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:35.387260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.396291 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8a2f5ac-954e-4f50-8786-155cb0b492bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.306921 Aug 27 21:14:35.400430 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2663/5434] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:35 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:35.463440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81996ad4-5a8c-4672-9966-85b80d824330 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1517808045", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": -1, "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:35.476941 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-81996ad4-5a8c-4672-9966-85b80d824330 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81996ad4-5a8c-4672-9966-85b80d824330 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 206 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1517808045", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": -1, "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: exception: Flavor -1 could not be found. Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1517808045', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': -1, 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:35.478994 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81996ad4-5a8c-4672-9966-85b80d824330 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81996ad4-5a8c-4672-9966-85b80d824330 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.021478 Aug 27 21:14:35.489029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2772/5435] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:14:35.498844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.499514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.505672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.506565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.507007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.507759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.508404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.508834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.543171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2ecb37-e181-478a-879d-0b6967486c8a", "name": "network-vif-plugged", "status": "completed", "tag": "ed989c8b-76c5-45e7-a222-2e17e79b9b25"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:35.555814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.556342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.556777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.567866 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] Creating event network-vif-plugged:ed989c8b-76c5-45e7-a222-2e17e79b9b25 for instance 5a2ecb37-e181-478a-879d-0b6967486c8a on nch2-master-1 Aug 27 21:14:35.573205 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c74fc1ee-0d51-4eeb-b1e6-2d205b82fbc9 req-4e85800b-1fa2-4fbd-b1e8-dfe7003c373b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034913 Aug 27 21:14:35.573905 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2773/5436] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:35.684841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.685782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.693069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.693706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.694244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.695605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.696022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.696602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.787163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.795621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.797303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.799030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:35.800475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02245812-cd00-4689-97ad-c358de6ecae3 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1399 microversion: 2.54 time: 0.120438 Aug 27 21:14:35.801151 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2774/5437] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:35 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1399 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:35.805727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4f6e58af-fb16-405b-9c1f-3ce2f364ee58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.311791 Aug 27 21:14:35.806351 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2664/5438] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:35 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:35.831416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-244beb78-215a-4e90-aadf-8af849cc73d7 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '.version_select at 0x7ff84dcadb80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.834115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.834751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.842488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.843115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.843580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.844505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.845261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.853867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.855009 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-244beb78-215a-4e90-aadf-8af849cc73d7 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-657269319" status: 204 len: 0 microversion: 2.54 time: 0.027462 Aug 27 21:14:35.855779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2775/5439] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:14:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-657269319 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:14:35.869372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:35.870397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:35.876951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.877444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.878068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.878993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:35.879667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:35.880271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:35.908570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:36.031116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9c59304-b3ae-4500-a886-9b2eee3af230 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 204 len: 0 microversion: 2.54 time: 0.166501 Aug 27 21:14:36.032466 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2776/5440] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:14:35 2022] DELETE /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:14:36.045357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.046398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.053269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.062387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.063026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.063666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.064402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.065061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.065503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.067886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f297e781-2579-43c5-9f63-242e227072d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.237504 Aug 27 21:14:36.068584 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2665/5441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:35 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:36.138248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07a9ec0f-1b98-42e9-abf6-640bb377af30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1078743286", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07a9ec0f-1b98-42e9-abf6-640bb377af30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 173 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1078743286", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1078743286', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi -1 Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:36.142393 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-07a9ec0f-1b98-42e9-abf6-640bb377af30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:36.147155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-07a9ec0f-1b98-42e9-abf6-640bb377af30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009966 Aug 27 21:14:36.151796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.152003 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2666/5442] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:36 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:14:36.152355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.153528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.156310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.157757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.158946 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15601228-b70a-4054-a31c-d67ab8a6aa86 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1405 microversion: 2.54 time: 0.121562 Aug 27 21:14:36.161185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.161793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.162353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.163170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.163777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.164302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.169107 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2777/5443] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:36.302237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.311118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-069ade5a-efd6-477e-9057-6e1a4c9d6fe8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.162448 Aug 27 21:14:36.311821 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2667/5444] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:36.332405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.333022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.339918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.340411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.340852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.341616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.342011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.342433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.367772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.368398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.374906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.375402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.375854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.376568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.377059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.377456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.569725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.574204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.578568 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f17903d-c3d6-4991-8053-4df33c00f4cc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.249782 Aug 27 21:14:36.579180 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2778/5445] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:36.583604 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-752292b1-216a-4ea3-83a2-1bd566240ca0 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1318 microversion: 2.1 time: 0.219695 Aug 27 21:14:36.584299 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2668/5446] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:36.641846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a8e6d3f-3195-4170-aed4-2b0edf08b1f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-28308399", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:36.646807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2a8e6d3f-3195-4170-aed4-2b0edf08b1f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a8e6d3f-3195-4170-aed4-2b0edf08b1f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 214 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-28308399", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-28308399', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.648770 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2a8e6d3f-3195-4170-aed4-2b0edf08b1f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2a8e6d3f-3195-4170-aed4-2b0edf08b1f0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012442 Aug 27 21:14:36.654727 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2779/5447] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:36.660107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.660814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.668131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.668888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.669583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.670491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.671115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.671770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.822595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:36.830485 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d29d43b-5d7e-4390-86aa-e2c1ee79bfd1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.174419 Aug 27 21:14:36.831243 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2669/5448] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:36.852999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:36.853544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:36.861605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.862102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.862545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.863243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:36.863743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:36.864171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:36.998393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.002170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:37.007542 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-495005a3-a631-4a71-8b26-a4580456b4b6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.158517 Aug 27 21:14:37.008096 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2780/5449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:37.067766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2100670049", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-key-1064483372", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:37.126475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] validate_networks() for [('d9208a18-551f-4b8c-a16f-084f27b88dfe', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:14:37.184908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:37.185516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:37.206896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.209501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.216803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.217535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.218564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.218564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.319195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.339398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.341201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b504c000bf7a47a0810394eaa8c21088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81795f5e2c404467a5b67f817e22f654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.342744 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-10e05b81-0bb7-45bc-b404-3d049cba6639 tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 200 len: 1405 microversion: 2.54 time: 0.162174 Aug 27 21:14:37.351477 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2781/5450] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:37 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:14:37.406377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Invalid key_name provided. Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 247 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2100670049", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-key-1064483372", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid key_name provided. Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2100670049', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'key_name': 'tempest-key-1064483372', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1064483372 not found for user fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:37.408788 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid key_name provided. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4df7081e-0ac3-4f9a-9c8c-f7e21c1b158b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.347156 Aug 27 21:14:37.413535 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2670/5451] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:37 2022] POST /compute/v2.1/servers => generated 70 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 21:14:37.426077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:37.435382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:37.442100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.444376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.444581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.446461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.446883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.447322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.605962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:37.606591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:37.613715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.614847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.615286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.615890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.616598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.617100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.617527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.623972 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c002e575-3f99-40f6-87b4-19bd47e6ff12 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.205933 Aug 27 21:14:37.624578 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2782/5452] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:37 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:37.644848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:37.645464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:37.651885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.652469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.652906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.653700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.654151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.654539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.901425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.909817 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-26d1a35e-b030-4ab0-92a3-33f7b87a3715 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1509 microversion: 2.1 time: 0.308020 Aug 27 21:14:37.910756 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2671/5453] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:37 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:37.923894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:37.930919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:37.931573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:37.933844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a03a6de9-2361-46d5-9544-8606fc881e8b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.292637 Aug 27 21:14:37.934760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2783/5454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:37 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:37.947715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.948352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.948800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.949518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:37.949981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:37.950411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:37.998928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1100603102", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:38.149467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.security_group_api [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Neutron security group does_not_exist not found {{(pid=140434) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 21:14:38.150203 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 258 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1100603102", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1100603102', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 21:14:38.192153 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.198241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:38.203592 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93a1537f-60fe-49b7-b78d-fd3dab6f3870 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.200044 Aug 27 21:14:38.203592 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2784/5455] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:37 2022] POST /compute/v2.1/servers => generated 106 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:14:38.205250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:38.216627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:38.217517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:38.223061 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c113c302-fda2-43a9-8cca-8d9d4814326f tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1509 microversion: 2.1 time: 0.296099 Aug 27 21:14:38.223923 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2672/5456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:37 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:38.227572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.228149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.228691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.229672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.230251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.230786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.243734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:38.247039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:38.254751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.255216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.255814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.256743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.257366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.258134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.296354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:38.343182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d92c841-40d0-4e8c-a18c-2a5060c5c179 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "PUT /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1081 microversion: 2.1 time: 0.103420 Aug 27 21:14:38.344243 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2673/5457] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:14:38 2022] PUT /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1081 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:38.363393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:38.364239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:38.371068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.371677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.372188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.373106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.373568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.374003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.886311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:38.896678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8267671f-8750-47b3-859f-6a63aca7cba9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.690011 Aug 27 21:14:38.898409 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2785/5458] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:38 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:38.904012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:38.904845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] [instance: ec15d9ff-f527-49ee-9b94-865ec61698f6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:38.911547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.912271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.912716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.913535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.914196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.914853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.932372 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] HTTP exception thrown: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Request method failure captured: Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 HTTP/1.1 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokSd-TCWCvJiWIQLwmXU_KO_vdSqnnPLcT8c_eMlew4LzBcC3HDWpYpJZkzK7zf9MHIjfow2NNrJSMUuIomai37yqL2w7_ZApnh1OjfbOzbVRdGX5D_TZox2CJeOrQ0Y7ZrNMjAq8WuGXvxsTLbREa7fCIMu5e41rampFMLTptLAeU Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 81795f5e2c404467a5b67f817e22f654 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerShowV254Test-1936147835 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81795f5e2c404467a5b67f817e22f654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/81795f5e2c404467a5b67f817e22f654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_81795f5e2c404467a5b67f817e22f654", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/81795f5e2c404467a5b67f817e22f654"}]}] Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerShowV254Test-1936147835 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 81795f5e2c404467a5b67f817e22f654 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerShowV254Test-1936147835 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerShowV254Test-1936147835-project Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: b504c000bf7a47a0810394eaa8c21088 Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerShowV254Test-1936147835-project Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ec15d9ff-f527-49ee-9b94-865ec61698f6'} Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:38.934914 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. Aug 27 21:14:38.940948 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:38.941835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] Returning 404 to user: Instance ec15d9ff-f527-49ee-9b94-865ec61698f6 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:38.943483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b24fc608-0437-4563-8e44-6bbbda7f074c tempest-ServerShowV254Test-1936147835 tempest-ServerShowV254Test-1936147835-project] 10.222.0.40 "GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6" status: 404 len: 111 microversion: 2.54 time: 0.043121 Aug 27 21:14:38.944343 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2786/5459] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:14:38 2022] GET /compute/v2.1/servers/ec15d9ff-f527-49ee-9b94-865ec61698f6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:38.976188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:38.977170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:38.987236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.987999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.989686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:38.990608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:38.991239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:38.991857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.035046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:39.046921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d928fd8-ed2f-4c3a-ae3f-03f169e14f2c tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1507 microversion: 2.1 time: 0.687644 Aug 27 21:14:39.048069 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2674/5460] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:38 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:39.067647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.069005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.076145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.076790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.077334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.078156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.078735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.079325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.298590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:39.311307 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b417604b-e522-4c27-ab69-f541d084c3ee tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.365536 Aug 27 21:14:39.312993 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2787/5461] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:38 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:39.341280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.342150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 625517e7-9325-4fa5-a539-3f2e7d1e9055] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.348318 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. Aug 27 21:14:39.349569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/625517e7-9325-4fa5-a539-3f2e7d1e9055 HTTP/1.1 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '625517e7-9325-4fa5-a539-3f2e7d1e9055'} Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:39.350307 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 625517e7-9325-4fa5-a539-3f2e7d1e9055 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f89ae5c-5222-4978-a0ea-00410a57ebca tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/625517e7-9325-4fa5-a539-3f2e7d1e9055" status: 404 len: 111 microversion: 2.1 time: 0.016845 Aug 27 21:14:39.358772 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2788/5462] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:39 2022] DELETE /compute/v2.1/servers/625517e7-9325-4fa5-a539-3f2e7d1e9055 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:39.366032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.366665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.374752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.375740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.376624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.377884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.378992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.380306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.380451 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-792268ff-896f-4a78-9187-5d8a6c6d58c8 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1507 microversion: 2.1 time: 0.315861 Aug 27 21:14:39.380451 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2675/5463] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:39 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:39.401831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:39.404603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.424952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.425674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.427384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.427384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.427976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.428610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.506915 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4340650a-bd58-44b1-96d9-8077c1f6255b tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "PUT /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1083 microversion: 2.1 time: 0.109215 Aug 27 21:14:39.519216 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2676/5464] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:14:39 2022] PUT /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1083 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:39.528278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.529315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.538047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.538564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.539215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.540270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.541078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.541638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.690108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:39.732223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cb3c92d-53cb-4a28-a42a-baaf2154f881 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.373137 Aug 27 21:14:39.733596 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2789/5465] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:39 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:39.755868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.756490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.763977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.764989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.765596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.767196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.768397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.769125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.855066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:39.863603 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-91f64e01-b11c-48fb-ade1-423be958331a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1509 microversion: 2.1 time: 0.340715 Aug 27 21:14:39.879287 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2677/5466] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:39 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:39.884575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:39.885586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:39.892367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.893161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.893772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:39.894675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:39.895463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:39.896281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.178880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:40.188561 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c86e6212-a1bf-4f19-8581-8ffb779aef9c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.436861 Aug 27 21:14:40.189317 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2790/5467] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:39 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:40.217246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.217991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 21:14:40.218506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 9223372036854775808 could not be found. Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '9223372036854775808'} Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.220006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed51ccde-a378-4611-b420-0fed098a18bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008554 Aug 27 21:14:40.224562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2791/5468] 10.222.0.40 () {58 vars in 1188 bytes} [Sat Aug 27 21:14:40 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 21:14:40.232248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.232248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.239655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:40.242409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.243275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.243541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.244114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.244560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.245039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.248337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2268be90-8ee6-4a09-8e52-2192e243ad2a tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1509 microversion: 2.1 time: 0.367775 Aug 27 21:14:40.248912 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2678/5469] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:39 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:40.269746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.270629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.284111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.284737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.285292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.286127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.286691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.287381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.330272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:40.471884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:40.486622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1b2de4ac-f8ef-402e-ae90-7c7eb92ae2db tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 204 len: 0 microversion: 2.1 time: 0.221901 Aug 27 21:14:40.492271 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2679/5470] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:40 2022] DELETE /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:14:40.492448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78714671-f53f-40d1-8d1e-fff31c2a7c81 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.262045 Aug 27 21:14:40.492448 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2792/5471] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:40 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:40.500691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.501288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.508970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.509463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.509896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.511590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.512070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.512551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.514951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.516412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.526712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.527285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.527772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.528568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.529533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.529978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.540988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:14:40.605228 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.compute.api [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Instance is already in deleting state, ignoring this request Aug 27 21:14:40.606264 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c680244-a3df-422e-9647-e4d26cbb8a58 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 204 len: 0 microversion: 2.1 time: 0.110107 Aug 27 21:14:40.607588 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2680/5472] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:40 2022] DELETE /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:14:40.615714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.617229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.629047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.629047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.629407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.630017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.630475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.630917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.781533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:40.809746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fdf03c0c-448f-4790-82ea-8cb757abc61a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.299392 Aug 27 21:14:40.811063 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2793/5473] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:40 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:40.834200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.834200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Failed to fetch instance by id -1 {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 21:14:40.834844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance -1 could not be found. Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '-1'} Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:40.836794 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9399116-7999-4785-94b5-c0c7c26711af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.011168 Aug 27 21:14:40.844350 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2794/5474] 10.222.0.40 () {58 vars in 1137 bytes} [Sat Aug 27 21:14:40 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:14:40.850783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:40.851866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:40.865104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.866697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.867482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.868709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:40.869415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:40.870298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:40.876437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:40.884550 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3ea587f-909f-4c55-bec0-f2c7265977d7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1515 microversion: 2.1 time: 0.272914 Aug 27 21:14:40.885899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2681/5475] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:40 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:41.029546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:41.042254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1af65a8d-5044-48c1-ad63-ecdf14afadde tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.196096 Aug 27 21:14:41.042849 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2795/5476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:40 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:41.070499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:41.071110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:41.077845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.078329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.078761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.079494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.079932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.080349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.216092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:41.224978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b50d02e7-5964-4a7b-80dd-df54dabf76f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.158385 Aug 27 21:14:41.225571 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2682/5477] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:41 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:41.247137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:41.247737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 029e89dc-c4d5-4962-9660-74ae3a3eb271] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:41.253768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/029e89dc-c4d5-4962-9660-74ae3a3eb271/action HTTP/1.1 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 19 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: {"forceDelete": {}} Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '029e89dc-c4d5-4962-9660-74ae3a3eb271', 'body': {'forceDelete': {}}} Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:41.259377 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 029e89dc-c4d5-4962-9660-74ae3a3eb271 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-756dd1b6-25df-41ce-9d4e-74bdda7959e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/029e89dc-c4d5-4962-9660-74ae3a3eb271/action" status: 404 len: 111 microversion: 2.1 time: 0.018685 Aug 27 21:14:41.264192 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2796/5478] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:41 2022] POST /compute/v2.1/servers/029e89dc-c4d5-4962-9660-74ae3a3eb271/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:14:41.270244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:41.270985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:41.278070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.278996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.279502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.280209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.280684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.281116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.557689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:41.573910 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2150543c-9c20-473b-a97b-5fbe43d5d5b0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.307070 Aug 27 21:14:41.574594 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2683/5479] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:41 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:41.596373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:41.597299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:41.609104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.609829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.610276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.611297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.611924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.612359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.906890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:41.907660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:41.914838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.915425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.915934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.916914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:41.917920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:41.918419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:41.959676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:41.968705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c30c1c9d-6e96-4610-bab8-7b6c80a9d0f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.376609 Aug 27 21:14:41.969827 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2797/5480] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:41 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:41.997951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:42.000338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 54ae7808-43ce-42f5-a425-0872699e3ad6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:42.015671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/54ae7808-43ce-42f5-a425-0872699e3ad6/action HTTP/1.1 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 39 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: {"os-getConsoleOutput": {"length": 10}} Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '54ae7808-43ce-42f5-a425-0872699e3ad6', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.025665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 54ae7808-43ce-42f5-a425-0872699e3ad6 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:42.032234 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1f86abc-9beb-49cd-af30-c56091654786 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/54ae7808-43ce-42f5-a425-0872699e3ad6/action" status: 404 len: 111 microversion: 2.1 time: 0.034152 Aug 27 21:14:42.034031 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2798/5481] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:41 2022] POST /compute/v2.1/servers/54ae7808-43ce-42f5-a425-0872699e3ad6/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:42.043546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:42.045724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:42.061953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.062502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.063146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.063882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.065637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.066073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.253077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:42.268556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5881b643-1a85-4051-9fa4-624796449e32 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1515 microversion: 2.1 time: 0.364497 Aug 27 21:14:42.269506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2684/5482] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:41 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:42.305382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:42.315106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d396eabd-e48d-4398-af89-727c742d9f66 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.279714 Aug 27 21:14:42.315769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2799/5483] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:42 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:42.345369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:42.345868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:42.355073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.360680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.361643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.362570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.366428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.366892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.631201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:42.641323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87099873-c00c-47b4-b865-63124b0cea69 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.300215 Aug 27 21:14:42.642664 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2685/5484] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:42 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:42.662862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:42.664132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:42.675025 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd HTTP/1.1 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd'} Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:42.677020 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:42.681558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:42.681558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:42.681558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:42.681558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. Aug 27 21:14:42.681558 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:42.684951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:42.686091 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d13c4339-ee1f-4e55-8a0a-d200e414347e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd" status: 404 len: 111 microversion: 2.1 time: 0.027859 Aug 27 21:14:42.687255 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2800/5485] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:42 2022] GET /compute/v2.1/servers/bdf5bf06-7aa1-4ace-b667-8e4fe9c0e7bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:42.696458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:42.697411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:42.706090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.706945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.707768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.708872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:42.709583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:42.710209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:42.717756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:42.978090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:43.010368 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1b8c198-78f0-430e-b211-e5fdf3e78dfb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.318489 Aug 27 21:14:43.027003 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2686/5486] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:42 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:43.032312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:43.033203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:43.044768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.045627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.046234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.047119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.047777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.048365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.290442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:43.291670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:43.293049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:43.299994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.302026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.302698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.304064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.305015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.305685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.317354 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78f0bd72-c7b8-47b5-ba5b-96dd99eaf342 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.288957 Aug 27 21:14:43.323611 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2801/5487] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:43 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:43.398764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:43.407649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-302d6aea-be8e-4b86-a6f5-73a7c3c5f1c3 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1473 microversion: 2.1 time: 0.121097 Aug 27 21:14:43.423645 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2687/5488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:43 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1473 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:43.460788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f94576e9-a0c1-45fb-b645-292a5cf59dcb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-509960290", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f94576e9-a0c1-45fb-b645-292a5cf59dcb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 237 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-509960290", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-509960290', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.478481 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f94576e9-a0c1-45fb-b645-292a5cf59dcb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:43.484563 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f94576e9-a0c1-45fb-b645-292a5cf59dcb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025952 Aug 27 21:14:43.492428 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2802/5489] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:43.493654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:43.494282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:43.506663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.507292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.507994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.510395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.511836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.512298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.640866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2ecb37-e181-478a-879d-0b6967486c8a", "name": "network-vif-deleted", "tag": "ed989c8b-76c5-45e7-a222-2e17e79b9b25"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:43.666556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.667633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.668073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.689024 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] Creating event network-vif-deleted:ed989c8b-76c5-45e7-a222-2e17e79b9b25 for instance 5a2ecb37-e181-478a-879d-0b6967486c8a on nch2-master-1 Aug 27 21:14:43.695427 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b9797877-32bf-4f1d-a8a7-d413b1687972 req-e3fec276-b9d7-4d3f-bb6e-3e8d774dc2b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059376 Aug 27 21:14:43.696601 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2803/5490] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:14:43.834267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:43.847971 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cdbeca20-dfcc-4de7-bd4d-94c021527d54 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.358328 Aug 27 21:14:43.848606 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2688/5491] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:43 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:43.882311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:43.884290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:43.898568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.899119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.901323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:43.903482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:43.905904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:43.908423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.430139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:44.432320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:44.433813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:44.442071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:44.443026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:44.444250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.449448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:44.450246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:44.450865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.453845 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a11c9529-5ee2-4826-8a2a-f75f8708f9bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.587863 Aug 27 21:14:44.457799 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2804/5492] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:43 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:44.516561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:44.517357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:44.517966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.519374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lazy-loading 'fault' on Instance uuid 5a2ecb37-e181-478a-879d-0b6967486c8a {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:14:44.545121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49f5c0a9-0f0b-40a8-a76e-7aecd02fafe9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-331573627", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49f5c0a9-0f0b-40a8-a76e-7aecd02fafe9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 234 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-331573627", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-331573627', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.550190 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49f5c0a9-0f0b-40a8-a76e-7aecd02fafe9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49f5c0a9-0f0b-40a8-a76e-7aecd02fafe9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011470 Aug 27 21:14:44.558915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2805/5493] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:44 2022] POST /compute/v2.1/servers => generated 133 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:44.569899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:44.570782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:44.579819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:44.580635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:44.581259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.582315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:44.582940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:44.583565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:44.923877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '879bc0b8cc764e5ca6f7c75a34a86d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e3c77a63d84df4a75a5fd94d02d23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:44.931960 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-913f269c-c259-4a2a-b41b-503c1de85839 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 200 len: 1308 microversion: 2.1 time: 0.505718 Aug 27 21:14:44.933523 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2689/5494] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:44 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:45.132122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:45.140686 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c79d456-0451-496c-a036-3240ad4ae43c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.574989 Aug 27 21:14:45.141442 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2806/5495] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:44 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:45.163853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:45.164671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:45.173104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.173741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.174515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.175555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.176800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.177613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.517211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:45.525641 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f49dc3e-e313-4eaf-a95e-f0159a1743b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.366971 Aug 27 21:14:45.527062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2690/5496] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:45 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:45.547959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:45.549207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: b0a94d8e-ff53-4314-abd8-d4f5e79978a6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:45.555833 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/b0a94d8e-ff53-4314-abd8-d4f5e79978a6/action HTTP/1.1 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 13 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: {"pause": {}} Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b0a94d8e-ff53-4314-abd8-d4f5e79978a6', 'body': {'pause': {}}} Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:45.561527 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance b0a94d8e-ff53-4314-abd8-d4f5e79978a6 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7415f4a6-b3ef-4908-9933-f42ee44ab0b1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/b0a94d8e-ff53-4314-abd8-d4f5e79978a6/action" status: 404 len: 111 microversion: 2.1 time: 0.019357 Aug 27 21:14:45.567168 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2807/5497] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:45 2022] POST /compute/v2.1/servers/b0a94d8e-ff53-4314-abd8-d4f5e79978a6/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:45.574217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:45.575201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:45.582011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.582569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.583081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.583902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.584432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.584929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.796015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:45.809825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70862df6-f91c-44fc-9c01-19523a71bba5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.240383 Aug 27 21:14:45.811435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2691/5498] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:45 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:45.831766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:45.832664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:45.841541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.842272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.842874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.843810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.844263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.844880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.964467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:45.965616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 5a2ecb37-e181-478a-879d-0b6967486c8a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:45.981477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.981477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.982441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:45.983410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:45.983912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:45.984341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.004392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] HTTP exception thrown: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Request method failure captured: Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a HTTP/1.1 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi1rH_UckAaBGx-_rFsI-Plc-cR3zPdd87L7FwFqyJl31XGDy2LfUdrNYTZO7E3ixHeziorQBo46EOitcKePCHUGTWI60Glio8V0_vgtsRAjSjBqPkixPYwve_pLeA79PpINw7yqzdcmThb16wwUR4Tfqzy78ltLYdjAMjJgGhWfmo Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5e3c77a63d84df4a75a5fd94d02d23f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}] Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 879bc0b8cc764e5ca6f7c75a34a86d5f Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '5a2ecb37-e181-478a-879d-0b6967486c8a'} Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.006345 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. Aug 27 21:14:46.012150 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.016040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Returning 404 to user: Instance 5a2ecb37-e181-478a-879d-0b6967486c8a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:46.017218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-abccacb7-dcc1-42bb-b2c2-c54dbdba9ca5 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a" status: 404 len: 111 microversion: 2.1 time: 0.065857 Aug 27 21:14:46.018083 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2692/5499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:45 2022] GET /compute/v2.1/servers/5a2ecb37-e181-478a-879d-0b6967486c8a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:14:46.026905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:46.027573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.034871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.035394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.037209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.038141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.038769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.039570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.058747 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] HTTP exception thrown: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Request method failure captured: Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 HTTP/1.1 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi1rH_UckAaBGx-_rFsI-Plc-cR3zPdd87L7FwFqyJl31XGDy2LfUdrNYTZO7E3ixHeziorQBo46EOitcKePCHUGTWI60Glio8V0_vgtsRAjSjBqPkixPYwve_pLeA79PpINw7yqzdcmThb16wwUR4Tfqzy78ltLYdjAMjJgGhWfmo Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5e3c77a63d84df4a75a5fd94d02d23f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}] Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 879bc0b8cc764e5ca6f7c75a34a86d5f Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ecf6f0c6-298b-4a42-b82d-2550ac31cad0'} Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:46.060819 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.065936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.067908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Returning 404 to user: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:46.068986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-488f15df-eb11-4d41-b766-5034d91a9dbc tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 404 len: 111 microversion: 2.1 time: 0.046639 Aug 27 21:14:46.069675 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2693/5500] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:46 2022] DELETE /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:14:46.080480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:46.080966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: ecf6f0c6-298b-4a42-b82d-2550ac31cad0] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.088675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.089181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.089627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.090345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.090810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.091243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.109793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] HTTP exception thrown: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Request method failure captured: Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 HTTP/1.1 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi1rH_UckAaBGx-_rFsI-Plc-cR3zPdd87L7FwFqyJl31XGDy2LfUdrNYTZO7E3ixHeziorQBo46EOitcKePCHUGTWI60Glio8V0_vgtsRAjSjBqPkixPYwve_pLeA79PpINw7yqzdcmThb16wwUR4Tfqzy78ltLYdjAMjJgGhWfmo Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5e3c77a63d84df4a75a5fd94d02d23f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}] Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 879bc0b8cc764e5ca6f7c75a34a86d5f Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ecf6f0c6-298b-4a42-b82d-2550ac31cad0'} Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.111379 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Returning 404 to user: Instance ecf6f0c6-298b-4a42-b82d-2550ac31cad0 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39b4f958-df38-472e-b5bf-a4a9c520bcbf tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0" status: 404 len: 111 microversion: 2.1 time: 0.038273 Aug 27 21:14:46.116924 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2694/5501] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:46 2022] GET /compute/v2.1/servers/ecf6f0c6-298b-4a42-b82d-2550ac31cad0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:46.121637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:46.122142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.128491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.129284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.129721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.130428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.131176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.131809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.146595 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] HTTP exception thrown: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Request method failure captured: Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 HTTP/1.1 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi1rH_UckAaBGx-_rFsI-Plc-cR3zPdd87L7FwFqyJl31XGDy2LfUdrNYTZO7E3ixHeziorQBo46EOitcKePCHUGTWI60Glio8V0_vgtsRAjSjBqPkixPYwve_pLeA79PpINw7yqzdcmThb16wwUR4Tfqzy78ltLYdjAMjJgGhWfmo Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5e3c77a63d84df4a75a5fd94d02d23f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}] Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 879bc0b8cc764e5ca6f7c75a34a86d5f Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7160b9cf-bbaf-4c51-a428-8eaad209f824'} Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:46.148216 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Returning 404 to user: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:46.153904 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32d99eb6-6f93-4c03-92ad-c4b6e9e6b92e tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 404 len: 111 microversion: 2.1 time: 0.031732 Aug 27 21:14:46.156872 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2695/5502] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:14:46 2022] DELETE /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:46.159255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:46.159925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] [instance: 7160b9cf-bbaf-4c51-a428-8eaad209f824] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.161833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:46.167790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:46.173291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.173848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.174255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.174990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.175690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.176413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.181611 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83d7953a-1666-4522-be7a-1c290c85f0f7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.353844 Aug 27 21:14:46.182922 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2808/5503] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:45 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:46.193472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] HTTP exception thrown: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Request method failure captured: Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 HTTP/1.1 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCoi1rH_UckAaBGx-_rFsI-Plc-cR3zPdd87L7FwFqyJl31XGDy2LfUdrNYTZO7E3ixHeziorQBo46EOitcKePCHUGTWI60Glio8V0_vgtsRAjSjBqPkixPYwve_pLeA79PpINw7yqzdcmThb16wwUR4Tfqzy78ltLYdjAMjJgGhWfmo Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5e3c77a63d84df4a75a5fd94d02d23f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5e3c77a63d84df4a75a5fd94d02d23f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5e3c77a63d84df4a75a5fd94d02d23f"}]}] Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: b5e3c77a63d84df4a75a5fd94d02d23f Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2008727494 Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 879bc0b8cc764e5ca6f7c75a34a86d5f Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-2008727494-project Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7160b9cf-bbaf-4c51-a428-8eaad209f824'} Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:46.195274 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] Returning 404 to user: Instance 7160b9cf-bbaf-4c51-a428-8eaad209f824 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da4596d7-8af9-440b-8878-f992acaac1a7 tempest-ServerDiskConfigTestJSON-2008727494 tempest-ServerDiskConfigTestJSON-2008727494-project] 10.222.0.40 "GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824" status: 404 len: 111 microversion: 2.1 time: 0.041495 Aug 27 21:14:46.202869 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2696/5504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:46 2022] GET /compute/v2.1/servers/7160b9cf-bbaf-4c51-a428-8eaad209f824 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:46.206226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:46.206765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.213595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.214186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.214534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.215245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.215740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.216175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.300554 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de94f57a-6f77-44ad-8c5b-f978e61a9839 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.097765 Aug 27 21:14:46.301847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2809/5505] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:46 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:14:46.315938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:46.316586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:46.325942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.326728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.327318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.329347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:46.330908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:46.332449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:46.629680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:46.638584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e00fb1de-ae8b-478b-8521-df395d481cf8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1510 microversion: 2.1 time: 0.329922 Aug 27 21:14:46.639181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2697/5506] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:46 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:47.661837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:47.663208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:47.675217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:47.677023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:47.677590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:47.679431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:47.680003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:47.686126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.000233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:48.013495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c673fa5f-c17f-4267-8199-516995ae75e5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1490 microversion: 2.1 time: 0.356934 Aug 27 21:14:48.016128 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2810/5507] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:47 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1490 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:48.037576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:48.038673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:48.053774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.054496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.055131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.056122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.056752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.057737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.085999 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'pause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state paused Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 13 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: {"pause": {}} Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'pause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state paused Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'pause': {}}} Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state paused. Cannot pause while the instance is in this state. Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state paused Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:48.088924 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:48.094755 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:48.094755 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:48.094755 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:48.094755 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state paused Aug 27 21:14:48.094755 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:48.096078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'pause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state paused {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:48.102782 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41ac2806-7b4a-4eb4-83e4-764cec6b3164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 143 microversion: 2.1 time: 0.070439 Aug 27 21:14:48.112412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:48.113223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:48.119187 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2698/5508] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:48 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 143 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:14:48.122006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.123585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.124228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.125127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.126290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.127099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.246117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa3be183-6a65-4682-8d47-8569896b72eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.137402 Aug 27 21:14:48.250194 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2811/5509] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:48 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:14:48.266797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:48.269299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:48.297630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.300241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.301830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:48.306241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:48.307528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:48.307983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:49.117410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:49.130064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cd907f3-ee68-44b2-ad45-5429125d94a9 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1497 microversion: 2.1 time: 0.876946 Aug 27 21:14:49.139764 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2699/5510] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:48 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1497 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:50.160804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:50.162535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:50.171025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.171877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.172739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.173806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.174480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.174908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.339867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:50.349009 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-171a2093-5e8f-490b-9834-1542a957aa2f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.192506 Aug 27 21:14:50.350202 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2812/5511] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:50 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:50.372162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:50.372785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:50.380616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.381107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.381564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.382252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.382703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.383315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.540453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:50.550361 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-48a53577-96e9-4bd1-afaf-5453fdf46148 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.182697 Aug 27 21:14:50.550941 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2700/5512] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:50 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:50.570333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:50.572786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:50.579077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.579610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.580051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.580751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.581203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.581842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.596995 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action HTTP/1.1 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 28 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: {"reboot": {"type": "SOFT"}} Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a58099dc-f5d9-4350-989e-7c990c10442a', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:50.598721 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:50.604167 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c509703-2943-4e49-af42-1c8001ed8e37 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action" status: 404 len: 111 microversion: 2.1 time: 0.033826 Aug 27 21:14:50.609751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2813/5513] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:50 2022] POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:50.610602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:50.610602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:50.615682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.616410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.617120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.618002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.618619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.619211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.780729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:50.794022 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86b59783-744a-47b1-9e57-f609728dadbb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.188596 Aug 27 21:14:50.795702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2701/5514] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:50 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:50.817876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:50.818606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:50.826337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.827156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.827886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:50.828713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:50.829237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:50.829732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:51.072531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:51.104976 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-05ae73a9-0e83-4746-b9ea-59c2a9567a4a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.288904 Aug 27 21:14:51.105762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2814/5515] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:50 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:51.136957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:51.144402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: b9372d82-a028-4675-ae29-1279ef6df506] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:51.154556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/b9372d82-a028-4675-ae29-1279ef6df506/action HTTP/1.1 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 28 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: {"reboot": {"type": "SOFT"}} Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b9372d82-a028-4675-ae29-1279ef6df506', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. Aug 27 21:14:51.157095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. Aug 27 21:14:51.161927 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:51.170688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance b9372d82-a028-4675-ae29-1279ef6df506 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:51.172067 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9cf3c98-76e3-4e99-a7fe-47ffd412e7bc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/b9372d82-a028-4675-ae29-1279ef6df506/action" status: 404 len: 111 microversion: 2.1 time: 0.045602 Aug 27 21:14:51.172884 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2702/5516] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:51 2022] POST /compute/v2.1/servers/b9372d82-a028-4675-ae29-1279ef6df506/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:51.183072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:51.184379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:51.200337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:51.200783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:51.203651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:51.204465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:51.208369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:51.209080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:51.688098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:51.702321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-963af35a-c590-4c07-8581-a289dcc13b89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.520140 Aug 27 21:14:51.723544 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2815/5517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:51 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:51.725963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:51.726600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:51.740947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:51.744456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:51.745211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:51.746291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:51.748927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:51.757783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.170600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:52.179188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f2a09b6c-e86c-4318-ad22-37625de0b139 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.459199 Aug 27 21:14:52.179817 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2703/5518] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:51 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:52.204697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:52.208442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:52.227053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.227877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.228514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.233619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.234419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.235061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.272661 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action HTTP/1.1 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 65 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a58099dc-f5d9-4350-989e-7c990c10442a', 'body': {'rebuild': {'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e'}}} Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 21:14:52.274778 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:14:52.280043 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:52.282851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:52.289967 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ab531b6-d3f2-4ac2-9431-bad0dc8e266c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action" status: 404 len: 111 microversion: 2.1 time: 0.089833 Aug 27 21:14:52.300701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:52.301750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:52.306031 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2816/5519] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:52 2022] POST /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:14:52.313764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.314310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.314761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.320649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.326599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.327166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.840936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:52.851720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bc220a5f-3506-4ebd-a80f-ed384821e106 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.555388 Aug 27 21:14:52.860416 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2704/5520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:52 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:52.886049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:52.886733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:52.905353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.905892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.906357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:52.907111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:52.907627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:52.908086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:53.283664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:53.298329 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4351ec4-ee69-4ef1-8818-a2e163777e5a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.417216 Aug 27 21:14:53.302947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2817/5521] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:52 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:53.330706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:53.335731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 45b2bc66-8a73-41f0-b21d-0ea4c9611e24] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:53.350885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/45b2bc66-8a73-41f0-b21d-0ea4c9611e24/action HTTP/1.1 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 65 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '45b2bc66-8a73-41f0-b21d-0ea4c9611e24', 'body': {'rebuild': {'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e'}}} Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 21:14:53.354921 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 45b2bc66-8a73-41f0-b21d-0ea4c9611e24 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55cef5f6-f1dd-4496-b1db-8c5c6cc3cdb5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/45b2bc66-8a73-41f0-b21d-0ea4c9611e24/action" status: 404 len: 111 microversion: 2.1 time: 0.033522 Aug 27 21:14:53.363511 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2705/5522] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:53 2022] POST /compute/v2.1/servers/45b2bc66-8a73-41f0-b21d-0ea4c9611e24/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:53.369000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:53.370212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:53.385865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:53.385865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:53.386846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:53.387621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:53.388095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:53.388965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:53.882619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:53.893021 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-729a8f46-5475-4f82-bc11-193318c7a164 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.527818 Aug 27 21:14:53.893627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2818/5523] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:53 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:53.918097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:53.918982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:53.935091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:53.939170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:53.940377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:53.942588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:53.944780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:53.945430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:54.892440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:54.922252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f6fd798-bc61-4c91-89b4-315e47a3a52e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 1.007033 Aug 27 21:14:54.925964 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2706/5524] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:53 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:54.943633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:54.944445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 6d3bb717-e894-4005-b738-6da47c5b5dd8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:54.961018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/6d3bb717-e894-4005-b738-6da47c5b5dd8/action HTTP/1.1 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 15 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: {"restore": {}} Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '6d3bb717-e894-4005-b738-6da47c5b5dd8', 'body': {'restore': {}}} Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:54.962441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:54.979817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:54.979817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:54.979817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. Aug 27 21:14:54.979817 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:54.984265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 6d3bb717-e894-4005-b738-6da47c5b5dd8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:54.985145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1eb76686-8dad-4e79-957f-ac1e5fb54903 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/6d3bb717-e894-4005-b738-6da47c5b5dd8/action" status: 404 len: 111 microversion: 2.1 time: 0.045753 Aug 27 21:14:54.990572 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2819/5525] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:54 2022] POST /compute/v2.1/servers/6d3bb717-e894-4005-b738-6da47c5b5dd8/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:55.004253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:55.008472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:55.031715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:55.032545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:55.032996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:55.033740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:55.034202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:55.034632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:55.460187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:55.497522 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9c8a5f4c-18b7-4d08-bd51-39f63e090f68 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.505134 Aug 27 21:14:55.500213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2707/5526] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:54 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:55.524851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:55.525564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:55.546654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:55.547093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:55.548221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:55.548982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:55.549454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:55.549889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:55.954407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:55.964823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-841a4737-157d-4cce-85fe-dadd07ae67f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.448132 Aug 27 21:14:55.965676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2820/5527] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:55 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:55.988002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:55.989406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:55.995675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:55.997891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:55.998393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:55.999227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:55.999969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.000433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.001811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.012889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:56.043810 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'restore' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 15 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: {"restore": {}} Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'restore' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'restore': {}}} Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state active. Cannot restore while the instance is in this state. Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.046045 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:56.051685 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:56.051685 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:56.051685 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:56.051685 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:56.051685 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.053060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'restore' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:56.054216 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0925ae29-d8fa-4532-8122-4939d367a958 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 145 microversion: 2.1 time: 0.071502 Aug 27 21:14:56.055432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2708/5528] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:55 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:14:56.064160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:56.065250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:56.067970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:14:56.074935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.075764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.076702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.077667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.078340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.078984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.338693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:56.350062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-779f7ccf-6e3e-458a-afb5-4a4100dd591c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.290199 Aug 27 21:14:56.364198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2821/5529] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:56 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:14:56.373524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:56.374151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:56.381046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.381537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.381975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.382884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.383373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.383788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.649210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:56.666285 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ac7b3bb6-1c74-4d3c-b1e9-d24db50d7a89 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.297157 Aug 27 21:14:56.679653 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2709/5530] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:56 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:56.689227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:56.690174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 7bd33b2e-b751-4772-b3a1-66f510cad065] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:56.696288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/7bd33b2e-b751-4772-b3a1-66f510cad065/action HTTP/1.1 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 14 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: {"resume": {}} Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7bd33b2e-b751-4772-b3a1-66f510cad065', 'body': {'resume': {}}} Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:56.706036 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:56.711591 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:56.711591 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:56.711591 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. Aug 27 21:14:56.711591 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:56.711591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 7bd33b2e-b751-4772-b3a1-66f510cad065 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:56.712038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08a8bbd5-26d5-4e6d-aeff-1c1dfbaeac1c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/7bd33b2e-b751-4772-b3a1-66f510cad065/action" status: 404 len: 111 microversion: 2.1 time: 0.025451 Aug 27 21:14:56.713821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2822/5531] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:56 2022] POST /compute/v2.1/servers/7bd33b2e-b751-4772-b3a1-66f510cad065/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:14:56.725069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:56.726806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:56.734580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.735517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.736332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:56.737241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:56.737915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:56.738539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.043033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:57.060380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3fa21d24-1150-435f-90f4-b4d9c1747dc8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.339310 Aug 27 21:14:57.061829 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2710/5532] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:56 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:57.085929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:57.086536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:57.103777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.104273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.104710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.111239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.114317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.115006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.485929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:57.503666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-570f9f0b-e3f4-4175-91f5-d9db7c35f741 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.421860 Aug 27 21:14:57.505079 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2823/5533] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:57 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:57.530725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:57.532430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:57.543258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.544327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.556717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.558241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.559523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.560470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.610315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'resume' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 14 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: {"resume": {}} Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'resume' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'resume': {}}} Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state active. Cannot resume while the instance is in this state. Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:57.613630 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:14:57.618127 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:14:57.621196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'resume' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:57.622195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-57d27379-4bab-4ede-a45e-f3610c631bcc tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 144 microversion: 2.1 time: 0.097159 Aug 27 21:14:57.624304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2711/5534] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:14:57 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 144 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:14:57.633573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:57.634199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:57.652794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.653796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.654241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.655006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.655786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.656212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.887429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:57.907390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9ea55005-f924-491e-beb4-914a27fb9099 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.278126 Aug 27 21:14:57.908771 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2824/5535] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:57 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:57.933988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:57.934707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:57.945169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.950694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.951301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:57.952431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:57.952994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:57.957063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:58.641507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:58.650973 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-192a805a-8209-4e8a-b09c-2f42a0877668 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.721787 Aug 27 21:14:58.652255 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2712/5536] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:57 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:58.803161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04d5a168-6571-4786-ba2f-28d0f690b188 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04d5a168-6571-4786-ba2f-28d0f690b188 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 160 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "d9208a18-551f-4b8c-a16f-084f27b88dfe"}]}} Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'body': {'server': {'name': '', 'imageRef': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'flavorRef': '452', 'networks': [{'uuid': 'd9208a18-551f-4b8c-a16f-084f27b88dfe'}]}}} Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi '' Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:14:58.808205 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:14:58.813164 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:14:58.815854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04d5a168-6571-4786-ba2f-28d0f690b188 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:14:58.816889 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04d5a168-6571-4786-ba2f-28d0f690b188 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017858 Aug 27 21:14:58.817576 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2825/5537] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:14:58 2022] POST /compute/v2.1/servers => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:14:58.827766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:58.829193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:58.836085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:58.836744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:58.837300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:58.838935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:58.839511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:58.840047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:59.697703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:14:59.709621 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0a3e06ae-c3d0-42af-876f-5bd3a7d0a0e7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.885937 Aug 27 21:14:59.724506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2713/5538] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:58 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:14:59.738829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:14:59.739478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:14:59.759155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:59.759757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:59.760208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:14:59.760923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:14:59.761383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:14:59.761811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:00.213542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:00.226905 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7dfeb64f-6daf-4d78-a68d-ea4f10d0593a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.493433 Aug 27 21:15:00.227645 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2826/5539] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:14:59 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:00.252520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:00.254041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: e6c42c73-65c4-41ab-8232-b0464830a1e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:00.269366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/e6c42c73-65c4-41ab-8232-b0464830a1e9/action HTTP/1.1 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 14 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: {"shelve": {}} Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'e6c42c73-65c4-41ab-8232-b0464830a1e9', 'body': {'shelve': {}}} Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:00.277267 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:00.283035 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:00.283035 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:00.283035 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. Aug 27 21:15:00.283035 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:00.297742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance e6c42c73-65c4-41ab-8232-b0464830a1e9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:00.298874 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d690c1c5-d040-433d-aed1-bc53ddcb11a0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/e6c42c73-65c4-41ab-8232-b0464830a1e9/action" status: 404 len: 111 microversion: 2.1 time: 0.053603 Aug 27 21:15:00.299520 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2714/5540] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:15:00 2022] POST /compute/v2.1/servers/e6c42c73-65c4-41ab-8232-b0464830a1e9/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:00.323881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:00.324737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:00.336984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:00.340589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:00.341337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:00.344889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:00.345562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:00.346196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:00.850840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:00.858015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:00.870088 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e34dbc5d-ac3c-4e61-b212-039094f6ec0b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.555543 Aug 27 21:15:00.872434 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2827/5541] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:00 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:00.897154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:00.898351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:00.924531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:00.926018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:00.926869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:00.928583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:00.930556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:00.931594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:01.405625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:01.422914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-18a03173-8434-4281-be0d-93855168b7dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.529694 Aug 27 21:15:01.424517 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2715/5542] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:00 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:01.453594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:01.454559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:01.482840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:01.484722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:01.486528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:01.489011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:01.489706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:01.490555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:01.535625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'flavor' on Instance uuid ff1b42cc-61cd-437d-92ca-1c27fd1fd538 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:01.645714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2081608163", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "09c22a6b-924a-4ac9-a1d2-2484aad591ca"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:01.715994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] validate_networks() for [('09c22a6b-924a-4ac9-a1d2-2484aad591ca', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:15:01.784756 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23b3093c-d38e-4f46-b1f2-aa4dc10c7f32 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.338673 Aug 27 21:15:01.785601 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2716/5543] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:15:01 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:15:01.809550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:01.811111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:01.818572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:01.819194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:01.819729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:01.820665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:01.821119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:01.821734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:02.115756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:02.132463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a1e1841-df8f-4b99-8391-6a71bce7fd6a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.342243 Aug 27 21:15:02.133424 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2717/5544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:01 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:02.466071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:15:02.467229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:15:02.467879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:15:02.468567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:15:02.470417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:15:02.488562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:02.490320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:02.491280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:02.492311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:02.493621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:02.494356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:02.529717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Getting quotas for project 709f6b1496ae4e9d9431df4e22bb6f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:02.537152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Getting quotas for user be3d4127d5624162902bb90076295b51 and project 709f6b1496ae4e9d9431df4e22bb6f7c. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:02.553750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:15:02.556781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:15:02.653166 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d1c74e4f-f45b-4b0a-8037-d86425a907a8 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274658 Aug 27 21:15:02.660598 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2828/5545] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:15:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:15:02.674993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51783a9e-a58e-4eb7-ad00-eac26e022ce3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:02.678328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51783a9e-a58e-4eb7-ad00-eac26e022ce3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:03.157765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:03.158612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:03.178831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:03.179312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:03.181161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:03.182946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:03.196157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:03.196891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:03.484394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51783a9e-a58e-4eb7-ad00-eac26e022ce3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:03.497122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51783a9e-a58e-4eb7-ad00-eac26e022ce3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1228 microversion: 2.1 time: 0.836077 Aug 27 21:15:03.498374 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2718/5546] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:02 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1228 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:03.672220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:03.684597 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1ddf97b-4dbd-4342-ab9e-623fd9ab60f4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.532958 Aug 27 21:15:03.686445 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2829/5547] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:03 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:04.527701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:04.528373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:04.548638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:04.549292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:04.550041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:04.550996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:04.555040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:04.556355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:04.707391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:04.708759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:04.720128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:04.721043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:04.722277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:04.723980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:04.724685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:04.725337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:04.762625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:04.770695 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e11b81f7-1d6e-4eeb-8812-5afeafc54335 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1280 microversion: 2.1 time: 0.248123 Aug 27 21:15:04.777378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2719/5548] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:04 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:05.514314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:05.525327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9919a6f4-d525-49dc-9cbe-1f810e4f5676 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.822982 Aug 27 21:15:05.551813 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2830/5549] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:04 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:05.808440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:05.811436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:05.826699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:05.827613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:05.832533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:05.843080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:05.844398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:05.845404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:06.199903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:06.215261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-966f7d14-a30b-4e29-929a-5b40502f36ee tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1286 microversion: 2.1 time: 0.416655 Aug 27 21:15:06.217617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2720/5550] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:05 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1286 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:06.558836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:06.562990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:06.601800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:06.603056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:06.603998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:06.604946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:06.605480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:06.605976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:06.988740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:07.006681 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-010b2649-3d26-47ef-a741-260b2cf0c8e2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.459513 Aug 27 21:15:07.007684 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2831/5551] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:06 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:07.239627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:07.244640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:07.259393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:07.260128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:07.260852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:07.262495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:07.265229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:07.266101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:07.588584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66e2c0e4-63f2-4428-ade7-b7b5527fedc8", "tag": "92baa260-8020-475e-8c8a-2bd9fc3d6b8a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:07.612794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:07.613748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:07.615461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:07.639911 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] Creating event network-changed:92baa260-8020-475e-8c8a-2bd9fc3d6b8a for instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 on nch1-master-1 Aug 27 21:15:07.645654 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e7051171-1def-4aa9-935b-73fb320288bc req-aa09abc5-d961-470d-86a0-b9132e41fc4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206359 Aug 27 21:15:07.646767 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2832/5552] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:07.797729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:07.822423 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d9fe5ab-3c22-4d06-a09b-870adcdff16e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.586985 Aug 27 21:15:07.824848 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2721/5553] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:07 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:08.032279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:08.033565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:08.043824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:08.044491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:08.045033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:08.045842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:08.046396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:08.047040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:08.406530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:08.415108 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cffc8cc2-fe47-48ab-abb5-1b3de166d6f1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.388942 Aug 27 21:15:08.415747 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2833/5554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:08 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:08.625004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: .version_select at 0x7ff84e1b1700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1742682793", "policies": ["affinity"]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:08.646648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.654667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.704292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.709801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.726338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-722d8d0d-7886-4a79-a536-b221a07b2f73 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.171901 Aug 27 21:15:08.726951 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2722/5555] 10.222.0.40 () {60 vars in 1174 bytes} [Sat Aug 27 21:15:08 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:08.738089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: .version_select at 0x7ff84dbd0f70>, body: {"server_group": {"name": "tempest-server-group-1552092429", "policies": ["affinity"]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:08.758312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.764797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.812403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.817843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.833824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74beb7fa-cfec-4a88-9faa-93d36c8c7526 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.099469 Aug 27 21:15:08.843275 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2834/5556] 10.222.0.40 () {60 vars in 1173 bytes} [Sat Aug 27 21:15:08 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:08.848359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:08.850404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:08.850580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: .version_select at 0x7ff84dbda670>, body: {"server_group": {"name": "tempest-server-group-1552092429", "policies": ["affinity"]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:08.857966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:08.858450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:08.859381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:08.860520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:08.861444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:08.862095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:08.879912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.886615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.954904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:08.961559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:08.977308 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d449a956-f69c-45f5-b295-37d701b5d007 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.132630 Aug 27 21:15:08.984452 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2835/5557] 10.222.0.40 () {60 vars in 1173 bytes} [Sat Aug 27 21:15:08 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:08.990762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ca3b6739-d193-47d9-b078-6a9831285db7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.030314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ca3b6739-d193-47d9-b078-6a9831285db7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/3cc57a9a-462d-4dad-991f-7c9430086dbc" status: 204 len: 0 microversion: 2.1 time: 0.044660 Aug 27 21:15:09.034460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2836/5558] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:08 2022] DELETE /compute/v2.1/os-server-groups/3cc57a9a-462d-4dad-991f-7c9430086dbc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:09.042246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-899ec8a5-a6d9-477d-ada7-f8d9f2c8fd09 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.048421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:09.062163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-899ec8a5-a6d9-477d-ada7-f8d9f2c8fd09 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.026293 Aug 27 21:15:09.062833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2837/5559] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:15:09 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:09.068729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:09.074967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6de0aba-dfa3-44ee-8ee3-3c3de6bf75e1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.079306 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-167e015d-c940-4884-bb81-d51ea9338c53 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.234644 Aug 27 21:15:09.084654 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2723/5560] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:08 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:09.113070 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6de0aba-dfa3-44ee-8ee3-3c3de6bf75e1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7cac8814-7465-4603-bb30-f8870dfaec45" status: 204 len: 0 microversion: 2.1 time: 0.042259 Aug 27 21:15:09.113684 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2838/5561] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:09 2022] DELETE /compute/v2.1/os-server-groups/7cac8814-7465-4603-bb30-f8870dfaec45 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:09.122632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a1119b4-2f15-4bb0-8e18-c29162230209 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.143960 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a1119b4-2f15-4bb0-8e18-c29162230209 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.025750 Aug 27 21:15:09.144710 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2724/5562] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:15:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:09.158012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: .version_select at 0x7ff84dc42700>, body: {"server_group": {"name": "tempest-server-group-1338354666", "policies": ["affinity"]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:09.177847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:09.184242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:09.231251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:09.237486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:09.254026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d75a27e0-d102-4553-be35-0ddd1722929f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.100016 Aug 27 21:15:09.254655 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2839/5563] 10.222.0.40 () {60 vars in 1173 bytes} [Sat Aug 27 21:15:09 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:09.269093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d988126-0434-4f1c-9f54-3ac11e096cb7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.303087 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d988126-0434-4f1c-9f54-3ac11e096cb7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/0025e7b4-9de5-468d-bd38-a169e92536d8" status: 204 len: 0 microversion: 2.1 time: 0.041406 Aug 27 21:15:09.308490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2725/5564] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:09 2022] DELETE /compute/v2.1/os-server-groups/0025e7b4-9de5-468d-bd38-a169e92536d8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:09.322522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc9f7df0-9adf-4538-97e4-cff671904e2f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.333127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc9f7df0-9adf-4538-97e4-cff671904e2f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.014732 Aug 27 21:15:09.333851 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2840/5565] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:15:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:09.347860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: .version_select at 0x7ff84dfef4c0>, body: {"server_group": {"name": "tempest-server-group-561914934", "policies": ["anti-affinity"]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:09.369803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:09.375472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:09.434247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:09.441683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_groups'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:09.444221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.445890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:09.460640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:09.461891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:09.463652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:09.464923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:09.465474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:09.465904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:09.475258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc958006-56a6-4123-8077-96d4d4c2987a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.132188 Aug 27 21:15:09.475970 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2726/5566] 10.222.0.40 () {60 vars in 1173 bytes} [Sat Aug 27 21:15:09 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:09.501005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60ac8a30-5279-4c62-b55c-b4753fd5146f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.532035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:09.544439 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60ac8a30-5279-4c62-b55c-b4753fd5146f tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/fd79b185-6301-4c24-ab41-475bafa7084e" status: 204 len: 0 microversion: 2.1 time: 0.057031 Aug 27 21:15:09.545038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2727/5567] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:09 2022] DELETE /compute/v2.1/os-server-groups/fd79b185-6301-4c24-ab41-475bafa7084e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:09.553492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35afcea6-1eb8-4f24-8efc-d2912d88b5be tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:09.567314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35afcea6-1eb8-4f24-8efc-d2912d88b5be tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.017833 Aug 27 21:15:09.568251 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2728/5568] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:15:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:09.676335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1180523775", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "e7f1b757-aabc-41c8-8d65-c199609c7195"}]}, "os:scheduler_hints": {"group": "5e954173-5000-49ee-81be-aa60a09c365d"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:09.756707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] validate_networks() for [('e7f1b757-aabc-41c8-8d65-c199609c7195', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:15:09.786582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:09.796868 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a06b60b9-bfa5-4e94-8e79-b9350f3abfb7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.364102 Aug 27 21:15:09.798426 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2841/5569] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:09 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:10.111168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:10.111844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:10.123103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.123875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.124329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:10.125009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.125465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.125886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:10.274755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:15:10.275591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:15:10.276647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:15:10.278068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:15:10.279109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:15:10.300186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.301056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.301686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:10.302834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.303667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.304394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:10.325283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:10.330279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:10.338052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:10.365683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:15:10.368418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:15:10.387495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7068027f-fecd-44d7-862a-1a613b9867c3 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.282375 Aug 27 21:15:10.396012 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2842/5570] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:10 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:10.458808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:10.465623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:10.506420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:10.512718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Getting quotas for user be63cedd051943d582bf17cc16200ccb and project 43f275a974bf4b8da14c7909d04b219e. Resources: {'server_group_members'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:10.541581 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f34689aa-c769-44fe-8ea5-239157408a43 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869294 Aug 27 21:15:10.548434 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2729/5571] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:15:10.557890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c452b9d2-11bc-4ba1-b34d-4e0e04155f2a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:10.558519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c452b9d2-11bc-4ba1-b34d-4e0e04155f2a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:10.632383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c452b9d2-11bc-4ba1-b34d-4e0e04155f2a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:10.642666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c452b9d2-11bc-4ba1-b34d-4e0e04155f2a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1213 microversion: 2.1 time: 0.092761 Aug 27 21:15:10.659761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2843/5572] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:10 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:10.820863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:10.821589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:10.831450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.832119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.832672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:10.833512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:10.834084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:10.834588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:11.044767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:11.054689 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7644bcc-05df-4979-b5bf-c0099fce6174 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.238890 Aug 27 21:15:11.068117 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2730/5573] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:10 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:11.410049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:11.411429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:11.429102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:11.431613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:11.433286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:11.434255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:11.434892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:11.435533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:11.628767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:11.640953 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5979f234-1e3b-4404-af41-e997502cf4d5 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.235205 Aug 27 21:15:11.642399 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2844/5574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:11 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:11.683034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:11.684050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:11.691585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:11.692265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:11.693047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:11.694801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:11.695399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:11.695989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:11.777285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:11.789437 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56e84f65-294d-4735-af72-9150ad200c53 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1265 microversion: 2.1 time: 0.111592 Aug 27 21:15:11.790323 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2731/5575] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:11 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:12.078680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:12.079310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:12.085866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.086531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.086973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.088173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.088986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.089422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.244886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:12.256963 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2ee3026-75b3-463a-8c5e-0e1359f53483 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.183279 Aug 27 21:15:12.273113 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2845/5576] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:12 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:12.663190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:12.663840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:12.670817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.671278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.671786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.672484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.672935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.673360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.679181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:12.813036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:12.815782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:12.826695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:12.828975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.829479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.830125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.831669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:12.832526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:12.833169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:12.843389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:12.854156 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-90e84d34-dbd2-4e62-baf4-323cfcf905b4 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.194597 Aug 27 21:15:12.854846 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2732/5577] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:12 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:12.926389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:12.935029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4bf5203b-2a80-4000-88dd-132beb2bdf36 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1271 microversion: 2.1 time: 0.128057 Aug 27 21:15:12.936083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2846/5578] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:12 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:13.157464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.158975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.168780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.169456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.170004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.170971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.171837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.172373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.204699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b50e974b-c6c4-40c7-bbed-2a0b0958f5e5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments/0ebdf631-522c-4ca4-8edd-98bd7239f81e" status: 200 len: 194 microversion: 2.20 time: 0.051643 Aug 27 21:15:13.205493 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2733/5579] 10.222.0.40 () {60 vars in 1454 bytes} [Sat Aug 27 21:15:13 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments/0ebdf631-522c-4ca4-8edd-98bd7239f81e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:15:13.275246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.276034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.279237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.280160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.283282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.284007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.284646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.285541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.286161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.286746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.286881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.287298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.287767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.288471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.288931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.289479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.395359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lazy-loading 'services' on Instance uuid eafef7f1-0bed-4a72-8ab4-2bec00006e79 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:13.447255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:13.456795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a43ab8d-97ca-45ce-8820-4f5ad4dcc55a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1532 microversion: 2.1 time: 0.181630 Aug 27 21:15:13.457676 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2734/5580] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:13 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1532 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:13.479880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24583176-98be-42c8-9fa3-b7412faba93f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments/0ebdf631-522c-4ca4-8edd-98bd7239f81e" status: 202 len: 0 microversion: 2.20 time: 0.208696 Aug 27 21:15:13.480641 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2847/5581] 10.222.0.40 () {60 vars in 1457 bytes} [Sat Aug 27 21:15:13 2022] DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments/0ebdf631-522c-4ca4-8edd-98bd7239f81e => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:13.489640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.492261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.499203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.500019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.500499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.501326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.501792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.502263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.536189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8479ddd-f0d7-4ca1-99f3-980d15dc6c1c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050855 Aug 27 21:15:13.536792 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2735/5582] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 21:15:13 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:15:13.877472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.878167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.885246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.885739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.886199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.886914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.887404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.887885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.957357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:13.957973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:13.966274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.966828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.967565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:13.968538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:13.969225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:13.969898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.061244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:14.071773 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc37458f-2065-4afd-aced-efae61107c27 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1271 microversion: 2.1 time: 0.118205 Aug 27 21:15:14.073351 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2736/5583] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:13 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:14.077920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:14.090288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-241429b7-4a6f-4a2f-9049-05e716860aab tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.217970 Aug 27 21:15:14.091422 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2848/5584] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:13 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:14.345242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e2c0e4-63f2-4428-ade7-b7b5527fedc8", "name": "network-vif-plugged", "status": "completed", "tag": "92baa260-8020-475e-8c8a-2bd9fc3d6b8a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:14.365227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:14.367292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:14.367982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.388826 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] Creating event network-vif-plugged:92baa260-8020-475e-8c8a-2bd9fc3d6b8a for instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 on nch1-master-1 Aug 27 21:15:14.398701 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fc6cc7a4-f95e-4d3c-a68f-104f51c68e38 req-3773c1ed-947d-4079-8844-20a702854520 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058259 Aug 27 21:15:14.401311 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2737/5585] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:14.482988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:14.484276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:14.498016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:14.500674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:14.504386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.508638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:14.509204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:14.509994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.551386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:14.553803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:14.566141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:14.571679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:14.574597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.575455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:14.575926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:14.576425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:14.610381 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e7b69ac-93d0-4d97-ab68-3ce21bd32b50 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064924 Aug 27 21:15:14.612621 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2738/5586] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 21:15:14 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:15:14.682812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:14.691639 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7fb9481e-3a16-4f9d-958f-3db7454b101f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1532 microversion: 2.1 time: 0.215394 Aug 27 21:15:14.692401 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2849/5587] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:14 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1532 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:15.094496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.095090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.102378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.102877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.104052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.104760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.105228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.105665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.115560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.117883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.125728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.126421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.127124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.127934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.128459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.129158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.320107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:15.325606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:15.329452 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-998a2c56-9ebf-4960-ab73-9fcc88598728 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1328 microversion: 2.1 time: 0.219123 Aug 27 21:15:15.339742 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2850/5588] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:15 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1328 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:15.348376 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89e508d0-eeb5-4941-bab6-96d869ca18e4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.257758 Aug 27 21:15:15.348901 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2739/5589] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:15 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:15.625640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.628424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.636028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.636527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.636963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.637780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.638227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.638647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.696539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e7f6a8f-9512-473c-8d01-ee26f6dccf2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075444 Aug 27 21:15:15.697660 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2851/5590] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 21:15:15 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:15.703331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8964f07-7cbd-404d-9833-d069ebc39e4e", "tag": "7bafb1bf-cf6f-4f37-afc2-74374d7a896c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:15.719009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.721106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.723028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.723559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.724001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.733329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.734402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.735372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.736933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.737760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.738559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.748290 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] Creating event network-changed:7bafb1bf-cf6f-4f37-afc2-74374d7a896c for instance a8964f07-7cbd-404d-9833-d069ebc39e4e on nch2-master-1 Aug 27 21:15:15.762221 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-55d8d8e2-6760-4ca2-b2b1-0d180a169b22 req-f5ce7c07-fc03-44e3-a537-79637c7a176d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064088 Aug 27 21:15:15.769365 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2740/5591] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:15.793446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.794378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.801723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.802464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.803168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.805194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.805934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.806553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.835106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:15:15.963404 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94086cb4-32c4-4abc-8831-aab659f2d7ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 204 len: 0 microversion: 2.20 time: 0.185575 Aug 27 21:15:15.964728 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2741/5592] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:15:15 2022] DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:15:15.975538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:15.977143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:15.985922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.987217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.988191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.988747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:15.989291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:15.989850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:15.999512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.010520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-281b4e18-3417-457f-aa29-d06170fc5628 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1532 microversion: 2.1 time: 0.300775 Aug 27 21:15:16.011811 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2852/5593] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:15 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1532 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:16.239143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.255589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.257872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.259493 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ab601dd7-987a-4dea-a0ea-53533474b180 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.289623 Aug 27 21:15:16.267712 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2742/5594] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:15 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:16.352162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:16.353527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:16.360519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.361003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.361436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.362129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.362576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.363032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.367298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:16.376509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:16.377256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:16.385222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.385409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.385925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.386699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.387231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.388004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.596987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.604285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.615122 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c80fc0d7-5ea7-4bb6-8d06-974c124fbde9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1528 microversion: 2.1 time: 0.266880 Aug 27 21:15:16.617534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b8ed0abb-6a27-4a79-afb1-ac9d16fbd03b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.244955 Aug 27 21:15:16.618129 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2743/5595] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:16 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:16.619064 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2853/5596] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:16 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1528 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:16.640779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:16.641644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:16.647808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.648290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.648723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.649415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.650049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.650658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.839114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:16.848134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a6d23b9-78a5-4222-9c06-963656ac4f05 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1528 microversion: 2.1 time: 0.211834 Aug 27 21:15:16.849103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2744/5597] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:16 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1528 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:16.931629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:16.932234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:16.938582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.939069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.939540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.940236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.940682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.941099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.956189 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] HTTP exception thrown: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Request method failure captured: Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 HTTP/1.1 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjColV4oE-bjxxVV9ZchTa1vC6zuW4H4jC5fzoGLZgFx5ivIzvDQh-XCUpzCQsWNoR81L4tfyB4SNy81B6tYQD7PEutD9oNBzd9qzQfNpWFnruaGqbIT2yModDFH3zXrIbpkHtGBoaNAUDhwEU-AUH-afrUQe2M5l5sXPkrXxYmhN-5OE Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 3bec4316d9ab428eb6277540befd002c Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3bec4316d9ab428eb6277540befd002c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3bec4316d9ab428eb6277540befd002c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3bec4316d9ab428eb6277540befd002c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3bec4316d9ab428eb6277540befd002c"}]}] Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 3bec4316d9ab428eb6277540befd002c Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1537584480-project Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 91420bb02d6f40e8947b869c1bc2f42d Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480-project Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '66e2c0e4-63f2-4428-ade7-b7b5527fedc8'} Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:16.958022 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Returning 404 to user: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:16.966327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e82debe-4968-4d86-9a9f-89aa3850e75e tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] 10.222.0.40 "DELETE /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 404 len: 111 microversion: 2.1 time: 0.093340 Aug 27 21:15:16.972250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:16.972951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:16.979500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.979888 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2854/5598] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:15:16 2022] DELETE /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:16.980196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.980726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:16.981383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:16.982024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:16.982967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.033051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:17.034174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.042927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.051593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.052448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.053368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.054024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.054466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.233343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.245712 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8c347e1a-f19e-4c8b-ad50-b57a4cd35711 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1528 microversion: 2.1 time: 0.276650 Aug 27 21:15:17.248396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2745/5599] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:16 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:17.270823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Action: 'update', calling method: >, body: {"server": {"name": "66e2c0e4-63f2-4428-ade7-b7b5527fedc8_new"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:17.274461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.283369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.286933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.288929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.289623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.290703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.291459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.292109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.292236 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0f5b682-0d90-4e32-9aba-a6f973643c23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1532 microversion: 2.1 time: 0.263833 Aug 27 21:15:17.292802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2855/5600] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:17 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1532 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:17.298043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:17.299010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.306202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.307214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.307934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.308809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.309477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.310061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.325932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] HTTP exception thrown: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Request method failure captured: Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 HTTP/1.1 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 64 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjColV4oE-bjxxVV9ZchTa1vC6zuW4H4jC5fzoGLZgFx5ivIzvDQh-XCUpzCQsWNoR81L4tfyB4SNy81B6tYQD7PEutD9oNBzd9qzQfNpWFnruaGqbIT2yModDFH3zXrIbpkHtGBoaNAUDhwEU-AUH-afrUQe2M5l5sXPkrXxYmhN-5OE Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 3bec4316d9ab428eb6277540befd002c Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3bec4316d9ab428eb6277540befd002c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3bec4316d9ab428eb6277540befd002c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3bec4316d9ab428eb6277540befd002c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3bec4316d9ab428eb6277540befd002c"}]}] Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 3bec4316d9ab428eb6277540befd002c Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480 Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1537584480-project Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 91420bb02d6f40e8947b869c1bc2f42d Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1537584480-project Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "66e2c0e4-63f2-4428-ade7-b7b5527fedc8_new"}} Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '66e2c0e4-63f2-4428-ade7-b7b5527fedc8', 'body': {'server': {'name': '66e2c0e4-63f2-4428-ade7-b7b5527fedc8_new'}}} Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:15:17.327957 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] Returning 404 to user: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f8b6ce6-0f5c-4889-a6be-e4ab863da9f8 tempest-ServersNegativeTestMultiTenantJSON-1537584480 tempest-ServersNegativeTestMultiTenantJSON-1537584480-project] 10.222.0.40 "PUT /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 404 len: 111 microversion: 2.1 time: 0.064933 Aug 27 21:15:17.334338 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2746/5601] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:15:17 2022] PUT /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:15:17.342241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:17.342889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.352859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.353751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.354317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.356227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.356788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.357463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.414045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:15:17.479682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:17.533100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c89b4a4-3847-4d16-a916-a0cd149250f7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "DELETE /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 204 len: 0 microversion: 2.1 time: 0.196212 Aug 27 21:15:17.534253 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2747/5602] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:15:17 2022] DELETE /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:15:17.545426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:17.546604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.555254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.556759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.557738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.558709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.560125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.562233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.576773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.587139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.591211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.592507 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f61a9790-9edd-4055-8920-7600d708b89f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.298484 Aug 27 21:15:17.599603 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2856/5603] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:17 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:17.640147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:17.641090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:17.657955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.660409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.661036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.661999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.662651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.663296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.803464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.811976 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c4b04d1-d562-4be8-bc7f-2b6b4b29d37e tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1534 microversion: 2.1 time: 0.271746 Aug 27 21:15:17.812778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2748/5604] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:17 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1534 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:17.831905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "name": "network-vif-plugged", "status": "completed", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:17.843332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:17.843708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:17.844328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:17.871218 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] Creating event network-vif-plugged:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:15:17.880521 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d5d59258-40ef-462e-ac47-d36ffc743dcf req-0b658016-ad66-46b6-97c0-3bb48329b31c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052711 Aug 27 21:15:17.881453 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2749/5605] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:17.895019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:17.903564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a9c9fa3-811f-49f5-ae76-9a83911319aa tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.269152 Aug 27 21:15:17.904467 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2857/5606] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:17 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:18.319996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:18.320843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:18.325379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:18.330718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.331766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.332723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.333611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.334307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.334909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.522003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:18.532288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f2ce138-d241-4136-bc91-727312a7096a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1532 microversion: 2.1 time: 0.218349 Aug 27 21:15:18.533137 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2750/5607] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:18 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1532 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:18.616795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:18.618174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:18.628035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.628916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.629587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.630896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.631571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.632189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.790500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:18.800216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:18.802224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:18.803723 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6e1b0f3-f5db-49d1-b061-41d7066f645e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1722 microversion: 2.20 time: 0.191786 Aug 27 21:15:18.810396 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2858/5608] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:18 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:18.834170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:18.834924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:18.844150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.846208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.847132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.848426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.849089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.849705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.928403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:18.929469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:18.943183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.943989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.944667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:18.945638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:18.946318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:18.947258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:19.015032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.025089 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41b2053a-77b1-437d-bb8e-1e2cd13c32c7 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1534 microversion: 2.1 time: 0.194565 Aug 27 21:15:19.038678 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2751/5609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:18 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1534 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:19.241784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.254773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f038c099-1fab-4801-ac7a-6ee39c543277 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.331037 Aug 27 21:15:19.256120 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2859/5610] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:18 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:19.563103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:19.566545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:19.577262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:19.577736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:19.578239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:19.578968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:19.579450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:19.579882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:19.713842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.722392 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6eacae83-e722-4f14-85cc-abaf1b844749 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.163165 Aug 27 21:15:19.723055 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2752/5611] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:19 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:19.838814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:19.839435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:19.846667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:19.847244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:19.847792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:19.848652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:19.849212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:19.849719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:19.916146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.932088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.935052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:19.937259 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-518917b7-8d96-4c96-baf5-769d8d925621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1655 microversion: 2.20 time: 0.102607 Aug 27 21:15:19.938374 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2860/5612] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:19 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:20.047375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:20.048039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:20.054822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.055176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.055880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.057102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.057575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.058001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.162521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3d4127d5624162902bb90076295b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '709f6b1496ae4e9d9431df4e22bb6f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:20.172803 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4df8de38-1afb-4dfb-b18f-679a102d9fe9 tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 200 len: 1492 microversion: 2.1 time: 0.129600 Aug 27 21:15:20.173920 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2753/5613] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:20 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 1492 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:20.279462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:20.280967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:20.308046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66e2c0e4-63f2-4428-ade7-b7b5527fedc8", "name": "network-vif-deleted", "tag": "92baa260-8020-475e-8c8a-2bd9fc3d6b8a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:20.322198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.326097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.327584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:20.328034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.331417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.332118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.333828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.334903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.337184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.339774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.380286 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] Creating event network-vif-deleted:92baa260-8020-475e-8c8a-2bd9fc3d6b8a for instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 on nch1-master-1 Aug 27 21:15:20.389437 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d06f53b9-7bff-4dad-bead-b435181f248c req-e511b363-d273-4e87-af33-53ac939829bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086618 Aug 27 21:15:20.399560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2754/5614] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:20.578941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:20.588868 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9e322dee-fa7f-40ae-acc7-84ea5343b19a tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.314770 Aug 27 21:15:20.590217 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2861/5615] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:20 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:20.745346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:20.750276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:20.763829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=32 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:20.788481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.795492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.795957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.796718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:20.797190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:20.797611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:20.960479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:20.961127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:20.964546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=32 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:21.001597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.011399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.014708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.016116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.016610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.017031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.262271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:21.276000 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-228e64ce-576b-470d-aa11-470d810a7dd5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.534908 Aug 27 21:15:21.289450 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2755/5616] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:20 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:21.289450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:21.289450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] [instance: 66e2c0e4-63f2-4428-ade7-b7b5527fedc8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:21.302175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.302675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.306674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.308007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.311157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.311842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.353015 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] HTTP exception thrown: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Request method failure captured: Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 HTTP/1.1 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjColIzMSYUnUEMj7mCghM8nrL-3o-jK-N6UXiKVfJqm9OV5-T6MRamp9-qEn6bJXJcqvS2yUAhCBbqDSu0xbMbQaVZVyyeoW8gaiHIx44l5uyxzAdk1lIYHBb6LgdF7uHf-uZBjimo6ZoDH5a6H4vd3rIqGtID2fX_JumQv88jdRLF-c Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 709f6b1496ae4e9d9431df4e22bb6f7c Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1497370950 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/709f6b1496ae4e9d9431df4e22bb6f7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/709f6b1496ae4e9d9431df4e22bb6f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_709f6b1496ae4e9d9431df4e22bb6f7c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/709f6b1496ae4e9d9431df4e22bb6f7c"}]}] Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1497370950 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 709f6b1496ae4e9d9431df4e22bb6f7c Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1497370950 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1497370950-project Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: be3d4127d5624162902bb90076295b51 Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1497370950-project Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '66e2c0e4-63f2-4428-ade7-b7b5527fedc8'} Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:21.355220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. Aug 27 21:15:21.360445 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:21.362142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] Returning 404 to user: Instance 66e2c0e4-63f2-4428-ade7-b7b5527fedc8 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:21.363215 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-08f645a0-1595-4f61-91ea-86c590cd775d tempest-ServersNegativeTestMultiTenantJSON-1497370950 tempest-ServersNegativeTestMultiTenantJSON-1497370950-project] 10.222.0.40 "GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8" status: 404 len: 111 microversion: 2.1 time: 0.082649 Aug 27 21:15:21.364321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2756/5617] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:21 2022] GET /compute/v2.1/servers/66e2c0e4-63f2-4428-ade7-b7b5527fedc8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:21.611303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:21.612068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:21.629755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.630275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.630802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.632931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.634445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.634896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.786090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:21.787003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:21.787692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:21.788310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lazy-loading 'fault' on Instance uuid eafef7f1-0bed-4a72-8ab4-2bec00006e79 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:21.928143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:21.943153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:21.947757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:21.960092 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0484082-bfe2-4a8f-bdb0-35b85655600d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 200 len: 1371 microversion: 2.20 time: 1.002819 Aug 27 21:15:21.964263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2862/5618] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:20 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 1371 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:22.200458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:22.219521 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ea9bcac-cbdd-4d76-8f05-f97974524ada tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.607025 Aug 27 21:15:22.234177 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2757/5619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:21 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:22.301428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:22.302498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:22.322053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:22.324409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:22.325854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:22.330316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:22.331021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:22.331665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:22.426155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eafef7f1-0bed-4a72-8ab4-2bec00006e79", "name": "network-vif-deleted", "tag": "861c8b6d-0545-43ef-8694-ff7ada7126e6"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:22.447379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:22.448408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:22.449020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:22.475279 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] Creating event network-vif-deleted:861c8b6d-0545-43ef-8694-ff7ada7126e6 for instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 on nch2-master-1 Aug 27 21:15:22.487328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-dc9b4fc3-1ac0-4247-b058-4605f9672136 req-0adad6bb-0b03-4e61-9268-487adb74bf89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064815 Aug 27 21:15:22.488284 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2758/5620] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:22.991181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:22.991939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:23.002450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:23.003139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:23.003768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:23.004670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:23.005288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:23.005879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:23.020525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 HTTP/1.1 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'eafef7f1-0bed-4a72-8ab4-2bec00006e79'} Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:23.022502 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-46fd24ed-d94a-4da0-9580-a21184261ccb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 404 len: 111 microversion: 2.20 time: 0.037593 Aug 27 21:15:23.028694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2759/5621] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:22 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:15:23.033376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72b534d6-9f50-4361-b796-e3e332eb8c2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '.version_select at 0x7ff857c68ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:23.064449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72b534d6-9f50-4361-b796-e3e332eb8c2e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872605123" status: 204 len: 0 microversion: 2.20 time: 0.034744 Aug 27 21:15:23.069698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2760/5622] 10.222.0.40 () {60 vars in 1259 bytes} [Sat Aug 27 21:15:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872605123 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:15:23.173626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:23.190152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d3ecb574-fd3b-4e17-8eb9-7bb98e3f9b27 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.896054 Aug 27 21:15:23.191099 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2863/5623] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:22 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:23.243782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:23.244742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:23.258654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:23.264854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:23.265648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:23.266870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:23.267556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:23.268270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:23.609624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:23.634187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d62fb2d2-9373-4822-9ce0-bca0a0da79b1 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.395916 Aug 27 21:15:23.636918 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2761/5624] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:23 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:24.057148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8964f07-7cbd-404d-9833-d069ebc39e4e", "name": "network-vif-plugged", "status": "completed", "tag": "7bafb1bf-cf6f-4f37-afc2-74374d7a896c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:24.082733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:24.084422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:24.084879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:24.108748 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] Creating event network-vif-plugged:7bafb1bf-cf6f-4f37-afc2-74374d7a896c for instance a8964f07-7cbd-404d-9833-d069ebc39e4e on nch2-master-1 Aug 27 21:15:24.116236 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2ecb6837-8f59-4aeb-b08b-6f35e23d49c2 req-49877c64-b890-46d3-8741-5451eb3b5e45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210398 Aug 27 21:15:24.121643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2864/5625] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:24.220509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:24.221076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:24.236882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:24.237674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:24.238309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:24.239571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:24.240204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:24.240886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:24.534990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:24.549246 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d73155e0-2870-461e-bc50-9f47a4eb874f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.336365 Aug 27 21:15:24.552902 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2762/5626] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:24 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:24.660316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:24.661281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:24.676646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:24.678406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:24.678865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:24.682074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:24.683862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:24.684481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:24.911050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:24.922812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3052b4e5-468b-4a19-b4df-386c69abb520 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.268291 Aug 27 21:15:24.929141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2865/5627] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:24 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:24.963866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6f48212-67fc-46b7-96a2-3be5d40ee79d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: .version_select at 0x7ff84dff8820>, body: {"keypair": {"name": "tempest-keypair-1170891779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/c0pu9y95hqXlRicbtChLT7MXchRLJ4xC8NdB5570Iao1ByLlxMt6np/DMgiV8402ox50dCjUJIJGQk5+LWmLW/X90DRLHXZJ612rhWhlC7xKy8HZkPFkAU4yfS8tlEQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:25.022015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d6f48212-67fc-46b7-96a2-3be5d40ee79d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:25.034390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-d6f48212-67fc-46b7-96a2-3be5d40ee79d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for user 3ed5b662d08e405395b930a185b78d47 and project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:25.093017 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6f48212-67fc-46b7-96a2-3be5d40ee79d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.133736 Aug 27 21:15:25.093896 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2763/5628] 10.222.0.40 () {62 vars in 1200 bytes} [Sat Aug 27 21:15:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 21:15:25.574604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:25.577063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:25.585011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:25.591149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:25.593151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:25.596371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:25.597047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:25.599205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:25.956449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:25.957081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:25.990161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:25.990690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:25.991134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:25.991941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:25.992426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:25.992866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:26.340583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:26.357214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-783f2205-7677-469c-97b0-10704cc9e232 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.786467 Aug 27 21:15:26.358844 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2866/5629] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:25 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:26.475209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:26.488923 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-953ef8c2-bfda-4cd9-b871-9d446ddd4ae7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1313 microversion: 2.1 time: 0.540142 Aug 27 21:15:26.501088 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2764/5630] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:25 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:27.388771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:27.390654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:27.409067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:27.415474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:27.416402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:27.417472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:27.418140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:27.427770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:27.514217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:27.515155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:27.535036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:27.535987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:27.536797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:27.537747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:27.538718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:27.547471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:28.213275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:28.241115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21d02166-9880-48ce-b831-d9a7d06704af tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.852127 Aug 27 21:15:28.242510 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2867/5631] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:27 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:28.400578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:28.417686 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0602ffd-4c30-42f8-8866-02feea488bb3 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1498 microversion: 2.1 time: 0.905875 Aug 27 21:15:28.419359 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2765/5632] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:27 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1498 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:28.442495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:28.458863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:28.465341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.server_groups [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Querying cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) for 1 instances {{(pid=140434) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 21:15:28.466564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:28.467535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:28.468024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:28.497715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e8f2cc50-b6c6-46d0-bb9b-8fac204f9084 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d" status: 200 len: 222 microversion: 2.1 time: 0.060535 Aug 27 21:15:28.499272 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2868/5633] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 21:15:28 2022] GET /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d => generated 222 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:28.512957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:28.514530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:28.527012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:28.528186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:28.528833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:28.529753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:28.530459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:28.531062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:28.599929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:15:28.766532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5cc1353c-2204-437e-ba61-311feb7659ba tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 204 len: 0 microversion: 2.1 time: 0.258781 Aug 27 21:15:28.767693 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2766/5634] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:15:28 2022] DELETE /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:15:28.779379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:28.780351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:28.790800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:28.791708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:28.792328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:28.793267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:28.793897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:28.794759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:29.270183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:29.271425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:29.284449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:29.284961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:29.285417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:29.286131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:29.286588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:29.288076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:29.396037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:29.408898 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08f21fa0-ebd4-4719-abd0-7d9fd8b2a843 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1504 microversion: 2.1 time: 0.635442 Aug 27 21:15:29.410502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2869/5635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:28 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:29.984520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:29.989067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:29.996290 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17250e11-3c18-4b95-9e85-59e08733f547 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.730794 Aug 27 21:15:30.016089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2767/5636] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:29 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:30.434242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:30.435683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:30.447152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:30.450687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:30.451456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:30.452891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:30.457269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:30.457984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:30.567088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-722538388", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47578b3b-10ca-4ff3-aca7-0f6cdcbb735f"}], "security_groups": [{"name": "tempest-securitygroup--615921816"}], "key_name": "tempest-keypair-1170891779", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:30.916439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] validate_networks() for [('47578b3b-10ca-4ff3-aca7-0f6cdcbb735f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:15:30.966474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:30.980606 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a6a64d1-267d-49d7-aa84-ec9eb752f4d7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1504 microversion: 2.1 time: 0.550410 Aug 27 21:15:30.984461 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2870/5637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:30 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:31.024270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:31.025701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:31.061057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:31.063884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:31.067974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:31.070751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:31.073737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:31.074425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:31.097541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:31.955666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:31.968528 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a72a58bb-0503-4204-a8fd-606595bf9f30 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.949617 Aug 27 21:15:31.982320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2871/5638] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:31.982320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8964f07-7cbd-404d-9833-d069ebc39e4e", "name": "network-vif-deleted", "tag": "7bafb1bf-cf6f-4f37-afc2-74374d7a896c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:32.002084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:32.002876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:32.003499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:32.021194 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] Creating event network-vif-deleted:7bafb1bf-cf6f-4f37-afc2-74374d7a896c for instance a8964f07-7cbd-404d-9833-d069ebc39e4e on nch2-master-1 Aug 27 21:15:32.038481 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a863e4c9-925c-4a68-ab3e-b8b35cc9eb46 req-77966ddf-0d5a-4e6a-81e7-686695334763 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067598 Aug 27 21:15:32.039088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2872/5639] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:32.057094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:32.058302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:32.075591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:32.076536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:32.076980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:32.078965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:32.079792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:32.080235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:32.142616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:32.144024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:32.144953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:32.146259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lazy-loading 'fault' on Instance uuid a8964f07-7cbd-404d-9833-d069ebc39e4e {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:32.660638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be63cedd051943d582bf17cc16200ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f275a974bf4b8da14c7909d04b219e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:32.670106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-342e58f2-9792-4624-81d4-a398a57093d9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 200 len: 1303 microversion: 2.1 time: 0.627623 Aug 27 21:15:32.670106 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2873/5640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:32 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 1303 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:33.000694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:33.002982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:33.021625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.025547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.027404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.029597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.031750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.034062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.140188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:15:33.141180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:15:33.141846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:15:33.142427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:15:33.143039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:15:33.156365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.157146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.157759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.158699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.160806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.161466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.202193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:15:33.211925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Getting quotas for user 3ed5b662d08e405395b930a185b78d47 and project 12fcf33563bb4c08852f48ad3cb2eed3. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:15:33.260416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:15:33.270767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:15:33.434950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce5d404c-c1a5-4a5b-a3d6-44b31595cc10 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.872080 Aug 27 21:15:33.435710 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2768/5641] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:15:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 21:15:33.446890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:33.447731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:33.601688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:33.617072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e4c23793-9f24-4d88-8692-612b23a4d593 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.629665 Aug 27 21:15:33.619762 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2874/5642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:32 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:33.693566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:33.694216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:33.724139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.725022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.727290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.730222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.730818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.733615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.766580 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e HTTP/1.1 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a8964f07-7cbd-404d-9833-d069ebc39e4e'} Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:33.770403 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:33.775790 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:33.780402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:33.784819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b8570893-9eb4-47e8-b3b6-a8eba1498e17 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 404 len: 111 microversion: 2.1 time: 0.096084 Aug 27 21:15:33.787397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2875/5643] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:33 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:33.807935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:33.850059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.server_groups [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Querying cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) for 1 instances {{(pid=140434) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 21:15:33.857464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.864330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.865219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.880547 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2061924b-6def-4ad6-8e7f-209eb6d55f64 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.085795 Aug 27 21:15:33.881833 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2876/5644] 10.222.0.40 () {58 vars in 1152 bytes} [Sat Aug 27 21:15:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:33.893908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:33.941927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.server_groups [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Querying cell 041b2571-2ebd-443e-8235-90f2a1f62fd5(cell1) for 1 instances {{(pid=140434) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 21:15:33.947714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:33.951516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:33.962142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:33.963964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:33.965415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:33.972483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:33.979600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c50bf39-0539-40eb-9218-ffa502c6d221 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1281 microversion: 2.20 time: 0.531728 Aug 27 21:15:33.980845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2769/5645] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:33 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:33.994795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-afbcbf26-cbad-4bcd-8e39-064a6cb7ca38 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d" status: 200 len: 184 microversion: 2.1 time: 0.104656 Aug 27 21:15:33.997708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2877/5646] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 21:15:33 2022] GET /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d => generated 184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:34.008078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.008774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:34.022716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.026144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.027122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:34.030328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.031946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.033259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:34.065677 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e HTTP/1.1 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a8964f07-7cbd-404d-9833-d069ebc39e4e'} Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:34.067818 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.075204 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.079671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.080799 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0f1dc36-b734-44be-ab62-05798e6529a2 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 404 len: 111 microversion: 2.1 time: 0.076842 Aug 27 21:15:34.082047 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2770/5647] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.091006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.091704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] [instance: a8964f07-7cbd-404d-9833-d069ebc39e4e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:34.109453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.109972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.110425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:34.111149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.111642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.112077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:34.145497 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e HTTP/1.1 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a8964f07-7cbd-404d-9833-d069ebc39e4e'} Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.148068 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance a8964f07-7cbd-404d-9833-d069ebc39e4e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b66d513-c319-49a4-905c-c87d00467ed9 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e" status: 404 len: 111 microversion: 2.1 time: 0.063747 Aug 27 21:15:34.153630 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2878/5648] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:34 2022] GET /compute/v2.1/servers/a8964f07-7cbd-404d-9833-d069ebc39e4e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.158602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fd07601-d620-4e17-b2a4-a1744a88947b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.167411 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2fd07601-d620-4e17-b2a4-a1744a88947b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fd07601-d620-4e17-b2a4-a1744a88947b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-server-groups/fd79b185-6301-4c24-ab41-475bafa7084e HTTP/1.1 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'fd79b185-6301-4c24-ab41-475bafa7084e'} Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.169474 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. Aug 27 21:15:34.176874 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.178406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fd07601-d620-4e17-b2a4-a1744a88947b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance group fd79b185-6301-4c24-ab41-475bafa7084e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.179606 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fd07601-d620-4e17-b2a4-a1744a88947b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/fd79b185-6301-4c24-ab41-475bafa7084e" status: 404 len: 117 microversion: 2.1 time: 0.024776 Aug 27 21:15:34.181631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2771/5649] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/os-server-groups/fd79b185-6301-4c24-ab41-475bafa7084e => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.190974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2393ce4a-bba4-428c-841d-27ec4f9ab485 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.201284 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-2393ce4a-bba4-428c-841d-27ec4f9ab485 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2393ce4a-bba4-428c-841d-27ec4f9ab485 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-server-groups/0025e7b4-9de5-468d-bd38-a169e92536d8 HTTP/1.1 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0025e7b4-9de5-468d-bd38-a169e92536d8'} Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.204088 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.209486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2393ce4a-bba4-428c-841d-27ec4f9ab485 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance group 0025e7b4-9de5-468d-bd38-a169e92536d8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.211125 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2393ce4a-bba4-428c-841d-27ec4f9ab485 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/0025e7b4-9de5-468d-bd38-a169e92536d8" status: 404 len: 117 microversion: 2.1 time: 0.024259 Aug 27 21:15:34.212282 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2879/5650] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/os-server-groups/0025e7b4-9de5-468d-bd38-a169e92536d8 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.222273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06885711-151b-4b97-8fe9-927014ca60b7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.248979 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-06885711-151b-4b97-8fe9-927014ca60b7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06885711-151b-4b97-8fe9-927014ca60b7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-server-groups/7cac8814-7465-4603-bb30-f8870dfaec45 HTTP/1.1 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7cac8814-7465-4603-bb30-f8870dfaec45'} Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.250567 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.256263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-06885711-151b-4b97-8fe9-927014ca60b7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance group 7cac8814-7465-4603-bb30-f8870dfaec45 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.256798 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-06885711-151b-4b97-8fe9-927014ca60b7 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/7cac8814-7465-4603-bb30-f8870dfaec45" status: 404 len: 117 microversion: 2.1 time: 0.039135 Aug 27 21:15:34.257200 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2772/5651] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/os-server-groups/7cac8814-7465-4603-bb30-f8870dfaec45 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.265689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8826ae75-6e1b-4909-b0e4-7ded533b3f7b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.280037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8826ae75-6e1b-4909-b0e4-7ded533b3f7b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] HTTP exception thrown: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8826ae75-6e1b-4909-b0e4-7ded533b3f7b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Request method failure captured: Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/os-server-groups/3cc57a9a-462d-4dad-991f-7c9430086dbc HTTP/1.1 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjColct4qk3ebAeKo-oBl1oymCC4QDphSC-ClOVej-P0spyewPKhGDDrIJULA0RD9B7-fH5TXf75U1S3HwywIyXW2cC1rIwxdLOFtGhoBH-sTYN6b4Jr9QQYokqOaM00izECITuQU-ABdIFvJJCgzcdI5I7pg162JnDNhLSalV8owqf7c Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/43f275a974bf4b8da14c7909d04b219e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_43f275a974bf4b8da14c7909d04b219e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/43f275a974bf4b8da14c7909d04b219e"}]}] Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 43f275a974bf4b8da14c7909d04b219e Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerGroupTestJSON-1003355805 Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: be63cedd051943d582bf17cc16200ccb Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerGroupTestJSON-1003355805-project Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '3cc57a9a-462d-4dad-991f-7c9430086dbc'} Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.281733 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:15:34.287712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8826ae75-6e1b-4909-b0e4-7ded533b3f7b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Returning 404 to user: Instance group 3cc57a9a-462d-4dad-991f-7c9430086dbc could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:34.291372 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8826ae75-6e1b-4909-b0e4-7ded533b3f7b tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/3cc57a9a-462d-4dad-991f-7c9430086dbc" status: 404 len: 117 microversion: 2.1 time: 0.029779 Aug 27 21:15:34.296185 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2880/5652] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/os-server-groups/3cc57a9a-462d-4dad-991f-7c9430086dbc => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:34.314944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02da767f-5da0-4014-973b-6db93e9e52d4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.388195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02da767f-5da0-4014-973b-6db93e9e52d4 tempest-ServerGroupTestJSON-1003355805 tempest-ServerGroupTestJSON-1003355805-project] 10.222.0.40 "DELETE /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d" status: 204 len: 0 microversion: 2.1 time: 0.087551 Aug 27 21:15:34.389401 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2773/5653] 10.222.0.40 () {58 vars in 1266 bytes} [Sat Aug 27 21:15:34 2022] DELETE /compute/v2.1/os-server-groups/5e954173-5000-49ee-81be-aa60a09c365d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:34.641790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:34.642635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:34.660719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.663783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.664261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:34.667879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:34.668582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:34.669224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:35.013816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:35.014922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:35.033152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:35.035786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:35.050461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:35.054835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:35.056534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:35.058138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:35.262001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:35.272020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06f0d2ce-097d-4c72-8a19-6cdb6fb4fd7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.634365 Aug 27 21:15:35.286978 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2881/5654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:34 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:35.344591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:35.360488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:35.361973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:35.363117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e225a4ee-aece-46a8-96e6-3cc460600c9a tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1333 microversion: 2.20 time: 0.359400 Aug 27 21:15:35.363717 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2774/5655] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:35 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1333 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:36.294493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:36.299273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:36.312451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:36.313543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:36.314149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:36.315088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:36.315786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:36.322626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:36.386964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:36.388716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:36.396545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:36.399372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:36.400539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:36.401759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:36.402434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:36.403302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:36.865994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:36.880141 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc6c8a77-62ea-43fb-9e31-f557611cfab7 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1527 microversion: 2.1 time: 0.590145 Aug 27 21:15:36.882219 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2882/5656] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1527 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:36.984429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:37.024913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:37.029030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:37.033220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e688f588-2c1f-4b52-9fd2-5d8f374e9da3 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.651254 Aug 27 21:15:37.034563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2775/5657] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:36 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:37.840354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:37.840993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:37.855160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:37.859973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:37.860557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:37.861526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:37.862098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:37.862685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:37.903681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:37.905826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:37.913736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:37.918292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:37.919259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:37.921296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:37.923681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:37.924394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:37.928784 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc4793d3-8bbc-4d78-9863-ef5ad545ab98 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/ips" status: 200 len: 145 microversion: 2.1 time: 0.093863 Aug 27 21:15:37.938940 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2883/5658] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:15:37 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/ips => generated 145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:38.058819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:38.059473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:38.076024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:38.076555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:38.077015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:38.079755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:38.080711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:38.082950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:38.372027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:38.392020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b715d7a5-df19-4f08-9cdc-d9a3e4498407 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1509 microversion: 2.1 time: 0.492720 Aug 27 21:15:38.392623 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2776/5659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:37 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:38.527788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:38.555851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:38.562927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:38.565816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4a87fd12-c8b9-49b6-8f88-17be7c08a7fb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.512360 Aug 27 21:15:38.568214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2884/5660] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:38 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:39.415577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:39.416197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:39.423196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.424012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.424853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:39.425532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.426148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.426723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:39.571050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0181737c-e695-4334-adad-23facf867139"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:39.574467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:39.581797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.582287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.583233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:39.583870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.584279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.584712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:39.667054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:39.709417 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca337fdd-665b-479d-aa24-e612e36f3682 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1509 microversion: 2.1 time: 0.297122 Aug 27 21:15:39.712695 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2777/5661] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:39 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:39.724525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:39.725358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:39.741234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.767992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.769600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:39.769600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:39.770457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:39.771105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:40.133651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d34e525-3f07-4ae6-8619-075b5440595f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566444 Aug 27 21:15:40.139657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2885/5662] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:15:39 2022] POST /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:40.162322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:40.183381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:40.194699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:40.203919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:40.205877 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0a8ce49d-add9-46c5-92b8-e9676c8c8f2f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.491953 Aug 27 21:15:40.211411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2778/5663] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:39 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:40.218809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "name": "network-vif-unplugged", "status": "completed", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:40.228190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:40.228697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:40.232502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:40.236432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:40.238099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:40.248155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:40.251536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:40.253217 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] Creating event network-changed:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch1-master-1 Aug 27 21:15:40.260606 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ae0cd9c2-3da1-47ac-bd84-14a8fa3e9ee3 req-0dfac130-9cc6-4c16-b494-2383e5682d59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113727 Aug 27 21:15:40.262050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2886/5664] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:40.295526 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] Creating event network-vif-unplugged:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:15:40.334468 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7af7344e-5840-495e-be14-76382caec612 req-08fb630b-3ad9-4754-8e9b-112aea542fc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120126 Aug 27 21:15:40.338709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2779/5665] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:40.738689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:40.739218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:40.758688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:40.759569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:40.762916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:40.766587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:40.770328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:40.771030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:41.235219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:41.236258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:41.254692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:41.255274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:41.256400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:41.257137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:41.258139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:41.258780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:41.502881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:41.514481 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42143d55-98f6-4462-b1b3-c57b2950581b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1509 microversion: 2.1 time: 0.781049 Aug 27 21:15:41.515091 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2887/5666] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:40 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1509 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:41.747525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:41.757023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:41.758553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:41.770167 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc9b8dd2-2a1b-423a-aec2-d0e641ed8862 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.539552 Aug 27 21:15:41.770796 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2780/5667] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:41 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:42.537691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:42.539017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:42.549145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:42.550068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:42.551166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:42.552238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:42.553000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:42.553749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:42.737043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:42.751913 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92380e11-83f9-4a8d-95fc-01fd4305126c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1509 microversion: 2.1 time: 0.219227 Aug 27 21:15:42.753615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2888/5668] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:42 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:42.795290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:42.795933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:42.812254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:42.815054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:42.815796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:42.830916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:42.832064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:42.832844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:43.100379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:43.115613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:43.124469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:43.125846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf18643e-f91f-4b73-b67d-1b793e8ae419 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.334450 Aug 27 21:15:43.126809 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2781/5669] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:42 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:43.782597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:43.783233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:43.810071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:43.812059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:43.815964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:43.819486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:43.820461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:43.820986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:44.152515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:44.153237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:44.160311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:44.163134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:44.169325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:44.170479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:44.171208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:44.173015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:44.174182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:44.175074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:44.571672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:44.583588 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aabdadfc-e990-4232-b30b-e4f15546f179 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1452 microversion: 2.1 time: 0.810816 Aug 27 21:15:44.588956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2889/5670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:43 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1452 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:44.613398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:44.614538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:44.626306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:44.630321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:44.632026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:44.633200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:44.633816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:44.636292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:44.782141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:44.797907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:44.800264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:44.802661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6e1a398-283c-47ad-83d4-b90e1916dda4 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.657247 Aug 27 21:15:44.816158 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2782/5671] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:44 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:44.953999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:44.971257 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c5ae983-330c-4bc6-997e-dc8f370c02ed tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1452 microversion: 2.1 time: 0.363794 Aug 27 21:15:44.974655 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2890/5672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:44 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1452 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:45.047407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:45.048347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:45.072248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.076201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.079601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.080720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.083386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.086041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.161935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'flavor' on Instance uuid ff1b42cc-61cd-437d-92ca-1c27fd1fd538 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:45.201235 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'shelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state shelved_offloaded Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 14 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: {"shelve": {}} Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'shelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state shelved_offloaded Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'shelve': {}}} Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:15:45.209936 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state shelved_offloaded Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state shelved_offloaded Aug 27 21:15:45.216398 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:45.225942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'shelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state shelved_offloaded {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:45.227287 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62304b5b-d355-4844-b228-99399882e55b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 155 microversion: 2.1 time: 0.186683 Aug 27 21:15:45.229440 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2783/5673] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:15:45 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 155 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:15:45.240291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:45.240915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:45.247465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.247989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.248512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.249265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.249856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.250453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.372830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140434) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 21:15:45.500256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:45.572375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7ec8c11-ac78-4946-9f8d-04dbf679e1d1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.337554 Aug 27 21:15:45.579255 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2891/5674] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:15:45 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:15:45.603176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:45.603839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:45.636983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.637601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.640313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.643011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.646182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.650082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.829453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:45.830382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:45.857608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.858730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.860846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:45.862354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:45.864059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:45.865879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:46.241035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:46.255456 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1b9a488-a965-45f0-bbce-b23744794da1 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1460 microversion: 2.1 time: 0.669782 Aug 27 21:15:46.264336 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2784/5675] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:45 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1460 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:46.270209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:46.273675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:46.316404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:46.316907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:46.333180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:46.336255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:46.337227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:46.340538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:46.341318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:46.356621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:46.358773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:46.365047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-052db24f-62e9-4773-b025-1cc17a76384d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.538217 Aug 27 21:15:46.366066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2892/5676] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:45 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:46.411432 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e7dc2db-63b3-4e52-8f20-c1a4265dbf29 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145359 Aug 27 21:15:46.413170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2785/5677] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:15:46 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:46.423141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:46.423931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:46.434629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:46.436507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:46.437981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:46.440209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:46.440943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:46.442063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:46.523158 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b576a815-eead-46a2-9024-56e5b1386425 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139" status: 200 len: 194 microversion: 2.1 time: 0.104241 Aug 27 21:15:46.524710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2893/5678] 10.222.0.40 () {58 vars in 1413 bytes} [Sat Aug 27 21:15:46 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139 => generated 194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:47.276519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:47.277261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:47.289030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:47.289706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:47.290284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:47.292830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:47.293434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:47.295368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:47.397066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:47.398718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:47.416814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:47.417333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:47.418438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:47.422295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:47.422737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:47.423206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:47.878784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:47.890053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-141434ce-1d85-4b2a-9e35-6bb54a9ce94f tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1460 microversion: 2.1 time: 0.617450 Aug 27 21:15:47.903645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:47.907598 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2786/5679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:47 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1460 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:47.912907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:47.914584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:47.916074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e3db70b1-29a4-4b39-98da-19e835460b97 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.524846 Aug 27 21:15:47.916860 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2894/5680] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:47 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:48.268596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92e11cba-093d-477a-884f-674297358856"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:48.272173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:48.284609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:48.285307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:48.285544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:48.286273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:48.286731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:48.287167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:48.784623 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4424bbb5-88a8-4705-845e-50d1ae84434f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "POST /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521910 Aug 27 21:15:48.802663 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2787/5681] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:15:48 2022] POST /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:48.819911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Action: 'create', calling method: .version_select at 0x7ff84dbc8160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1045453927"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:48.914096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:48.914842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:48.948305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:48.951633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:48.952111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:48.952876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:48.953340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:48.965576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:49.439711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:49.449575 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e29bf87-e685-42df-a6e1-cfd6be80db6e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1462 microversion: 2.1 time: 0.539918 Aug 27 21:15:49.453991 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2788/5682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:48 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1462 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:49.468928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:49.469555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:49.471986 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.969548 Aug 27 21:15:49.472902 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2895/5683] 10.222.0.40 () {60 vars in 1155 bytes} [Sat Aug 27 21:15:48 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 971 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 21:15:49.489133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-adc02d2b-9fe4-4499-a3f1-eeb2302cd268 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84de22af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:49.500932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:49.501443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:49.501887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:49.502608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:49.503062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:49.503527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:49.556913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:49.593110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-adc02d2b-9fe4-4499-a3f1-eeb2302cd268 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 200 len: 338 microversion: 2.1 time: 0.108228 Aug 27 21:15:49.593966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2896/5684] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:15:49 2022] GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:49.760935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:49.761512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "name": "network-vif-plugged", "status": "completed", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:49.777899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:49.782386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:49.782891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:49.783353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:49.785553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:49.787509 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f5207f5-d3a0-47ea-ae1b-aad57aec38bc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.332460 Aug 27 21:15:49.792402 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2789/5685] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:49 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:49.828350 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] Creating event network-vif-plugged:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch1-master-1 Aug 27 21:15:49.839735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-81594c5b-8f82-4165-bef2-5353595b655c req-1f7b5e96-c369-4aad-a592-c7e3f8f84e2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082289 Aug 27 21:15:49.843187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2897/5686] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:50.481299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:50.483691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:50.522579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:50.523144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:50.528789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:50.529969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:50.530844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:50.531498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:50.610189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb2ce54b-ca9c-48ac-9470-78239f88fa70 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dce74c0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:50.722743 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb2ce54b-ca9c-48ac-9470-78239f88fa70 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 200 len: 339 microversion: 2.1 time: 0.116910 Aug 27 21:15:50.723351 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2898/5687] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:15:50 2022] GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:50.737654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-518fa5da-35be-4af4-aa26-41ec4432d69d tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Action: 'create', calling method: .version_select at 0x7ff84dc4ea60>, body: {"snapshot": {"volume_id": "9f4af3ca-608e-4ac7-8a66-abde29b67378", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-745261620"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:51.099689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:51.117515 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f673f24e-80ed-4968-a76d-1b7db4be6329 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.644953 Aug 27 21:15:51.118250 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2790/5688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:50 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:51.129129 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-518fa5da-35be-4af4-aa26-41ec4432d69d tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.395340 Aug 27 21:15:51.129723 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2899/5689] 10.222.0.40 () {60 vars in 1162 bytes} [Sat Aug 27 21:15:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:51.150161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1e27150-1147-4e75-aa81-bb8d0a4de4bf tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dc6c790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:51.166273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:51.167193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:51.187518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:51.188686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:51.189131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:51.189858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:51.190322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:51.190734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:51.220500 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1e27150-1147-4e75-aa81-bb8d0a4de4bf tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 200 len: 286 microversion: 2.1 time: 0.083916 Aug 27 21:15:51.221076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2900/5690] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:51 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:51.233365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1bf780b2-0e98-496d-9ec3-3bb2be9627db tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dbc88b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:51.322810 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1bf780b2-0e98-496d-9ec3-3bb2be9627db tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094015 Aug 27 21:15:51.323963 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2901/5691] 10.222.0.40 () {58 vars in 1140 bytes} [Sat Aug 27 21:15:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:51.342574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b27c530a-b571-45c7-9382-778e9f1b5cd7 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dcadb80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:51.406575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b27c530a-b571-45c7-9382-778e9f1b5cd7 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 200 len: 286 microversion: 2.1 time: 0.073490 Aug 27 21:15:51.412824 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2902/5692] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:51 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:51.552267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:51.584597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:51.586190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:51.590454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d29dd032-df36-4b87-aa33-1e57ea9e3a29 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1406 microversion: 2.20 time: 0.466047 Aug 27 21:15:51.594873 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2791/5693] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:51 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:15:52.141995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:52.142955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:52.159023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:52.161931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:52.164913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:52.167856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:52.168360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:52.169008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:52.423166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4683fc6e-efbb-4fb4-80fe-f6d824d4af0f tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dff83a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:52.509520 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4683fc6e-efbb-4fb4-80fe-f6d824d4af0f tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 200 len: 286 microversion: 2.1 time: 0.090672 Aug 27 21:15:52.510220 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2792/5694] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:52 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:52.615997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:52.616725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:52.628734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:52.637483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:52.639879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:52.642368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:52.646372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:52.646947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:53.458312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:53.481385 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc9e4c4a-48cd-451f-b349-4345b94f9d58 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 1.344656 Aug 27 21:15:53.483963 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2903/5695] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:52 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:53.523836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5753079b-781a-48e8-a239-66ad0ee5ebcc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dd4e790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:53.548546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:53.558762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:53.565445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:53.572588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f92aebb-b805-45c0-b319-bd6786000d9b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1597 microversion: 2.20 time: 0.961010 Aug 27 21:15:53.576973 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2793/5696] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:15:52 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1597 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:15:53.600904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:53.602038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:53.617144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:53.621768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:53.622632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:53.622779 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5753079b-781a-48e8-a239-66ad0ee5ebcc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 200 len: 287 microversion: 2.1 time: 0.103502 Aug 27 21:15:53.624586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:53.630262 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2904/5697] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:53 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:53.631010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:53.635325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:53.636985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dd4edc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:53.779107 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 202 len: 0 microversion: 2.1 time: 0.147141 Aug 27 21:15:53.779779 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2905/5698] 10.222.0.40 () {58 vars in 1254 bytes} [Sat Aug 27 21:15:53 2022] DELETE /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:15:53.790213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:53.798265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:53.819238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:53.822841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:53.823579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:53.825769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:53.826556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:53.827167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:53.929352 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50b9a053-3d33-4bf0-b365-d6eb2c82b4d4 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.147216 Aug 27 21:15:53.931824 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2906/5699] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:15:53 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:53.944754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8493fc3d-bc4d-4613-b702-3656dc75e66b tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84dcc93a0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:54.013216 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8493fc3d-bc4d-4613-b702-3656dc75e66b tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 200 len: 286 microversion: 2.1 time: 0.079673 Aug 27 21:15:54.022065 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2907/5700] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:53 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:54.078242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:54.078907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:54.090371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.099405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.103969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.105603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.106489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.107509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.156125 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a17b6be-7586-4910-8c67-4950871042e9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.559142 Aug 27 21:15:54.157059 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2794/5701] 10.222.0.40 () {60 vars in 1316 bytes} [Sat Aug 27 21:15:53 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-interface => generated 284 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:15:54.258466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07cbb19c-c4fc-4460-97fa-176d8226d328 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139" status: 200 len: 194 microversion: 2.1 time: 0.185367 Aug 27 21:15:54.269600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2908/5702] 10.222.0.40 () {58 vars in 1413 bytes} [Sat Aug 27 21:15:54 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139 => generated 194 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:54.270285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:54.270819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:54.301068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.318283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.319812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.321665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.322350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.322979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.510009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:54.512137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:54.526848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.531638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.534609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.536369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:54.538609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:54.542830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:54.625393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lazy-loading 'services' on Instance uuid 02d914b2-3d53-4cd5-920c-a5014c1cb579 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:54.875444 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-23965bfb-14df-42e8-af2f-d9456626297f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139" status: 202 len: 0 microversion: 2.1 time: 0.609420 Aug 27 21:15:54.876062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2795/5703] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:15:54 2022] DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/0181737c-e695-4334-adad-23facf867139 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:15:55.049913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bda209d6-c2ed-4565-91cf-e2f06f114e34 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e1b6ee0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:55.102788 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-bda209d6-c2ed-4565-91cf-e2f06f114e34 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] HTTP exception thrown: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bda209d6-c2ed-4565-91cf-e2f06f114e34 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Request method failure captured: Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 HTTP/1.1 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjComE6ft31YjKjZGBsDeJ3sFjt5GQSavRAJs8LF2QEzusYCmEonmv_vqfnKfmDiokMJxKBWbb65OusVjbADCPjy3w_VdkULx3fyolZLPp07J0gZVtbzx9J0ei__Y7nE51OOlQQLGelVACqyaXgTohs8NK_NmvEd1llbNABqBSvyzgeng Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4bc1ca5ce0b34fbf9f16f2a0b60e93ef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}] Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 13d8ca681c254fac8a3f3fd2245dff7b Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: exception: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '6decd9cc-1ddf-42e5-8476-8df9624cc7e0'} Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. (HTTP 404) (Request-ID: req-eb590d03-f26d-4dc8-bf90-6ba15025b222) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:15:55.110955 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. Aug 27 21:15:55.115942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:55.129054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bda209d6-c2ed-4565-91cf-e2f06f114e34 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Returning 404 to user: Snapshot 6decd9cc-1ddf-42e5-8476-8df9624cc7e0 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:55.130393 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bda209d6-c2ed-4565-91cf-e2f06f114e34 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0" status: 404 len: 111 microversion: 2.1 time: 0.104094 Aug 27 21:15:55.131600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2796/5704] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:15:55 2022] GET /compute/v2.1/os-snapshots/6decd9cc-1ddf-42e5-8476-8df9624cc7e0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:55.143056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e1c0430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:55.325819 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 202 len: 0 microversion: 2.1 time: 0.189301 Aug 27 21:15:55.327273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2797/5705] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:15:55 2022] DELETE /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:15:55.335417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ba6dc5a-ae1d-43b4-94ab-357e1824bf28 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e1c09d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:55.554540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ba6dc5a-ae1d-43b4-94ab-357e1824bf28 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 200 len: 338 microversion: 2.1 time: 0.223237 Aug 27 21:15:55.556203 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2798/5706] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:15:55 2022] GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:55.959413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:55.976248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a3f54334-6747-4f8f-b754-cc63f279a525 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 1.471047 Aug 27 21:15:55.990604 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2909/5707] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:54 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:15:56.228815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:56.229562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:56.255455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:56.257579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:56.259619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:56.260632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:56.262058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:56.264146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:56.378617 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-02688690-1919-49a4-9ba7-1b7ec541786f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/92e11cba-093d-477a-884f-674297358856" status: 200 len: 194 microversion: 2.1 time: 0.157691 Aug 27 21:15:56.392470 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2799/5708] 10.222.0.40 () {58 vars in 1413 bytes} [Sat Aug 27 21:15:56 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/92e11cba-093d-477a-884f-674297358856 => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:15:56.404630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:56.405414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:56.422277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:56.422857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:56.458584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:56.460457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:56.465928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:56.466398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:56.574196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b155cae-d8e9-4b7f-bab9-2d54766bbd52 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e1d6790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:56.672690 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-3b155cae-d8e9-4b7f-bab9-2d54766bbd52 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] HTTP exception thrown: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b155cae-d8e9-4b7f-bab9-2d54766bbd52 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Request method failure captured: Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 HTTP/1.1 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjComE6ft31YjKjZGBsDeJ3sFjt5GQSavRAJs8LF2QEzusYCmEonmv_vqfnKfmDiokMJxKBWbb65OusVjbADCPjy3w_VdkULx3fyolZLPp07J0gZVtbzx9J0ei__Y7nE51OOlQQLGelVACqyaXgTohs8NK_NmvEd1llbNABqBSvyzgeng Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4bc1ca5ce0b34fbf9f16f2a0b60e93ef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}] Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 13d8ca681c254fac8a3f3fd2245dff7b Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9f4af3ca-608e-4ac7-8a66-abde29b67378'} Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. (HTTP 404) (Request-ID: req-5109ee0a-a453-4fd3-9131-4e1996113f01) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:15:56.674908 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b155cae-d8e9-4b7f-bab9-2d54766bbd52 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Returning 404 to user: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:56.680495 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b155cae-d8e9-4b7f-bab9-2d54766bbd52 tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 404 len: 109 microversion: 2.1 time: 0.109231 Aug 27 21:15:56.684292 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2800/5709] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:15:56 2022] GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:56.686900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-372f3004-c970-403c-ab83-7bee54f397fc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e28c940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:56.829145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-372f3004-c970-403c-ab83-7bee54f397fc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] HTTP exception thrown: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-372f3004-c970-403c-ab83-7bee54f397fc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Request method failure captured: Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 HTTP/1.1 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjComE6ft31YjKjZGBsDeJ3sFjt5GQSavRAJs8LF2QEzusYCmEonmv_vqfnKfmDiokMJxKBWbb65OusVjbADCPjy3w_VdkULx3fyolZLPp07J0gZVtbzx9J0ei__Y7nE51OOlQQLGelVACqyaXgTohs8NK_NmvEd1llbNABqBSvyzgeng Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4bc1ca5ce0b34fbf9f16f2a0b60e93ef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}] Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 13d8ca681c254fac8a3f3fd2245dff7b Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9f4af3ca-608e-4ac7-8a66-abde29b67378'} Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. (HTTP 404) (Request-ID: req-b52e1616-cf0c-478e-a52c-a8443c1941bf) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:15:56.831222 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-372f3004-c970-403c-ab83-7bee54f397fc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Returning 404 to user: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-372f3004-c970-403c-ab83-7bee54f397fc tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 404 len: 109 microversion: 2.1 time: 0.150358 Aug 27 21:15:56.837914 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2801/5710] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:15:56 2022] DELETE /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:56.852639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lazy-loading 'services' on Instance uuid 02d914b2-3d53-4cd5-920c-a5014c1cb579 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:15:56.863759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35b65b1a-52b8-44b0-937d-87a592546ceb tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Calling method '.version_select at 0x7ff84e1d6940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:56.951541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-35b65b1a-52b8-44b0-937d-87a592546ceb tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] HTTP exception thrown: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35b65b1a-52b8-44b0-937d-87a592546ceb tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Request method failure captured: Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 HTTP/1.1 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjComE6ft31YjKjZGBsDeJ3sFjt5GQSavRAJs8LF2QEzusYCmEonmv_vqfnKfmDiokMJxKBWbb65OusVjbADCPjy3w_VdkULx3fyolZLPp07J0gZVtbzx9J0ei__Y7nE51OOlQQLGelVACqyaXgTohs8NK_NmvEd1llbNABqBSvyzgeng Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4bc1ca5ce0b34fbf9f16f2a0b60e93ef", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4bc1ca5ce0b34fbf9f16f2a0b60e93ef"}]}] Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4bc1ca5ce0b34fbf9f16f2a0b60e93ef Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-808827494 Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 13d8ca681c254fac8a3f3fd2245dff7b Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesSnapshotsTestJSON-808827494-project Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '9f4af3ca-608e-4ac7-8a66-abde29b67378'} Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. (HTTP 404) (Request-ID: req-07ea313f-e08b-4614-b165-8af7c11615d1) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:15:56.953785 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. Aug 27 21:15:56.958840 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:15:56.963586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35b65b1a-52b8-44b0-937d-87a592546ceb tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] Returning 404 to user: Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:15:56.964639 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35b65b1a-52b8-44b0-937d-87a592546ceb tempest-VolumesSnapshotsTestJSON-808827494 tempest-VolumesSnapshotsTestJSON-808827494-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378" status: 404 len: 109 microversion: 2.1 time: 0.125123 Aug 27 21:15:56.970913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2802/5711] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:15:56 2022] GET /compute/v2.1/os-volumes/9f4af3ca-608e-4ac7-8a66-abde29b67378 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:15:57.017363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:57.017918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:57.042514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:57.043033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:57.043712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:57.054168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04419b33-744a-415e-8be3-55c54c63fe76 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/92e11cba-093d-477a-884f-674297358856" status: 202 len: 0 microversion: 2.1 time: 0.654179 Aug 27 21:15:57.061079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:57.061297 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2910/5712] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:15:56 2022] DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments/92e11cba-093d-477a-884f-674297358856 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:15:57.072531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:57.073508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:58.350362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:15:58.364699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4f6c68c-16e9-4c53-867e-20ebd89766dd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 1.358178 Aug 27 21:15:58.374290 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2803/5713] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:57 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:15:58.470400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:58.473764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:58.511968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:58.514738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:58.515365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:58.516406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:58.517439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:58.519280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:58.604804 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ca85fbe-f2ae-4123-8ef9-02abf26df42c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137000 Aug 27 21:15:58.605982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2911/5714] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:15:58 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:15:58.867277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:58.870115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:58.904252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:58.907077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:58.917382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:58.920374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:58.921289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:58.923456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:59.021216 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5e27354b-6610-4122-8c7c-0c31fe408d04 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158467 Aug 27 21:15:59.022309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:15:59.025764 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2804/5715] 10.222.0.40 () {58 vars in 1302 bytes} [Sat Aug 27 21:15:58 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:15:59.038672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:15:59.043573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:59.045727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:59.046433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:59.087808 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] Creating event network-changed:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch1-master-1 Aug 27 21:15:59.094914 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8d8ee5ec-1267-4574-84e4-d1a6a55d0a96 req-fb05d0e5-4c2e-4f09-8e9c-3656e53791c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082962 Aug 27 21:15:59.095968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2912/5716] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:15:59.200857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:59.201940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:59.216366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:59.218512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:59.220513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:59.225121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:59.225232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:59.227819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:59.365105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:15:59.651414 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dc649b6e-4ffd-406d-8a86-cb7b6af9e781 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 204 len: 0 microversion: 2.1 time: 0.455427 Aug 27 21:15:59.655617 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2805/5717] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:15:59 2022] DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:15:59.658605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:15:59.659457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:15:59.674805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:59.676009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:59.677286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:15:59.678135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:15:59.679868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:15:59.681376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:00.077706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:00.087793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5fb5cf4-db0d-437a-81e1-1eb36f9d7ff3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.432781 Aug 27 21:16:00.099423 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2806/5718] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:15:59 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:00.121578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:00.124973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:00.154823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:00.157707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:00.161010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:00.163305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:00.166788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:00.169770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:00.191794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2007284045", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:00.400600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] validate_networks() for [('4df3eaf5-67ac-4837-b181-fef00d86521f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:16:01.096087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:01.109749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4dab90de-d052-4211-84e3-89dd87f23c26 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1674 microversion: 2.1 time: 1.005211 Aug 27 21:16:01.123557 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2807/5719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:00 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1674 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:01.136725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:01.138209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:01.167193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:01.167878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:01.168389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:01.171024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:01.172338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:01.173969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:01.800659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:01.825255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9ae86d9-bae2-43e5-a984-280e37d7774e tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.692789 Aug 27 21:16:01.847906 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2808/5720] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:01 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:02.134718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:02.135514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:02.150324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:02.151077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:02.151980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:02.153041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:02.156092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:02.156992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:02.168349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:16:02.169495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:16:02.170595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:16:02.171250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:16:02.172193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:16:02.195241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:02.200275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:02.204806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:02.206081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:02.213338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:02.214174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:02.339230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Getting quotas for project cecffcd3f1204f589fd2cb6bc942b0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:16:02.361239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Getting quotas for user 9054fd09ee6f4b3abe9279eb1166cbc7 and project cecffcd3f1204f589fd2cb6bc942b0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:16:02.406448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:16:02.432187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:16:02.566964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-612d623a-4a83-4afd-b1b4-3a37ab4bfb7f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.186548 Aug 27 21:16:02.577450 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2913/5721] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:15:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:16:02.588162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-416299b9-c647-4d4f-a1af-bb937fa06c24 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:02.589461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-416299b9-c647-4d4f-a1af-bb937fa06c24 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:04.459027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-416299b9-c647-4d4f-a1af-bb937fa06c24 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:04.490273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-416299b9-c647-4d4f-a1af-bb937fa06c24 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1214 microversion: 2.1 time: 1.911361 Aug 27 21:16:04.511929 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2914/5722] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:02 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1214 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:04.519078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:04.535966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:04.548947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:04.560209 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-268f5998-0ed7-46cb-a3a0-2fb183d08c7e tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1606 microversion: 2.1 time: 2.429369 Aug 27 21:16:04.575966 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2809/5723] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:02 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1606 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:04.578017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:04.587590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:04.588065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:04.588846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:04.589315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:04.603704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:04.851237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39bbd8ed-ccba-4c10-a708-a03e645d6b61 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e00e3a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:04.977049 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39bbd8ed-ccba-4c10-a708-a03e645d6b61 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e3eade37-eedd-4ab8-9c81-e9a598ec26b4" status: 200 len: 343 microversion: 2.1 time: 0.129304 Aug 27 21:16:04.977641 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2810/5724] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:16:04 2022] GET /compute/v2.1/os-volumes/e3eade37-eedd-4ab8-9c81-e9a598ec26b4 => generated 343 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:05.135822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d914b2-3d53-4cd5-920c-a5014c1cb579", "name": "network-vif-deleted", "tag": "ae49cf36-2770-4b28-bdeb-0dc93c0a2f39"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:05.176581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.178831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.179381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.252492 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] Creating event network-vif-deleted:ae49cf36-2770-4b28-bdeb-0dc93c0a2f39 for instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 on nch1-master-1 Aug 27 21:16:05.288234 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-64dac396-b705-47fe-9ebf-4d2ba5f52a00 req-dc49d13a-428a-4375-8fd2-88643cb10d55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155719 Aug 27 21:16:05.294580 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2811/5725] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:16:05.408372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:05.421617 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-123c49c4-a87c-489f-8052-fb7711e53c64 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.907251 Aug 27 21:16:05.424394 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2915/5726] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:04 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:05.518555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:05.527428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:05.543913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.556539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.559962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.561265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.572744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.573658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.590299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:05.591749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:05.609446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.611850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.613634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.617244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.619824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.620909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.651701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:05.740233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:05.743599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:05.744251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:05.747203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lazy-loading 'fault' on Instance uuid 02d914b2-3d53-4cd5-920c-a5014c1cb579 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:16:05.993268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7266d6f3c5f44e758e222cf97e0cda65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a854ce08e212478fbc2bb8eb7d78b145', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:06.018882 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-886b6639-e116-4671-bccc-7e1346d5ea92 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 200 len: 1328 microversion: 2.1 time: 0.430066 Aug 27 21:16:06.031105 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2916/5727] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:05 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 1328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:06.138851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:06.151492 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a4a1db5-f82d-4a07-8209-3b75a718e96d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1274 microversion: 2.1 time: 0.639472 Aug 27 21:16:06.153300 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2812/5728] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:05 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1274 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:06.451498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:06.454172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:06.474918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:06.475970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:06.477677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:06.480630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:06.482793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:06.484274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:07.052843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:07.054251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:07.069130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:07.078713 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6bc9291a-3ef9-45c6-ad4d-0d67b5e4f6e4 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.637762 Aug 27 21:16:07.087937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:07.092799 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2917/5729] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:06 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:07.103801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:07.106445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:07.108092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:07.108754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:07.111397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:07.114813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8aeb2120-1f38-43a1-b2d1-a02fd6d749e1 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84dcadf70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:07.129657 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 HTTP/1.1 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '02d914b2-3d53-4cd5-920c-a5014c1cb579'} Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:07.131695 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:07.137639 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:07.139089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:07.140234 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd6cdde3-976c-440c-8737-e64b6d973e5b tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 404 len: 111 microversion: 2.1 time: 0.091513 Aug 27 21:16:07.144975 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2813/5730] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:07 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:07.150372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45c82076-723f-4694-b33a-09d729505eed tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '.version_select at 0x7ff84e1c0d30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:07.188618 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-45c82076-723f-4694-b33a-09d729505eed tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480491318" status: 202 len: 0 microversion: 2.1 time: 0.042211 Aug 27 21:16:07.193604 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2814/5731] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480491318 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:16:07.199785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:07.200618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:07.208023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:07.208778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:07.209414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:07.210582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:07.211312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:07.212054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:07.271812 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8aeb2120-1f38-43a1-b2d1-a02fd6d749e1 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6a9b13e1-fc0a-4dac-a452-c94aa84fae64" status: 200 len: 343 microversion: 2.1 time: 0.166196 Aug 27 21:16:07.282167 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2918/5732] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:16:07 2022] GET /compute/v2.1/os-volumes/6a9b13e1-fc0a-4dac-a452-c94aa84fae64 => generated 343 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:16:07.458499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:07.469477 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-730a5492-7a62-4064-acdc-d53cd1323547 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1272 microversion: 2.1 time: 0.272489 Aug 27 21:16:07.483373 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2815/5733] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:07 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:08.119789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:08.120590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:08.128768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:08.129670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:08.130446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:08.131266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:08.131970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:08.132526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:08.449712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:08.459737 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3acdac70-0732-4cfd-b9f8-26f464a64c21 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.346470 Aug 27 21:16:08.461043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2919/5734] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:08 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:08.495172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:08.496687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:08.506155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:08.506798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:08.507255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:08.508817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:08.509807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:08.512346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:08.891436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6d02387-e5a5-46b3-845f-089224f2c6d6 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84dd4e280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:08.953480 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6d02387-e5a5-46b3-845f-089224f2c6d6 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/47f10a7f-58ea-4ccf-aaee-21d3100d016d" status: 200 len: 344 microversion: 2.1 time: 0.066247 Aug 27 21:16:08.954263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2920/5735] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:16:08 2022] GET /compute/v2.1/os-volumes/47f10a7f-58ea-4ccf-aaee-21d3100d016d => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:16:08.967681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f4c7968-04c2-423c-8ec6-e37bca0da406 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84dd4e8b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.063928 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f4c7968-04c2-423c-8ec6-e37bca0da406 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.100081 Aug 27 21:16:09.064770 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2921/5736] 10.222.0.40 () {58 vars in 1134 bytes} [Sat Aug 27 21:16:08 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:09.078849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-184b2595-3f61-4f3c-a1bd-a33c16bacd8c tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84dbdab80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.116575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:09.128173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3631d3d5-27aa-4e14-bb7f-c8c6b8353a27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.637857 Aug 27 21:16:09.129305 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2816/5737] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:08 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:09.195987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-184b2595-3f61-4f3c-a1bd-a33c16bacd8c tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.120954 Aug 27 21:16:09.197018 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2922/5738] 10.222.0.40 () {58 vars in 1149 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:09.210095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ca2e1dd-d01b-46ac-a8aa-d779302bdff6 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e2b7790>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.325311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ca2e1dd-d01b-46ac-a8aa-d779302bdff6 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.118667 Aug 27 21:16:09.325909 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2817/5739] 10.222.0.40 () {58 vars in 1134 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:09.340785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-971935b3-517e-4f94-b391-a1082c6465c8 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84dd4e700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.449583 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-971935b3-517e-4f94-b391-a1082c6465c8 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.114344 Aug 27 21:16:09.450185 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2923/5740] 10.222.0.40 () {58 vars in 1167 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:09.466427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c57e8ff-a5fc-48fa-98fe-371d33d35a45 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e00e310>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.482043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.482780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:09.490848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:09.491617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:09.492179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:09.493046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:09.493730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:09.494360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:09.616038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c57e8ff-a5fc-48fa-98fe-371d33d35a45 tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.155380 Aug 27 21:16:09.616916 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2818/5741] 10.222.0.40 () {58 vars in 1170 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:09.634469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7cf3caca-c45d-41b3-9b8e-c23aaa55318e tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e00edc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.741408 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7cf3caca-c45d-41b3-9b8e-c23aaa55318e tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.114714 Aug 27 21:16:09.742236 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2819/5742] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:09.756380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c88d646e-6452-4a33-9f8c-cf39bdf6bb3f tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e1abdc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.864949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c88d646e-6452-4a33-9f8c-cf39bdf6bb3f tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.112797 Aug 27 21:16:09.865836 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2820/5743] 10.222.0.40 () {58 vars in 1188 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:09.880032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d26ead6d-46f6-4020-af3c-5203c5af97cc tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] Calling method '.version_select at 0x7ff84e28c820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:09.886519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:09.896943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4119f572-e26a-46a7-a616-0c3dfa006a7a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.417902 Aug 27 21:16:09.897763 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2924/5744] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:09.995369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d26ead6d-46f6-4020-af3c-5203c5af97cc tempest-VolumesTestJSON-121884501 tempest-VolumesTestJSON-121884501-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.120039 Aug 27 21:16:09.996603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2821/5745] 10.222.0.40 () {58 vars in 1155 bytes} [Sat Aug 27 21:16:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:10.155268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:10.156652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:10.192699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:10.193547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:10.194187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:10.194938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:10.195638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:10.197933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:10.228371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:10.584374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:10.611220 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2a2233b-9c65-4b3a-b638-0ac944d88cbb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.464379 Aug 27 21:16:10.615919 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2925/5746] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:10 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:10.918453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:10.919065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:10.953475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:10.953971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:10.954612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:10.960853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:10.967363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:10.968168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.280834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16416af-024a-4b0e-8627-af618e653b41", "tag": "a81e72be-360a-4fac-9704-5eabd4716cf0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:11.329538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.346417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.348775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.367787 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] Creating event network-changed:a81e72be-360a-4fac-9704-5eabd4716cf0 for instance a16416af-024a-4b0e-8627-af618e653b41 on nch2-master-1 Aug 27 21:16:11.377653 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-34ce189d-c3a5-4c0e-ab0e-918abae2188d req-1b802ae2-335e-41f7-b12f-d5b700f22b1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100098 Aug 27 21:16:11.379038 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2926/5747] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:16:11.422217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:11.431991 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3dc3e156-91e6-430e-bb7d-43e6c357e3cd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.517905 Aug 27 21:16:11.432838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2822/5748] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:10 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:11.638889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:11.640232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:11.650371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.651233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.652886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.653861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.654534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.655910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.670184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:11.672501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:11.683600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:11.686013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.686698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.687471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.688611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.689415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.690016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.716666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 HTTP/1.1 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '02d914b2-3d53-4cd5-920c-a5014c1cb579'} Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:11.719748 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.727164 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.731999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:11.733174 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9fb163e5-7e8d-4b5f-a548-b06ef331337f tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 404 len: 111 microversion: 2.1 time: 0.068400 Aug 27 21:16:11.733812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2823/5749] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:16:11 2022] DELETE /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:11.742742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:11.743440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: 02d914b2-3d53-4cd5-920c-a5014c1cb579] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:11.750635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.751563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.752177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.753199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:11.753845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:11.754282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:11.771949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 HTTP/1.1 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '02d914b2-3d53-4cd5-920c-a5014c1cb579'} Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:11.774180 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance 02d914b2-3d53-4cd5-920c-a5014c1cb579 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4f167e0-edce-43f1-bb71-87f809af5bac tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579" status: 404 len: 111 microversion: 2.1 time: 0.037155 Aug 27 21:16:11.782256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2824/5750] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:11 2022] GET /compute/v2.1/servers/02d914b2-3d53-4cd5-920c-a5014c1cb579 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:11.905650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:11.920585 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3047bd73-ea06-4037-b4f6-7e54b89a1534 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.286738 Aug 27 21:16:11.943847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2927/5751] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:11 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:12.455592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:12.456799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:12.470698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:12.471376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:12.471922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:12.472836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:12.473539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:12.476762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:12.917968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:12.934323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11e0d622-99ca-4ea3-b9dd-57f560543595 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.484254 Aug 27 21:16:12.935761 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2825/5752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:12 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:12.948829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:12.949386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:12.954902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:12.959171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:12.959814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:12.960557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:12.961639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:12.962612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:12.964512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:12.979713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:12.980621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:12.996245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:12.998053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.000164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:13.002852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:13.004634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.005891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:13.051587 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 HTTP/1.1 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f08894f9-51d1-4343-ac4d-194a49f114e9'} Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:13.053387 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.059084 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.062831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:13.064452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9475c784-7adb-4e56-9758-0235e6f9e68c tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 404 len: 111 microversion: 2.1 time: 0.095868 Aug 27 21:16:13.065738 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2826/5753] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:16:12 2022] DELETE /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:16:13.076536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:13.077162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] [instance: f08894f9-51d1-4343-ac4d-194a49f114e9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:13.104712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:13.105832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.106769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:13.107805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:13.108348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.109259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:13.127328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] HTTP exception thrown: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Request method failure captured: Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 HTTP/1.1 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCogJ1C1O3ICf8n1ELyBR_6eQbhr3-NZXYZZyo90EJN10N8xrGUyayvqfHr1rwTP_wbCAeyfOXoFfTv27YdEiXkCVIDX6baN6D8merfCdpr1aiiFlOxgPLVAcAxHWT2Qh4i7eYIgmLnryop4K07AUhu6u8uVk5pMULGBQjsQv058YnVg Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a854ce08e212478fbc2bb8eb7d78b145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a854ce08e212478fbc2bb8eb7d78b145", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a854ce08e212478fbc2bb8eb7d78b145"}]}] Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a854ce08e212478fbc2bb8eb7d78b145 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1033298169 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7266d6f3c5f44e758e222cf97e0cda65 Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeTestJSON-1033298169-project Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f08894f9-51d1-4343-ac4d-194a49f114e9'} Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:13.129877 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:13.137027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] Returning 404 to user: Instance f08894f9-51d1-4343-ac4d-194a49f114e9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:13.137701 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fcdcad14-042b-42c3-84d8-30ad886f6a93 tempest-AttachVolumeTestJSON-1033298169 tempest-AttachVolumeTestJSON-1033298169-project] 10.222.0.40 "GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9" status: 404 len: 111 microversion: 2.1 time: 0.063093 Aug 27 21:16:13.138689 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2827/5754] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:13 2022] GET /compute/v2.1/servers/f08894f9-51d1-4343-ac4d-194a49f114e9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:13.283991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:13.294444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bbbf0256-752d-4e02-9331-b8bfe19a4501 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.351599 Aug 27 21:16:13.295685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2928/5755] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:12 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:13.958111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:13.958710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:13.979040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:13.979573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.980017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:13.980734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:13.981187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:13.981614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:14.293693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:14.306853 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d87ae61-9200-4203-ad0f-825d56cc5bda tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.352584 Aug 27 21:16:14.308730 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2828/5756] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:13 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:14.326971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:14.328229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:14.336320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:14.336853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:14.337842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:14.338747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:14.339394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:14.339821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:14.480748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:14.682869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:14.696118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-099c0d69-f118-44a8-a6f9-a018ee984f50 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.372739 Aug 27 21:16:14.712509 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2929/5757] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:14 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:15.335880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:15.336608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:15.358281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:15.363756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:15.364739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:15.412086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:15.412086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:15.412086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:15.712902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:15.719631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:15.720870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:15.724092 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ece9fe68-9a76-46e1-829a-5edac9c56c14 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.398367 Aug 27 21:16:15.724680 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2829/5758] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:15 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:15.731921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:15.738101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:15.738814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:15.739771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:15.740427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:15.741231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:16.043871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:16.054660 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f9e7bdc-c6a6-4a1b-9cc1-16388c60c73b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.339039 Aug 27 21:16:16.055675 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2930/5759] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:15 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:16.590174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "name": "network-vif-plugged", "status": "completed", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:16.634050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:16.634752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:16.635409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:16.660983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] Creating event network-vif-plugged:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:16:16.670807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-495c2bbb-61a0-43bf-9e6a-4b2e03e72fdd req-c4f9d9e9-64f8-47ae-881c-f8b188a671f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084978 Aug 27 21:16:16.673461 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2830/5760] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:16.746960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:16.747295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:16.765795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:16.766598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:16.767187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:16.768056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:16.768649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:16.769210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:17.076347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:17.077059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:17.088597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:17.090236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:17.091083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:17.092275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:17.092957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:17.093770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:17.275704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:17.284993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7614582-b446-425b-a83e-2d982ca8cb4b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.542399 Aug 27 21:16:17.287394 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2931/5761] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:16 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:17.475648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:17.485812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a61b4ec2-3903-472e-a50b-8cea68c1d4bc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.413661 Aug 27 21:16:17.486426 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2831/5762] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:17 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:18.312931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:18.314133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:18.340022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:18.341429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:18.342102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:18.346033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:18.346748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:18.349420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:18.506871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:18.512757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:18.528518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:18.530105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:18.531563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:18.533775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:18.535498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:18.535944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:18.905931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:18.916013 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-439132a0-35f1-4ea8-8451-547924b2767c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1518 microversion: 2.1 time: 0.611939 Aug 27 21:16:18.923152 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2932/5763] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:18 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1518 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:19.214718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:19.230885 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21e40df6-abc9-4842-8f88-de84840002c1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.728175 Aug 27 21:16:19.231949 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2832/5764] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:18 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:19.940073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:19.940946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:19.964996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:19.966501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:19.967234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:19.968942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:19.971317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:19.971900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.250985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:20.253053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:20.257149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:20.266852 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-333e9e1c-f8b5-4ca1-863b-18bbe53f0dc0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.331933 Aug 27 21:16:20.268124 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2933/5765] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:19 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:20.280904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.281454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.281924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.282653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.283210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.283839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.290402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:20.292084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:20.303081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.303912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.304644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.305651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.307464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.308116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.717433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:20.731502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac553c45-0127-4119-8adc-c961ae375fd8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.444937 Aug 27 21:16:20.732173 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2934/5766] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:20 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:20.746429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16416af-024a-4b0e-8627-af618e653b41", "name": "network-vif-plugged", "status": "completed", "tag": "a81e72be-360a-4fac-9704-5eabd4716cf0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:20.770439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.771867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.772763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.787403 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] Creating event network-vif-plugged:a81e72be-360a-4fac-9704-5eabd4716cf0 for instance a16416af-024a-4b0e-8627-af618e653b41 on nch2-master-1 Aug 27 21:16:20.795656 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d09291c9-a780-4a4c-a0b6-3be0858a95e3 req-b240090a-54a6-4820-9b19-b05374fb4603 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060052 Aug 27 21:16:20.798471 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2935/5767] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:20.810327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:20.817264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:20.822190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:20.827010 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ddb21ed-86d9-44f3-9ef1-0bf47eaa7978 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.577774 Aug 27 21:16:20.837526 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2833/5768] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:20 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:20.856509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.857026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.857479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:20.858199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:20.861587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:20.862040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.600052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:21.623975 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc4bc2fd-8dc4-4db2-aafb-de35b19cb54d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.821198 Aug 27 21:16:21.625482 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2936/5769] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:20 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:21.646905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a5c8035-0d72-4ba9-9414-b23b92c213ec tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:21.653363 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-2a5c8035-0d72-4ba9-9414-b23b92c213ec tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a5c8035-0d72-4ba9-9414-b23b92c213ec tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/370a8966-2f71-453f-9254-44add480a896/action HTTP/1.1 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 15 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: {"os-stop": {}} Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '370a8966-2f71-453f-9254-44add480a896', 'body': {'os-stop': {}}} Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:21.668358 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a5c8035-0d72-4ba9-9414-b23b92c213ec tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 370a8966-2f71-453f-9254-44add480a896 has no mapping to a cell. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a5c8035-0d72-4ba9-9414-b23b92c213ec tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/370a8966-2f71-453f-9254-44add480a896/action" status: 404 len: 117 microversion: 2.1 time: 0.028112 Aug 27 21:16:21.675122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2834/5770] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:21 2022] POST /compute/v2.1/servers/370a8966-2f71-453f-9254-44add480a896/action => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:21.681340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:21.682068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:21.693987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.694487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.694983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.696021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.696205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.696616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.856997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:21.857538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:21.865842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.866326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.866888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.867660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.868142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.868565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.942112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:21.953856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae8bdc3f-79d9-4e4f-8358-8a590ddc5f8d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.277023 Aug 27 21:16:21.967748 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2937/5771] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:21 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:21.979770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:21.980526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:21.989236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.989833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.990514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:21.991488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:21.992299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:21.992907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.153826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:22.165220 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-596f23a9-0d27-4102-a2c9-e2d02e36e7fc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1314 microversion: 2.1 time: 0.312103 Aug 27 21:16:22.167237 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2835/5772] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:21 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:22.256442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:22.267541 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3c4b009-76df-4473-ae5c-61e0759a713d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.292779 Aug 27 21:16:22.269600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2938/5773] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:21 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:22.292440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:22.292970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: 80fbee33-6f8c-4636-b6a0-1d27907a1290] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:22.300120 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/80fbee33-6f8c-4636-b6a0-1d27907a1290/action HTTP/1.1 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 15 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: {"suspend": {}} Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '80fbee33-6f8c-4636-b6a0-1d27907a1290', 'body': {'suspend': {}}} Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:22.301973 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:22.305105 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:22.305105 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:22.305105 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. Aug 27 21:16:22.305105 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:22.307169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance 80fbee33-6f8c-4636-b6a0-1d27907a1290 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:22.308454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a074a05c-2f53-43ba-a88f-be43c06d5e77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/80fbee33-6f8c-4636-b6a0-1d27907a1290/action" status: 404 len: 111 microversion: 2.1 time: 0.019972 Aug 27 21:16:22.309697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2836/5774] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:22 2022] POST /compute/v2.1/servers/80fbee33-6f8c-4636-b6a0-1d27907a1290/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:22.318669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:22.319617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:22.327848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.328582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.329245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.330316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.330796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.331266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.501088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:22.510036 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-90f04c3a-2f61-40ac-b434-5844a0b74454 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.195639 Aug 27 21:16:22.511225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2939/5775] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:22 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:22.533744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:22.534471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:22.542629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.543822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.544572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.545576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.546182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.547042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.751122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:22.759936 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d2a29de-ed2d-4dd1-ad0a-5ca368f935f2 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.230859 Aug 27 21:16:22.781509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:22.782059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:22.783510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2837/5776] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:22 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:22.794252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.794759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.795575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.796457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:22.797088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:22.797653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:22.838146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'flavor' on Instance uuid ff1b42cc-61cd-437d-92ca-1c27fd1fd538 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:16:23.030922 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21665ca6-8666-4509-bfba-a2e0556d4536 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.254583 Aug 27 21:16:23.032301 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2940/5777] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:22 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:16:23.041325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:23.042114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:23.050512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.051155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.051716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.052770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.053437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.055041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.189324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:23.190148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:23.202001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.205051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.205788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.209911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.210653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.211395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.271500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:23.393095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:23.402818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3d23b50-6076-4e2c-88ab-b10b10a57abe tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1513 microversion: 2.1 time: 0.366571 Aug 27 21:16:23.414103 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2838/5778] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:23 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:23.517729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:23.532567 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b903d7b-92db-4fb1-8e38-59c3d207d8e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1500 microversion: 2.1 time: 0.349024 Aug 27 21:16:23.536244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2941/5779] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:23 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:23.560280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:23.564507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:23.574403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.580852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.581570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.582367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.583925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.584763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.620242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lazy-loading 'flavor' on Instance uuid a16416af-024a-4b0e-8627-af618e653b41 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:16:23.681290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:23.721380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25d92f9b-a1ee-463b-98d9-895c7ba0e956 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "POST /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41/action" status: 200 len: 32 microversion: 2.1 time: 0.168015 Aug 27 21:16:23.723048 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2839/5780] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:23 2022] POST /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:16:23.733605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:23.742094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:23.756374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.757073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.768094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:23.769234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:23.769906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:23.770533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.048707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:24.057692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfeffa84-5a52-4568-97a2-2a18bf8f3af3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.327937 Aug 27 21:16:24.058298 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2942/5781] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:23 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:24.427739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:24.428573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:24.438749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.440667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.442131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.443636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.446895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.448480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.711577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:24.727731 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87e11893-ee68-47e3-bc22-6cc545e35da3 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1496 microversion: 2.1 time: 0.303770 Aug 27 21:16:24.729627 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2840/5782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:24 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1496 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:24.751173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:24.752234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:24.760463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.761090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.761849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.762720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.763529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.763996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.805039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'flavor' on Instance uuid ff1b42cc-61cd-437d-92ca-1c27fd1fd538 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:16:24.818844 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'suspend' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state suspended Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 15 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: {"suspend": {}} Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'suspend' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state suspended Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'suspend': {}}} Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 21:16:24.822059 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state suspended Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state suspended Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'suspend' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state suspended {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:24.825600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f833f432-6a73-40ee-8623-db21716bc5be tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 148 microversion: 2.1 time: 0.079293 Aug 27 21:16:24.829753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2943/5783] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:24 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 148 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:16:24.836341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:24.837418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:24.844982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.850835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.851904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.854303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.855108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.858490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.957515 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f747d668-62c4-427a-a005-081d345e1938 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 202 len: 0 microversion: 2.1 time: 0.125412 Aug 27 21:16:24.959270 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2841/5784] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:24 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:16:24.968702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:24.969397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:24.976112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.976960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.977663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:24.978572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:24.979179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:24.979870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:25.083098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:25.084193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:25.098658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:25.100238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:25.102310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:25.104082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:25.104563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:25.105002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:25.225721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:25.236535 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5cd98f94-f3e9-4d4a-b85b-fd71a3c35e15 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1502 microversion: 2.1 time: 0.271898 Aug 27 21:16:25.237755 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2944/5785] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:24 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:25.390700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:25.406737 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3604280-7b22-4802-9454-fe1e76b322ed tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.327082 Aug 27 21:16:25.408153 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2842/5786] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:25 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:26.258730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:26.260081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:26.271025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:26.271571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:26.272026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:26.272744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:26.273276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:26.273712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:26.432132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:26.432737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:26.443971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:26.444489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:26.445015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:26.445793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:26.446214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:26.446660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:26.791584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:26.804437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c06a55a0-e435-4c9c-b3f7-eac138f09233 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1502 microversion: 2.1 time: 0.548311 Aug 27 21:16:26.805955 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2945/5787] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:26 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1502 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:26.892138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:26.900355 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-75a121d9-64c2-409c-a6d5-a4c94f17ca09 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.472520 Aug 27 21:16:26.909960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2843/5788] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:26 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:27.827769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:27.828588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:27.841135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:27.841655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:27.847652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:27.848471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:27.848946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:27.849389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:27.922259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:27.924234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:27.933498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:27.934793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:27.935630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:27.936582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:27.937208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:27.937931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.213644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:28.216912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:28.227080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-abc9597a-0af7-4e9d-b7fd-d830615f3788 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.308863 Aug 27 21:16:28.239496 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2844/5789] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:27 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:28.239893 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a931eb5b-f616-411d-9d55-e6b64bd17457 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.410163 Aug 27 21:16:28.243500 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2946/5790] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:27 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:28.259970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:28.260586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:28.266596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.267087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.267560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.268397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.269009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.269325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.498127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:28.508315 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d1874fc-4219-4eb2-977d-7e10087c6633 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.252319 Aug 27 21:16:28.509400 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2845/5791] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:28 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:28.531469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:28.532250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: acba5bb0-1015-478b-ae8b-4769ab2f825d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:28.540395 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/acba5bb0-1015-478b-ae8b-4769ab2f825d/action HTTP/1.1 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 15 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: {"unpause": {}} Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'acba5bb0-1015-478b-ae8b-4769ab2f825d', 'body': {'unpause': {}}} Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:28.542313 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance acba5bb0-1015-478b-ae8b-4769ab2f825d could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-32d22318-d8bf-4940-b40d-c2aa40eb4f51 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/acba5bb0-1015-478b-ae8b-4769ab2f825d/action" status: 404 len: 111 microversion: 2.1 time: 0.019339 Aug 27 21:16:28.547819 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2947/5792] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:28 2022] POST /compute/v2.1/servers/acba5bb0-1015-478b-ae8b-4769ab2f825d/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:28.553819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:28.554886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:28.563188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.563986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.564513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.565317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.565890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.566392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.776884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:28.786573 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-982afbeb-8afc-4a8c-90b9-1904a6519dc5 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.237046 Aug 27 21:16:28.787503 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2846/5793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:28 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:28.808549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:28.809337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:28.817065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.817563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.818011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:28.818907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:28.819379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:28.820022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.013057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:29.023410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eb2fef53-2f51-42fa-ae78-fee07795ec18 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.219431 Aug 27 21:16:29.036625 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2948/5794] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:28 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:29.048678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:29.049564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.060264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.060355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.062265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.062265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.062408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.062978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.095749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'unpause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 15 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: {"unpause": {}} Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: exception: Cannot 'unpause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'unpause': {}}} Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state active. Cannot unpause while the instance is in this state. Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.097680 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'unpause' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:29.102283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d34fc0e-406a-4620-ab2d-dfe5b1d3e22c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 145 microversion: 2.1 time: 0.055926 Aug 27 21:16:29.108624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:29.109255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.114040 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2847/5795] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:29 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:16:29.114882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:29.119234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.119774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.120226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.123182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.123702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.124145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.256280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:29.258192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.280594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.281176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.281677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.282863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.283943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.284712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.450029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:29.470378 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d911c34-346e-4060-b977-17a5999a1d77 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.365776 Aug 27 21:16:29.483381 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2949/5796] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:29 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:29.496525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:29.497486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.509017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.509628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.510753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.512087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.513859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.514795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.738210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:29.751386 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a18ce0f-cc05-4a70-ba67-a0a74b5d8783 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.501476 Aug 27 21:16:29.752618 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2848/5797] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:29 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:29.822573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:29.834530 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94b45c1d-c276-424d-ab36-288592cf9932 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.343351 Aug 27 21:16:29.847821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2950/5798] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:29 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:29.856086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:29.856881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: aa25074e-b2c3-4ed4-9f53-d08663c96070] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.863889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/aa25074e-b2c3-4ed4-9f53-d08663c96070/action HTTP/1.1 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 18 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: {"unshelve": null} Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'aa25074e-b2c3-4ed4-9f53-d08663c96070', 'body': {'unshelve': None}} Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.866490 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance aa25074e-b2c3-4ed4-9f53-d08663c96070 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:29.870817 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-763b6cad-18e4-4457-a5d9-5ac57df8b079 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/aa25074e-b2c3-4ed4-9f53-d08663c96070/action" status: 404 len: 111 microversion: 2.1 time: 0.016808 Aug 27 21:16:29.878586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:29.879459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:29.883734 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2849/5799] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:29 2022] POST /compute/v2.1/servers/aa25074e-b2c3-4ed4-9f53-d08663c96070/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:29.887880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.888903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.889480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:29.891072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:29.891845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:29.892439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.088859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:30.100654 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-33967ee4-e654-4844-a960-040c483e2edb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.225826 Aug 27 21:16:30.102132 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2951/5800] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:29 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:30.124766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:30.126672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:30.153973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.154936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.155610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.156513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.157157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.157791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.351122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:30.365299 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf66223c-5867-43f0-b16a-f65fcaf2ebe6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.244440 Aug 27 21:16:30.366427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2850/5801] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:30 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:30.393014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:30.394063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:30.404629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.406238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.406984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.407834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.408429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.408954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.444260 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Cannot 'unshelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action HTTP/1.1 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 18 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: {"unshelve": null} Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: exception: Cannot 'unshelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'unshelve': None}} Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 21:16:30.446240 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active Aug 27 21:16:30.449494 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:30.451071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 409 to user: Cannot 'unshelve' instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 while it is in vm_state active {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:30.452013 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a45a65d-59c4-4ff0-b4d7-d90a8f019b9b tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action" status: 409 len: 146 microversion: 2.1 time: 0.067124 Aug 27 21:16:30.452925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2952/5802] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:16:30 2022] POST /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538/action => generated 146 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 21:16:30.466310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:30.466897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:30.473164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.475627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.475627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.475627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.475627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.476029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.672289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:30.685669 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a2ef2c4-560d-48df-8ceb-5cc18445c469 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.228273 Aug 27 21:16:30.697261 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2851/5803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:30 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:30.718517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:30.719547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:30.730993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.736998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.736998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.736998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.736998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.736998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.776921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:30.777910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:30.804231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.805744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.806384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:30.807142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:30.807636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:30.812761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.066168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:31.080122 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70bfd48d-60b3-4b88-9de0-2ab225ea168d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.367241 Aug 27 21:16:31.084900 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2953/5804] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:30 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:31.093460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:31.102262 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8813c69d-ce06-4b70-958d-ace43490572c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.330273 Aug 27 21:16:31.102642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-776922885_updated"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:31.103145 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2852/5805] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:30 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:31.118256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: fe5fed1d-726a-4ad2-8030-a909068a234c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:31.124223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: request: PUT /compute/v2.1/servers/fe5fed1d-726a-4ad2-8030-a909068a234c HTTP/1.1 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 80 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-776922885_updated"}} Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'fe5fed1d-726a-4ad2-8030-a909068a234c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-776922885_updated'}}} Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 21:16:31.126168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance fe5fed1d-726a-4ad2-8030-a909068a234c could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68cfdbf5-41cd-4b4c-94bd-7e86790fa632 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "PUT /compute/v2.1/servers/fe5fed1d-726a-4ad2-8030-a909068a234c" status: 404 len: 111 microversion: 2.1 time: 0.029445 Aug 27 21:16:31.133836 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2954/5806] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:16:31 2022] PUT /compute/v2.1/servers/fe5fed1d-726a-4ad2-8030-a909068a234c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:16:31.140182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:31.140865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:31.147447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.148001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.148504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.149400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.149887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.150317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.304944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:31.320684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-521c192e-e29c-47c6-b817-9907521510bf tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.183996 Aug 27 21:16:31.321648 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2853/5807] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:31.349547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:31.349547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:31.366499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.367083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.367568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.368296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.368751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.369181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.606588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:31.619107 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ad2c3eb-147e-442c-92b0-d31ea2cb0a23 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.274719 Aug 27 21:16:31.626305 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2955/5808] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:31.643528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8df60a9f-727c-4efc-9372-feb2b12a0ac0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8df60a9f-727c-4efc-9372-feb2b12a0ac0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 HTTP/1.1 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 280 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.650834 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 21:16:31.654234 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:31.656879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8df60a9f-727c-4efc-9372-feb2b12a0ac0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:31.658317 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8df60a9f-727c-4efc-9372-feb2b12a0ac0 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 400 len: 619 microversion: 2.1 time: 0.020442 Aug 27 21:16:31.658909 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2854/5809] 10.222.0.40 () {60 vars in 1257 bytes} [Sat Aug 27 21:16:31 2022] PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:16:31.667767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:31.668499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:31.675619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.676335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.676920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.677918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.678795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.679071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.944126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:31.956539 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a33dfcd8-26d0-4b49-9a61-3acff30c27f6 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.290909 Aug 27 21:16:31.957671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2956/5810] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:31.980434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:31.981052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:31.994180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.994932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:31.995596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:31.996836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:31.997450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:32.000272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:32.129790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:32.130702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:32.144146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:32.145382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:32.146766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:32.147935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:32.148660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:32.149521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:32.233787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:32.243296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5873d7bc-39f1-4943-9ced-1c6c281c06eb tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.266465 Aug 27 21:16:32.244467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2855/5811] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:31 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:32.271758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f1e1899-91f8-4043-ace3-9f08be609c1d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f1e1899-91f8-4043-ace3-9f08be609c1d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: request: PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 HTTP/1.1 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 24 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: {"server": {"name": ""}} Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538', 'body': {'server': {'name': ''}}} Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi '' Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:16:32.276226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 21:16:32.280372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:32.281763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f1e1899-91f8-4043-ace3-9f08be609c1d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:32.283508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f1e1899-91f8-4043-ace3-9f08be609c1d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 400 len: 108 microversion: 2.1 time: 0.021151 Aug 27 21:16:32.284651 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2856/5812] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:16:32 2022] PUT /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 21:16:32.296609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:32.297256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:32.314863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:32.317302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:32.317831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:32.320843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:32.324932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:32.325624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:32.482344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:32.492194 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1239e8bc-0965-446b-b4d1-005fdc33d75e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.368389 Aug 27 21:16:32.493832 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2957/5813] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:32 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:32.554778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:32.565628 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-166002dd-9eb7-440d-9c60-ba95c26a3b0a tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1505 microversion: 2.1 time: 0.274980 Aug 27 21:16:32.566216 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2857/5814] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:32 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:33.516168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:33.517155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:33.529932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:33.530730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:33.531496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:33.532436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:33.533139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:33.533736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:33.686947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:33.698110 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc447192-adc1-484a-8c64-6286c335a9ce tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.185891 Aug 27 21:16:33.698705 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2958/5815] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:33 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:34.723645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:34.724403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:34.732396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:34.733006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:34.733790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:34.734726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:34.735376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:34.736640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:34.741797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:34.969144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:34.969574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:34.985255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:34.985814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:34.986463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:34.987439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:34.991238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:34.992433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.044110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:35.047378 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a HTTP/1.1 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a58099dc-f5d9-4350-989e-7c990c10442a'} Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:35.049665 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.053271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:35.057552 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1778c7a-e2b3-4703-adb8-bf074455e06b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.337250 Aug 27 21:16:35.059003 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2858/5816] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:34 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:35.063876 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c31ebe29-b149-4977-9abe-a2f472ebe2d8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 404 len: 111 microversion: 2.1 time: 0.087315 Aug 27 21:16:35.067297 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2959/5817] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:16:34 2022] DELETE /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:35.081241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:35.083394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: a58099dc-f5d9-4350-989e-7c990c10442a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:35.090830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.091879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.092505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.093271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.093716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.094154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.123044 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a HTTP/1.1 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a58099dc-f5d9-4350-989e-7c990c10442a'} Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:35.125372 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance a58099dc-f5d9-4350-989e-7c990c10442a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d78adda1-616b-4561-80e4-1a6201bc8f36 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a" status: 404 len: 111 microversion: 2.1 time: 0.051219 Aug 27 21:16:35.132198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2859/5818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:35 2022] GET /compute/v2.1/servers/a58099dc-f5d9-4350-989e-7c990c10442a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:16:35.138389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:35.139110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:35.148440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.149512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.150145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.151140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.151864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.152527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.185666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:16:35.202676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:35.305434 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9abdb6cb-54b4-4e3a-a216-366c41a935b8 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 204 len: 0 microversion: 2.1 time: 0.170636 Aug 27 21:16:35.310678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2960/5819] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:16:35 2022] DELETE /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:16:35.328299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:35.329293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:35.351521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.352425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.353282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.354560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:35.355199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:35.355915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:35.568178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:35.574549 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fbc9642b-80d3-4d29-bb79-0c4d1c994849 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.251266 Aug 27 21:16:35.587851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2860/5820] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:35 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:36.087761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:36.088956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:36.097001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:36.097713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:36.098167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:36.098897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:36.099405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:36.100188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:36.518051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:36.530224 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68e6d85c-2a8e-4aca-b766-8fc39ca0e41f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.447546 Aug 27 21:16:36.531108 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2961/5821] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:36 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:36.596547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:36.597664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:36.608459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:36.608967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:36.616959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:36.618142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:36.618637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:36.619102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:36.824589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:36.832708 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51a7ac77-48ce-4e95-9206-8743a5613f26 tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.240098 Aug 27 21:16:36.833286 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2861/5822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:36 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:37.559277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:37.560079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:37.580396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:37.581607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:37.582302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:37.597154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:37.597970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:37.598595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:37.865809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:37.872664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:37.888027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:37.889452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:37.891958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:37.893002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:37.893792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:37.895140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:37.919477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:37.937035 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91dabf5b-90fe-4fff-a608-461bcb9b05e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.384726 Aug 27 21:16:37.938922 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2962/5823] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:37 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:38.430731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:38.448953 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6bba7d11-f089-4d6b-bdb0-05ee57b8426c tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1511 microversion: 2.1 time: 0.598120 Aug 27 21:16:38.449548 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2862/5824] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:37 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:38.694066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1b42cc-61cd-437d-92ca-1c27fd1fd538", "name": "network-vif-deleted", "tag": "1a1d734e-2ab1-4e29-a785-79f89c2d3588"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:38.720877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:38.721706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:38.731829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:38.776778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] Creating event network-vif-deleted:1a1d734e-2ab1-4e29-a785-79f89c2d3588 for instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 on nch2-master-1 Aug 27 21:16:38.798400 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-cf8cfa81-b93b-40fd-aaba-a6621fcecd3b req-54f008d8-ce4e-4774-9c9e-1981f89095b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107581 Aug 27 21:16:38.799063 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2963/5825] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:16:38.966183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:38.966853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:38.989709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:38.990259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:38.990693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:38.994188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:38.999553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:39.002318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:39.390892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:39.410907 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0b2e5f4-bd00-46b9-a32c-e3c93ff43dbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.450446 Aug 27 21:16:39.412569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2863/5826] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:38 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:39.478954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:39.479836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:39.495204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:39.496122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:39.497308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:39.500993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:39.501532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:39.502056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:39.589648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:39.591099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:39.592355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:39.593566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lazy-loading 'fault' on Instance uuid ff1b42cc-61cd-437d-92ca-1c27fd1fd538 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:16:39.659653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe51e589dc00446cb71cc2c4b3cdbc3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30cc1bb296014690bb72ae59829e5218', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:39.670921 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-22e86d6a-9d68-4d37-acda-082099082ebd tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 200 len: 1306 microversion: 2.1 time: 0.203349 Aug 27 21:16:39.672244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2964/5827] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:39 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 1306 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:40.437550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:40.438178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:40.458489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:40.459125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:40.462561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:40.465824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:40.473178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:40.474208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:40.699879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:40.717529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] [instance: ff1b42cc-61cd-437d-92ca-1c27fd1fd538] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:40.754357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:40.755039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:40.755554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:40.756294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:40.756908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:40.757652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:40.768552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:40.779962 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2b6c5ba-c960-4430-990a-e66c0275ebbf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.346256 Aug 27 21:16:40.780558 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2864/5828] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:40 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:40.800723 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] HTTP exception thrown: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Request method failure captured: Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 HTTP/1.1 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCokN7VzGsUsze6uEnUwd5uXm5TsXS9ZDKm5fE7Ll5hGEEcFRKt1M2CtcC6niFx9LGnbTfzbUwV6SP9-rk4EvnyIzPTVXzqeK8y3dIzSb5XoRM-r-ho6HiOsP1bSxo402O3RqSMqS9UK_jea8WlkZXNbt7URL0VQZgdJqF6T4wC9-JkA Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/30cc1bb296014690bb72ae59829e5218"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_30cc1bb296014690bb72ae59829e5218", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/30cc1bb296014690bb72ae59829e5218"}]}] Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 30cc1bb296014690bb72ae59829e5218 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1621363259 Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: fe51e589dc00446cb71cc2c4b3cdbc3f Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1621363259-project Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ff1b42cc-61cd-437d-92ca-1c27fd1fd538'} Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:16:40.811708 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. Aug 27 21:16:40.815217 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:16:40.819410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] Returning 404 to user: Instance ff1b42cc-61cd-437d-92ca-1c27fd1fd538 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:16:40.822424 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07a80797-26dd-440a-8983-f99a69fabc6d tempest-ServersNegativeTestJSON-1621363259 tempest-ServersNegativeTestJSON-1621363259-project] 10.222.0.40 "GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538" status: 404 len: 111 microversion: 2.1 time: 0.131148 Aug 27 21:16:40.827030 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2965/5829] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:40 2022] GET /compute/v2.1/servers/ff1b42cc-61cd-437d-92ca-1c27fd1fd538 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:16:41.803739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:41.805970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:41.810595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=80 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:41.827882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:41.830930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:41.832215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:41.833983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:41.838275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:41.840161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:42.244286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:42.258380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d5a9f27-b730-463c-958b-064ffb44d895 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.459849 Aug 27 21:16:42.266152 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2865/5830] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:41 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:43.287567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:43.289767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:43.300694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:43.306959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:43.307699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:43.311012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:43.311918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:43.314052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:43.924239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:43.939084 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eca7cda0-d92d-4d25-86ac-065efce41a0e tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.656262 Aug 27 21:16:43.942020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2966/5831] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:43 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:16:44.965225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:44.966315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:44.983603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:44.984962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:44.986553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:44.988896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:44.989705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:44.990275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:45.402679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:45.431609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a218c27e-a24b-4bfd-841e-995760dfebcc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.472265 Aug 27 21:16:45.435614 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2866/5832] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:44 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:46.469993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:46.471594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:46.491687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:46.492337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:46.497083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:46.503786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:46.503786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:46.503786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:46.958212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:46.972146 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c01ade9b-abe2-474c-b001-662441aa41a6 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.513667 Aug 27 21:16:46.973413 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2967/5833] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:46 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:47.994583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:47.995862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:48.003238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:48.004786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:48.005380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:48.006254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:48.006902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:48.008155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:48.237211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:48.251385 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c488b6d4-60ed-4f3e-84cc-92d2ac6ef067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.261456 Aug 27 21:16:48.256347 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2867/5834] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:47 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:49.291448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:49.292641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:49.329837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:49.335093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:49.337457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:49.338881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:49.339598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:49.342768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:49.544056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:49.558145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a92703ee-6e0b-4e73-b9ba-4d44fcfb29ba tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.288201 Aug 27 21:16:49.558956 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2968/5835] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:49 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:50.583828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:50.585720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:50.612965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:50.618534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:50.618996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:50.619844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:50.620301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:50.620722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:51.196902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:51.228448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59520342-d08c-428a-b2c9-0a06672d81e7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.646182 Aug 27 21:16:51.229372 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2868/5836] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:50 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:52.254280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:52.255598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:52.270998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:52.271508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:52.275378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:52.277942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:52.278679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:52.279135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:52.601245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:52.615310 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02cdd3f4-ee61-46fd-a0cd-469988a3cbfa tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.366494 Aug 27 21:16:52.616104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2969/5837] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:52 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:53.637446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:53.638166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:53.654097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:53.654605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:53.655055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:53.655830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:53.659726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:53.661204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:53.973319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:53.996162 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50b7a9bf-4355-4bc8-8fcb-6ad08784e7bd tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.360257 Aug 27 21:16:54.013046 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2869/5838] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:53 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:55.020786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:55.021405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:55.039422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:55.040241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:55.040848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:55.041769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:55.043717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:55.044330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:55.853924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:55.881265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d8ef595-ab3b-4941-a7bc-bb5036a52a25 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1506 microversion: 2.1 time: 0.855383 Aug 27 21:16:55.884891 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2970/5839] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:55 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:56.905141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:56.906446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:56.926011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:56.927129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:56.927846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:56.928895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:56.929595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:56.930233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:57.520497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:57.530588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6dc2ea3a-18a1-4068-8df3-104be5ab667a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1486 microversion: 2.1 time: 0.629454 Aug 27 21:16:57.531186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2870/5840] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:56 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1486 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:16:57.761453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1221092008", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:16:57.859446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] validate_networks() for [('4df3eaf5-67ac-4837-b181-fef00d86521f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:16:59.014677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:16:59.015855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:16:59.016551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:16:59.017316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:16:59.018129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:16:59.071107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:59.071648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:59.072092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:59.072878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:16:59.073298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:16:59.073736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:16:59.145432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Getting quotas for project cecffcd3f1204f589fd2cb6bc942b0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:16:59.156788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:16:59.169841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Getting quotas for user 9054fd09ee6f4b3abe9279eb1166cbc7 and project cecffcd3f1204f589fd2cb6bc942b0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:16:59.220508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:16:59.223110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:16:59.367633 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d14bf02f-1743-414f-a15f-89db992bb747 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.611828 Aug 27 21:16:59.368879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2971/5841] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:16:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:16:59.380108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:16:59.381479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:16:59.546690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:16:59.563374 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1214 microversion: 2.1 time: 0.187115 Aug 27 21:16:59.564041 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2871/5842] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:16:59 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:00.599019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:00.600596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:00.628553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:00.629114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:00.630063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:00.630802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:00.631319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:00.638495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:00.940301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:00.996786 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe3727af-339d-4711-9d00-40febdec2827 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1266 microversion: 2.1 time: 0.396447 Aug 27 21:17:01.000261 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2972/5843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:00 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:01.521467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:01.523805 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-60f9c90e-e23a-447f-9b25-d6baa32baf60 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002680 Aug 27 21:17:01.542646 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2872/5844] 10.222.0.40 () {56 vars in 886 bytes} [Sat Aug 27 21:17:01 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 21:17:01.889882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:01.890973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:01.902900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:01.903949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:01.906435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:01.907439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:01.910036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:01.910833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:01.972673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e0f6b7f-c663-4408-85bf-44302b406a8d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/ips" status: 200 len: 151 microversion: 2.20 time: 0.422275 Aug 27 21:17:01.990653 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2973/5845] 10.222.0.40 () {60 vars in 1289 bytes} [Sat Aug 27 21:17:01 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/ips => generated 151 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:17:02.023285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:02.025062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:02.062692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:02.064536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:02.065505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:02.066736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:02.071365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:02.072091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:02.796248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:02.807880 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3df5131-02fc-4a46-95dd-711cd337bb63 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.790621 Aug 27 21:17:02.809008 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2873/5846] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:02 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:03.838087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:03.839517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:03.850519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:03.851484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:03.852304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:03.853432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:03.854096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:03.854726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:03.890077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d", "tag": "178864eb-8499-4d8f-9683-662eb054da61"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:03.920292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:03.921545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:03.922135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:03.956494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] Creating event network-changed:178864eb-8499-4d8f-9683-662eb054da61 for instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d on nch1-master-1 Aug 27 21:17:03.979033 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d91f4972-b126-40cd-8ee9-3585ae8ef803 req-432f1c5b-a348-4a2c-a37a-67931a02a40e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094079 Aug 27 21:17:03.980374 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2874/5847] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:17:04.160139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:04.163176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:04.184715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:04.185447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:04.186140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:04.187191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:04.188828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:04.189485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:04.235584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lazy-loading 'flavor' on Instance uuid 77f610c2-8a16-43c6-b44d-3379a8593cf3 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:17:04.501756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:04.510987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d4fd9b4b-3523-4d7a-b76e-160555a12469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.684562 Aug 27 21:17:04.512642 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2974/5848] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:03 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:04.615654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7cf8a472-3094-4109-9805-18c06bce6883 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/action" status: 202 len: 0 microversion: 2.20 time: 0.468797 Aug 27 21:17:04.616280 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2875/5849] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 21:17:04 2022] POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:17:04.625760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:04.626383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:04.635851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:04.636620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:04.637259 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:04.638639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:04.639283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:04.639907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:05.301219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:05.320664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:05.329815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:05.332502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:05.333983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d6c18a2-ec8c-49f3-9903-cc9a7cb2e4eb tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.713156 Aug 27 21:17:05.335871 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2975/5850] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:04 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:05.536346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:05.537062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:05.562312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:05.564383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:05.566525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:05.567500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:05.568127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:05.568947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:05.583690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:06.298790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:06.325623 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca663dcc-256a-4211-a75b-f52167fdad75 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.793392 Aug 27 21:17:06.346793 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2876/5851] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:05 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:06.360561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:06.361708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:06.375186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:06.376000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:06.376599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:06.383491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:06.384322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:06.385000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:06.693107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:06.715689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:06.717541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:06.719104 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c670810-bf50-45a4-b69b-6c5e4f2c3078 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.362966 Aug 27 21:17:06.733885 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2976/5852] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:06 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:07.353932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:07.354668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:07.368642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:07.369155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:07.369633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:07.370322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:07.370784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:07.371218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:07.695203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:07.716252 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7ae253a8-835d-4886-98d1-4a79df4bff65 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.369704 Aug 27 21:17:07.717166 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2877/5853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:07 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:07.744812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:07.745846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:07.753732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:07.754436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:07.755303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:07.756968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:07.758010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:07.758732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:08.080817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:08.102031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:08.105594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:08.107147 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3f6f62b-0734-4dd6-8fa4-a499c307b2e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.366453 Aug 27 21:17:08.108288 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2977/5854] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:07 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:08.742788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:08.743332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:08.757387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:08.757880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:08.758319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:08.767710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:08.770412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:08.782147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:09.112108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:09.126820 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-891a40c1-a3a3-4866-943c-dc45a3132a07 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.393228 Aug 27 21:17:09.128460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2878/5855] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:08 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:09.131076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:09.143449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:09.144313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:09.157177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:09.158480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:09.159381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:09.161214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:09.162429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:09.163831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:09.203610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:09.424896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:09.442096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:09.448707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:09.450342 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-18a707d4-1872-46d6-92e2-1888a4587f92 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.320929 Aug 27 21:17:09.466988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2978/5856] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:09 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:10.155562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:10.156803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:10.168023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:10.170743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:10.171603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:10.172131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:10.173018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:10.173743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:10.174324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:10.346148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:10.356898 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e1b66b93-6224-4dee-926d-7b7db5fb8fb4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.206896 Aug 27 21:17:10.358050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2879/5857] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:10 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:10.474212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:10.474881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:10.487614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:10.488132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:10.488574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:10.489328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:10.489758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:10.490183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:10.761794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:10.770374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:10.771888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:10.773402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-df867d45-7dbf-48ba-bd63-8f45c3615730 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.303316 Aug 27 21:17:10.787127 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2979/5858] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:10 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:11.243232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d", "name": "network-vif-plugged", "status": "completed", "tag": "178864eb-8499-4d8f-9683-662eb054da61"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:11.265162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:11.265912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:11.266565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:11.286983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] Creating event network-vif-plugged:178864eb-8499-4d8f-9683-662eb054da61 for instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d on nch1-master-1 Aug 27 21:17:11.308261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-17bb24c9-390c-460e-9a66-51a96a7de096 req-a9363dde-e6ff-48ff-9e17-1f9d6d3f87bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058501 Aug 27 21:17:11.309061 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2880/5859] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:17:11.378232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:11.379462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:11.399900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:11.400752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:11.405118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:11.407022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:11.409343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:11.419032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:11.653063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:11.664326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-115e0b2a-f51f-406a-80ac-d0a51ac08fad tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.290109 Aug 27 21:17:11.665781 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2980/5860] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:11 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:11.800852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:11.801727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:11.808995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:11.809873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:11.810431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:11.811390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:11.812066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:11.813030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:11.987847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:11.998003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:12.001266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:12.002707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9090cb28-2b7c-4c1f-b984-f4297d360036 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.209313 Aug 27 21:17:12.003569 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2881/5861] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:11 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:12.687377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:12.688846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:12.700009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:12.700977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:12.701790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:12.702864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:12.703555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:12.704173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:12.931813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:12.944438 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-966e7a0c-7d07-4fa5-a4be-18815211ddd4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1314 microversion: 2.1 time: 0.261537 Aug 27 21:17:12.945040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2981/5862] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:12 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:13.029927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:13.032023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:13.037703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=34 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:13.043901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:13.044686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:13.045467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:13.046500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:13.047252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:13.047899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:13.204515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:13.217346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:13.217346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:13.218047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e7796d4-07a3-417d-8381-814baa04de0b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.195056 Aug 27 21:17:13.232300 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2882/5863] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:13 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:13.969682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:13.970619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:14.001324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.001922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.002637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.003668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.004369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.005018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.159491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:14.167936 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-614cd406-3868-40fd-804a-e44ce2ba75e2 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1501 microversion: 2.1 time: 0.205139 Aug 27 21:17:14.183517 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2982/5864] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:13 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:14.188850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:14.191478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:14.198481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.198975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.199583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.200269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.200800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.201215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.232026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lazy-loading 'flavor' on Instance uuid d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:17:14.249118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:14.250576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:14.262179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.262857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.263740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.264525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.265130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.265638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.332045 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ec291ae-60cc-406c-a158-c1b0f2b1024a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "POST /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d/action" status: 200 len: 32 microversion: 2.1 time: 0.147092 Aug 27 21:17:14.332683 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2883/5865] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:17:14 2022] POST /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 21:17:14.344649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:14.345605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:14.353340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.353814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.354259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.355754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:14.356469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:14.357147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:14.502281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:14.515470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:14.519075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:14.520658 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-127254dc-7916-4a4b-8a2a-8ab5604d90d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.277754 Aug 27 21:17:14.532377 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2983/5866] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:14 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:14.572489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:14.581798 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8aeca7b-287f-4177-b71e-e2be54e3525d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.242155 Aug 27 21:17:14.583193 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2884/5867] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:14 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:15.544967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:15.546175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:15.553054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:15.553824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:15.554335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:15.555678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:15.556222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:15.556663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:15.609484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:15.618405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:15.626604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:15.627113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:15.627613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:15.628330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:15.628793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:15.629225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:15.788819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:15.803162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:15.806262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:15.809550 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c164ec05-6d15-494b-8831-5bc7313623f2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.267183 Aug 27 21:17:15.810407 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2984/5868] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:15 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:15.822117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:15.834462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-efe25efa-a6b2-479c-b920-12341160b7b0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.233875 Aug 27 21:17:15.851697 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2885/5869] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:15 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:16.833120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:16.833743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:16.842960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:16.843460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:16.844261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:16.845153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:16.845753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:16.846317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:16.857512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:16.858722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:16.869004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:16.873276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:16.873879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:16.876272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:16.876751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:16.884743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:17.151955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:17.166072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:17.169826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:17.175366 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c9a743a-106c-4b4b-9fe3-d7f2e5655420 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.344247 Aug 27 21:17:17.176244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2985/5870] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:16 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:17.194325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:17.204037 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e5496e05-3414-4038-a25a-928f67a64f27 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.351093 Aug 27 21:17:17.204969 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2886/5871] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:16 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:18.200595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:18.201296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:18.209603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:18.210190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:18.210947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:18.212317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:18.212994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:18.213664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:18.231168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:18.231842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:18.244614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:18.245457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:18.246797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:18.247713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:18.248318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:18.251048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:18.459970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:18.469521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:18.471279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:18.473214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed2048fa-c81e-4825-83a0-6f8eac42d977 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.276963 Aug 27 21:17:18.485354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:18.487566 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2986/5872] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:18 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:18.489192 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-072859a8-aa03-48e6-9e27-37b31b6763dc tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.266702 Aug 27 21:17:18.499648 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2887/5873] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:18 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:19.500389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:19.501857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:19.510665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:19.511167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:19.511471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:19.511953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:19.512352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:19.512522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:19.512972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:19.513397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:19.519533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:19.520105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:19.520620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:19.521660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:19.522465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:19.523131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:19.738800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:19.746721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:19.751765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:19.753902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:19.755471 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84de3bd0-822b-4a4d-9d40-7c82dae150cc tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.259739 Aug 27 21:17:19.755798 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-56e05cc4-acc9-41c1-8f18-e5ec00acb9d5 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.248645 Aug 27 21:17:19.756789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2888/5874] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:19 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:19.770549 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2987/5875] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:19 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:20.779935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:20.780568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:20.788530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:20.789029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:20.790178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:20.791187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:20.791833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:20.792303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:20.795169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:20.796386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:20.805227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:20.806068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:20.806738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:20.807695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:20.808360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:20.809018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:21.511935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:21.521199 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9edee31-e929-4fa7-a756-a77707304b20 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.746762 Aug 27 21:17:21.522126 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2889/5876] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:20 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:21.529356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:21.539660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:21.541375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:21.542681 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84fa5ca9-93af-413d-a984-0d2283b871d6 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.751733 Aug 27 21:17:21.543530 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2988/5877] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:20 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:22.542784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:22.543444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:22.550858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:22.551682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:22.552129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:22.553261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:22.553945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:22.554402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:22.566493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:22.568105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:22.575968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:22.576819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:22.577469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:22.578405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:22.579031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:22.579605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:22.787826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:22.793279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:22.796428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aab6c435-58b9-4f75-aaa5-fd1a49b729e9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.257959 Aug 27 21:17:22.797816 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2890/5878] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:22 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:22.804996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:22.806712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:22.807993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3b270b2-93c3-4c39-a3a1-1a31503377a1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1743 microversion: 2.20 time: 0.245607 Aug 27 21:17:22.808688 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2989/5879] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:22 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1743 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:23.823422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:23.824706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:23.836148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:23.837716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:23.853385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:23.855473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:23.857567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:23.858224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:23.859493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:23.859657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:23.860538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:23.861397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:23.862003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:23.862627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:23.863076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:23.865570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:23.885865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:24.133149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:24.135918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:24.145362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:24.146045 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2dcfef6d-38d7-433a-9bc3-ba159b636583 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.330004 Aug 27 21:17:24.147054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:24.147254 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2891/5880] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:23 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:24.149041 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-236f348b-bea4-40bb-9a78-2e7fde665f8f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1743 microversion: 2.20 time: 0.318594 Aug 27 21:17:24.162695 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2990/5881] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:23 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1743 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:25.173508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:25.174533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:25.180338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:25.181740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:25.190215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:25.190858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:25.194901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:25.196023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:25.196584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:25.197727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:25.201953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:25.202843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:25.203555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:25.205224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:25.205887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:25.206372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:25.473346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:25.490045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:25.494522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:25.498228 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c7edd04-9f3a-46c5-b752-4678e351596b tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1743 microversion: 2.20 time: 0.328402 Aug 27 21:17:25.511365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2991/5882] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:25 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1743 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:25.512295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "name": "network-vif-plugged", "status": "completed", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:25.526934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:25.527538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:25.528072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:25.528726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:25.541314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c1becb4-63a4-48d7-bb7c-a9781bdb1517 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.375361 Aug 27 21:17:25.542992 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2892/5883] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:25 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:25.544980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] Creating event network-vif-plugged:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch1-master-1 Aug 27 21:17:25.552193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-20091176-4e8b-403d-855c-759a3897f6b2 req-5c3439b8-a106-4515-94b1-486fa3afb942 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049788 Aug 27 21:17:25.553198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2992/5884] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:17:26.526086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:26.527506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:26.537427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:26.538228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:26.539803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:26.540877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:26.541842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:26.542860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:26.565394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:26.566784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:26.589257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:26.590093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:26.590757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:26.593298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:26.594350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:26.594782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:26.598382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:26.911356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:26.921604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:26.935567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:26.936960 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fe2a3a77-b942-4612-ab20-a83966cbca69 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.418724 Aug 27 21:17:26.946877 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2893/5885] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:26 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:26.962879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:26.980624 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78bb53d9-98e7-40d8-bb17-5a0aa84c414c tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.419577 Aug 27 21:17:26.981443 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2993/5886] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:26 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:27.971104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:27.972365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:27.980008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:27.980896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:27.981574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:27.982582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:27.983506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:27.984292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:28.013031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:28.014285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:28.030016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:28.030963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:28.032235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:28.036267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:28.038041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:28.038752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:28.555637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:28.570269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:28.572485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:28.583067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:28.588250 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c63e1293-ddce-4f5e-8dc0-c80c67eeddd8 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.621253 Aug 27 21:17:28.592089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2894/5887] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:27 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:28.594261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-412ec88c-e71d-4732-8966-e3b25188d487 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.586694 Aug 27 21:17:28.596031 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2994/5888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:28 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:29.620014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:29.620627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:29.623257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:29.624202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:29.632756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:29.650318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:29.650920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:29.651574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:29.652164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:29.653709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:29.654263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:29.654996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:29.655671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:29.656320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:29.662235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:29.665716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:29.666414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:30.092530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:30.108485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:30.112638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:30.113979 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec09f6a3-dda9-47fc-a9f2-962014be1ebe tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.501420 Aug 27 21:17:30.118130 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2895/5889] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:29 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:30.144028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:30.157687 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ca888af-be48-478c-a440-d4ee24bdd418 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.537050 Aug 27 21:17:30.158978 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2995/5890] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:29 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:31.146775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:31.148108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:31.157478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:31.158652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:31.159508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:31.160688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:31.161379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:31.162419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:31.187165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:31.188018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:31.216861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:31.218839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:31.219480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:31.222118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:31.223518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:31.227074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:31.558809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:31.605999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:31.608697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:31.619508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c1098d1-7483-4b24-88fa-7616079a770b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.440797 Aug 27 21:17:31.621006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2996/5891] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:31 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:31.621715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:31.624050 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64ec9c46-e27a-4da1-9ab8-563dc86ac621 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.485913 Aug 27 21:17:31.637669 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2896/5892] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:31 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:32.650862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:32.652193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:32.663078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:32.665250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:32.674256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:32.675231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:32.675857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:32.678163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:32.678782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:32.679278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:32.679519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:32.679755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:32.680233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:32.680466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:32.680926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:32.681357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:32.915384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:32.929249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:32.931906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:32.934468 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8b01063-7dc5-47b8-8116-1dfc3bba43c7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.291846 Aug 27 21:17:32.936623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2997/5893] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:32 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:33.013448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:33.035920 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b244a2b-e32f-4db2-8f26-9098b2c02f64 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.380147 Aug 27 21:17:33.054917 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2897/5894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:32 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:33.963933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:33.964464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:33.986863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:33.987405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:33.987904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:33.988636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:33.989151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:33.989613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:34.069845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:34.070825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:34.093493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:34.098580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:34.100326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:34.103166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:34.107139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:34.108281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:34.459982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:34.476223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:34.477820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:34.479212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71294ca2-bba5-4886-9e1d-39153a346685 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.522579 Aug 27 21:17:34.479708 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2998/5895] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:33 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:34.562209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:34.572012 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c17eef5-90ff-460b-afee-c0b6537516a1 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.509178 Aug 27 21:17:34.572610 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2898/5896] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:34 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:35.503191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:35.504655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:35.517402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:35.521202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:35.521863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:35.535318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:35.537563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:35.539958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:35.596021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:35.596766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:35.609480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:35.611470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:35.620869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:35.622165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:35.624446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:35.625115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:35.890165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:35.916105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:35.918030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:35.919374 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe5cbd95-d4ae-4f13-981c-eb72757000d1 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.420933 Aug 27 21:17:35.919974 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 2999/5897] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:35 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:35.973313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:35.987365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b45aee93-daa9-448f-a5cb-df400373978b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.396377 Aug 27 21:17:35.991154 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2899/5898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:35 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:36.946760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:36.948141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:36.971902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:36.973745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:36.974915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:36.976436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:36.979058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:36.980127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:37.018333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:37.019584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:37.033962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:37.035038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:37.036635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:37.040179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:37.040940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:37.041537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:37.516377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:37.531044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:37.533984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:37.536029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ffb52872-4a00-4531-bf14-3b9251aae709 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.596401 Aug 27 21:17:37.542897 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3000/5899] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:36 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:37.558481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:37.569966 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5bf26019-d7db-4733-84fe-22590f2fac66 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.559631 Aug 27 21:17:37.591740 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2900/5900] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:37 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:38.565592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:38.566422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:38.577114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:38.577354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:38.578041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:38.580144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:38.580804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:38.581451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:38.599222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:38.600475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:38.627260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:38.628031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:38.628618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:38.629781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:38.630854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:38.631663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:38.946770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:38.970791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:38.976872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:38.979597 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8bb6575-6348-4e7f-8621-a6e5e53e8d35 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.386632 Aug 27 21:17:38.980184 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2901/5901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:38 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:38.982717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:38.989879 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c286cc7-e88d-43f4-bb2d-ff61a118ccdd tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.428819 Aug 27 21:17:38.991988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3001/5902] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:38 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:40.003765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:40.004669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:40.017672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:40.018943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:40.034240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:40.036187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:40.036954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:40.037594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:40.040012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:40.041388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:40.043811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:40.044423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:40.045968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:40.047170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:40.048810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:40.051222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:40.399299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:40.408790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:40.416988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:40.423232 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1d09c5a-c52f-4c8c-9eb4-130b1c497715 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.409558 Aug 27 21:17:40.424266 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3002/5903] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:40 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:40.465698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:40.475999 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-498435ca-9ced-40b1-8959-bf5aaec0b93b tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.477967 Aug 27 21:17:40.476668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2902/5904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:39 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:41.448962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:41.449574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:41.457146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:41.457550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:41.457990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:41.464283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:41.464850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:41.465304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:41.500743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:41.501376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:41.525128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:41.525640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:41.526082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:41.526809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:41.527270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:41.527934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:41.828303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:41.840585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:41.844197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:41.847501 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41af9ea9-3d4d-4dfe-8cad-9ddf39667e26 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.402538 Aug 27 21:17:41.852369 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3003/5905] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:41 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:41.912454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:41.924288 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-817f40da-eed0-4d5e-a974-51ed150bf331 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.427375 Aug 27 21:17:41.931676 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2903/5906] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:41 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:42.879181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:42.880864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:42.901078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:42.901960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:42.903943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:42.907612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:42.908197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:42.908723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:42.953010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:42.954485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:42.975694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:42.975694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:42.975694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:42.979247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:43.005228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:43.005529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:43.564412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:43.576581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:43.578039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:43.579263 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e3e0ee7f-1bbb-482f-a0aa-4b06d704cd4e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1738 microversion: 2.20 time: 0.708201 Aug 27 21:17:43.582870 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3004/5907] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:42 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1738 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:43.618941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:43.638108 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-efe25e76-d827-4433-bc9f-595a2cfd5f8f tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.689192 Aug 27 21:17:43.640224 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2904/5908] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:42 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:44.611059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:44.612052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:44.624809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:44.631659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:44.634124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:44.639592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:44.640093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:44.647976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:44.667121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:44.668419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:44.676932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=46 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:44.683397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:44.684473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:44.685107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:44.696488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:44.698258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:44.700238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:45.116579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:45.127696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:45.133877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:45.140563 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd770bfa-7b46-409a-8877-dde0683ac3c2 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1720 microversion: 2.20 time: 0.531869 Aug 27 21:17:45.143001 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3005/5909] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:44 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1720 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:45.274205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:45.288793 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ab993b6-5b3d-4e0e-89b5-883f8f6ea608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.627584 Aug 27 21:17:45.289586 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2905/5910] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:44 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:45.542206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "name": "network-vif-unplugged", "status": "completed", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:45.557288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:45.565588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:45.566169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:45.593247 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] Creating event network-vif-unplugged:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch1-master-1 Aug 27 21:17:45.608863 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9fca9f50-6173-474d-ba25-c0d9eb60f5c9 req-6d3e5543-2cd9-4462-940d-26a1a804433d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070656 Aug 27 21:17:45.609878 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3006/5911] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:17:46.168413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:46.169959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:46.181112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:46.181982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:46.182730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:46.183724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:46.184326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:46.185358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:46.319953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:46.321685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:46.338495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:46.341158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:46.345037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:46.350143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:46.350817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:46.352037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:46.441956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:46.454303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:46.456346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:46.464504 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-965ee4ed-cac6-4a9a-ba7a-adfac742b9d0 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1720 microversion: 2.20 time: 0.302001 Aug 27 21:17:46.484758 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2906/5912] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:46 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1720 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:46.619232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:46.628929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81626b65-0596-4546-b85f-13f3d5006965 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.314785 Aug 27 21:17:46.630814 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3007/5913] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:46 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:47.501451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:47.504022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:47.517280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.519110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.519777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.521066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.529401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.529872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.658793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:47.659450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:47.675759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.678281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.678919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.679853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.681483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.682081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.834328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:47.850916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:47.860185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:47.861618 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ceee4526-9e94-4b63-a48f-152165206529 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1723 microversion: 2.20 time: 0.370447 Aug 27 21:17:47.862766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2907/5914] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:47 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:47.890584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd39b830-6dd7-44ea-bb11-15a2d1f5987b"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:47.893584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:47.915048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.918453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.919439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.920425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:47.921480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:47.924962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:47.929019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=100 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:48.080328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:48.097860 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eba70e35-ac31-4ae5-a0a0-f99163797067 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.444520 Aug 27 21:17:48.100008 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3008/5915] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:47 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:48.538553 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0b50904-3aa3-469d-b08e-738597f7317d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.653100 Aug 27 21:17:48.539655 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2908/5916] 10.222.0.40 () {62 vars in 1364 bytes} [Sat Aug 27 21:17:47 2022] POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments => generated 188 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:17:48.774074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:48.775303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:48.801818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:48.805566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:48.810101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:48.813988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:48.816536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:48.823635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.006391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=100 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:17:49.122727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:49.124009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:49.132919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.135244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.137934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.143756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.158841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.161010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.348980 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74690c7c-ef7c-4100-b8db-304afd1e57de tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments/bd39b830-6dd7-44ea-bb11-15a2d1f5987b" status: 202 len: 0 microversion: 2.20 time: 0.580868 Aug 27 21:17:49.350086 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3009/5917] 10.222.0.40 () {60 vars in 1457 bytes} [Sat Aug 27 21:17:48 2022] DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments/bd39b830-6dd7-44ea-bb11-15a2d1f5987b => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:17:49.461954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:49.463636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:49.475982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.477306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.478081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.482626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.483088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.483643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.569580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140434) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 21:17:49.729300 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ff37caeb-39ef-4120-9e34-a65e83752993 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/action" status: 202 len: 0 microversion: 2.20 time: 0.269950 Aug 27 21:17:49.733672 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3010/5918] 10.222.0.40 () {62 vars in 1319 bytes} [Sat Aug 27 21:17:49 2022] POST /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:17:49.764231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:49.768983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:49.791150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:49.800474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.801036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.801528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.808981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:49.810862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd96a899-c1ac-4b2f-bdd0-8009ee7ac85d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.689268 Aug 27 21:17:49.811539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:49.812018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:49.813761 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2909/5919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:49 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:50.230534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:50.239752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:50.245380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:50.249292 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e2f0e43e-67ca-418d-b9b2-9664b341d575 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1671 microversion: 2.20 time: 0.512230 Aug 27 21:17:50.254186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3011/5920] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:49 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:50.842110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:50.842754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:50.851402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:50.852113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:50.853395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:50.854496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:50.856121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:50.856847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.127435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:51.140653 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a435dd13-1319-485d-9c76-f2cac5c8d7e4 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1487 microversion: 2.1 time: 0.309678 Aug 27 21:17:51.166403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:51.166960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:51.171409 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2910/5921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:50 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1487 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:51.182536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.184262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.185593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.189354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.189952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.190580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.274783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:51.275932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:51.285187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.285905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.286755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.287614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.288111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.288688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.432149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81532404-99ad-4491-bc42-8c096d929469 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "POST /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.269924 Aug 27 21:17:51.450648 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3012/5922] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:17:51 2022] POST /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:17:51.476033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:51.476689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:51.507677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.508195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.508660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.509394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:51.518273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:51.518740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:51.689854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:51.707992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:51.715576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:51.716970 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-026d60bc-8464-4789-b0cc-76ca916c1dae tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1673 microversion: 2.20 time: 0.447247 Aug 27 21:17:51.719922 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2911/5923] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:51 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1673 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:51.842306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:51.860326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a16459ea-6d19-4ca3-97f5-4e8cdd1f82cf tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1495 microversion: 2.1 time: 0.406724 Aug 27 21:17:51.861790 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3013/5924] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:51 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1495 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:52.745827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:52.746574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:52.777908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:52.778710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:52.779301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:52.783516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:52.786491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:52.789778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:52.883849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:52.884843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:52.898104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:52.904422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:52.906993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:52.907935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:52.910184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:52.915732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:53.272424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:53.286123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:53.290294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:53.293188 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2a7528b-42ac-4894-b8cc-45284b9ecd49 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.552082 Aug 27 21:17:53.298510 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2912/5925] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:52 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:53.306265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:53.316978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-469689e7-d9dc-4829-a4e2-3dbcb50b4aeb tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1495 microversion: 2.1 time: 0.438448 Aug 27 21:17:53.318811 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3014/5926] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:52 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1495 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:54.321227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:54.322470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:54.331760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:54.333077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:54.333838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:54.335109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:54.336034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:54.339676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:54.344674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:54.347181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:54.371549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:54.372080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:54.372520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:54.373282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:54.377479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:54.377943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:54.763714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:54.776690 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2cabb62b-e544-4a87-b1fc-ac108be1a704 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1495 microversion: 2.1 time: 0.435893 Aug 27 21:17:54.777479 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3015/5927] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:54 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:54.838173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:54.852891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:54.854403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:54.855672 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5fdbf03b-8c78-4966-a616-df74caa087f9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.538563 Aug 27 21:17:54.856256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2913/5928] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:54 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:55.732668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:17:55.743838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:55.744312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:55.744929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:55.758273 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] Creating event network-changed:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch2-master-1 Aug 27 21:17:55.763738 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8323e1a3-61ac-4467-bfd6-48136c161240 req-b24c172a-ee05-4506-9d56-ce85c7a401ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034845 Aug 27 21:17:55.764346 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3016/5929] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:17:55.798853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:55.799798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:55.808061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:55.808696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:55.809283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:55.810389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:55.812069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:55.812491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:55.892234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:55.893527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:55.905954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:55.908004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:55.908701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:55.909527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:55.910059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:55.910670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:56.270878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:56.288871 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35dbfd1f-0993-449b-99be-8394a9d49f6d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1495 microversion: 2.1 time: 0.493057 Aug 27 21:17:56.291468 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2914/5930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:55 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1495 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:56.462134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:56.473668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:56.481033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:56.482487 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d30648d-f067-4c1f-be3d-f54c3230f62e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.605546 Aug 27 21:17:56.483380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3017/5931] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:55 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:17:57.315684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:57.317460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:57.328839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:57.330232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:57.331105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:57.332313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:57.333487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:57.334734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:57.509659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:57.512672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:57.536992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:57.537923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:57.539032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:57.542103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:57.542938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:57.543600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:58.065366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:58.094287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:58.103130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:58.109261 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79d103d4-da12-4102-97a2-881550f71800 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1501 microversion: 2.1 time: 0.797795 Aug 27 21:17:58.113571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:58.113985 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2915/5932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:57 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1501 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:17:58.115241 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-031453c4-3aea-4551-93e3-2ef005ffbb25 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.613184 Aug 27 21:17:58.129906 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3018/5933] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:57 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:17:58.160350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:58.161061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:58.180234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:58.181460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:58.182046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:58.182967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:58.183761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:58.184335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:58.217003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:17:58.339434 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c0f326f6-4e50-4508-a402-199ec1f32fb7 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 204 len: 0 microversion: 2.1 time: 0.183537 Aug 27 21:17:58.341919 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2916/5934] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:17:58 2022] DELETE /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:17:58.355787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:58.356621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:58.374508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:58.375029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:58.385117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:58.386066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:58.386574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:58.387043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:58.960551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:59.007444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ee95d39-2a2c-4304-8b99-71833d7ae724 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.652003 Aug 27 21:17:59.019360 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3019/5935] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:17:58 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:17:59.163283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:17:59.164416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:17:59.182497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:59.189618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:59.190138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:59.192620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:17:59.193812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:17:59.195996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:17:59.731420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:59.752333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:59.753807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:17:59.755244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9222e0f5-fe29-45f3-ba98-fb07c042de48 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.598391 Aug 27 21:17:59.777291 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2917/5936] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:17:59 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:00.035105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:00.036057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:00.042149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:00.054395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:00.054915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:00.055570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:00.056705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:00.057191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:00.058235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:00.666164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:00.681227 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3696270d-4499-4438-880d-104fe0a3a1f3 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.648613 Aug 27 21:18:00.689587 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3020/5937] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:00 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:00.801995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:00.803306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:00.818859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:00.819891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:00.820726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:00.821814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:00.825863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:00.826630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:01.704553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:01.705913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:01.724950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:01.725458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:01.725960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:01.726701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:01.731954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:01.732804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:01.799778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:01.836337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:01.839959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:01.844175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fb88047-01cf-4b64-9fc4-62fcdf823fc5 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 1.047083 Aug 27 21:18:01.859372 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2918/5938] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:00 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:02.317714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:02.333849 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-24b0127b-5a39-46f1-b405-efad6dd4f69a tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1507 microversion: 2.1 time: 0.633732 Aug 27 21:18:02.335305 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3021/5939] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:01 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:02.873497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:02.876876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:02.901473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:02.903461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:02.904003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:02.909489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:02.911864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:02.918594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:03.363319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:03.364609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:03.398710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:03.408457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:03.409994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:03.412026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:03.414980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:03.423189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:03.670830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:03.680897 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9c3edd2-5cf4-4d06-b387-421bf295873d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1465 microversion: 2.1 time: 0.324008 Aug 27 21:18:03.693501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3022/5940] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:03 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1465 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:03.713422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d", "name": "network-vif-deleted", "tag": "178864eb-8499-4d8f-9683-662eb054da61"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:03.763847 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:03.765343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:03.766043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:03.777165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=90,nova_cell1:UPDATE=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:03.807238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] Creating event network-vif-deleted:178864eb-8499-4d8f-9683-662eb054da61 for instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d on nch1-master-1 Aug 27 21:18:03.823249 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f4ac1900-28dd-4efa-9264-a9e12a5e0f72 req-609d6557-c298-4bc9-a6df-7a91fb853360 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128297 Aug 27 21:18:03.827554 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3023/5941] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:03.941790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:03.956454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:03.968605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:03.970943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d82c845-8ca2-4235-9101-b54cce510443 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 1.102038 Aug 27 21:18:03.976047 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2919/5942] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:02 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:04.723308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:04.727228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:04.770761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:04.775261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:04.776675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:04.778828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:04.779972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:04.782096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:04.930001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:04.936567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:04.939189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:04.939908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lazy-loading 'fault' on Instance uuid d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:05.004537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:05.006441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:05.039100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:05.040088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:05.040987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:05.041992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:05.043256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:05.045739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:05.075019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:05.104276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7a686b16-3d86-43c7-8317-a089c5883a43 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 200 len: 1304 microversion: 2.1 time: 0.393668 Aug 27 21:18:05.108502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3024/5943] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:04 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 1304 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:05.190228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:05.419754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:05.448414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:05.460565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:05.464787 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b67f5c21-a85f-418c-99e9-9d0cc74b596d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.465813 Aug 27 21:18:05.482303 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2920/5944] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:04 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:18:06.131138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:06.132491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:06.151910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.169800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.171977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.173019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.178042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.179706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.253453 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] HTTP exception thrown: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Request method failure captured: Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d HTTP/1.1 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjComPZevXyCnY7fv4Bpj_Hk4X1c1gECIirdSrXRGNG-dsyQZsonkw7t8kM8QuFlZ8pPuqZNFDx4LoJ0wADlyjsIqc76D2-BoFooJKnS7U6c8L9yY8p88MN68ZYmln8ClCfyYiL2_tO8Telh6kz7mslYDo8PG_t8uAAknQyuX7cybay2I Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: cecffcd3f1204f589fd2cb6bc942b0f7 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cecffcd3f1204f589fd2cb6bc942b0f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cecffcd3f1204f589fd2cb6bc942b0f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cecffcd3f1204f589fd2cb6bc942b0f7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cecffcd3f1204f589fd2cb6bc942b0f7"}]}] Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: cecffcd3f1204f589fd2cb6bc942b0f7 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueTestJSON-2045283898-project Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9054fd09ee6f4b3abe9279eb1166cbc7 Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueTestJSON-2045283898-project Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'd330d044-f0bf-49ea-a78a-e0ca1a0a1f3d'} Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:06.256675 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. Aug 27 21:18:06.261534 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:06.265112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Returning 404 to user: Instance d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:18:06.266151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64252f70-c7ff-46e2-a7f3-8bfbf1f257a9 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d" status: 404 len: 111 microversion: 2.1 time: 0.139645 Aug 27 21:18:06.268877 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3025/5945] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:06 2022] GET /compute/v2.1/servers/d330d044-f0bf-49ea-a78a-e0ca1a0a1f3d => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:18:06.290159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:06.293092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:06.314398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.318461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.320363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.327937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.332156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.337243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.406818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:18:06.501110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:06.505704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:06.543387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.544131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.547932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.550980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.551785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.552502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.639529 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e50c6d8f-89f7-430a-a7a3-a609cc579608 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 204 len: 0 microversion: 2.1 time: 0.366818 Aug 27 21:18:06.641690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2921/5946] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:18:06 2022] DELETE /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:18:06.656115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:06.657402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:06.667964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.669091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.669767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.671003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:06.672419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:06.673707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:06.964013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:06.972742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:06.978927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:06.983547 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c7e8b05-bf66-444d-9f46-72fbe063a7fa tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.492838 Aug 27 21:18:06.985368 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3026/5947] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:06 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:07.015811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:07.029323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-483b0de1-2c34-4457-b050-40cfe3b290e0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1492 microversion: 2.1 time: 0.384203 Aug 27 21:18:07.035845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2922/5948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:06 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1492 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:08.013423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:08.014153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:08.039197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:08.040962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:08.041523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:08.050547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:08.051261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:08.051710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:08.052556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:08.055460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:08.065877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:08.066419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:08.069165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:08.070284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:08.071780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:08.078829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:08.994924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:09.013221 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-38762271-b406-4207-b448-c3603522ac4d tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1492 microversion: 2.1 time: 0.966454 Aug 27 21:18:09.014242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2923/5949] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:08 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1492 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:09.086103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:09.098162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:09.109974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:09.111698 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ff6e322-8372-42fb-a5ef-b877cc71208e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 1.103616 Aug 27 21:18:09.127648 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3027/5950] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:08 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:10.040611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:10.041139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:10.067292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:10.068031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:10.068569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:10.069193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:10.069646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:10.070123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:10.144187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:10.144977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:10.171774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:10.196695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:10.198462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:10.203503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:10.208564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:10.210342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:10.834184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:10.851045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:10.868033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:10.869353 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-982cb05d-9977-4c16-9a8b-a4494c635869 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.729991 Aug 27 21:18:10.874070 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3028/5951] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:10 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:11.177521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:11.200088 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7005893c-f4ce-4b40-8c73-2c4accf63eb0 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1492 microversion: 2.1 time: 1.163769 Aug 27 21:18:11.218982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2924/5952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:10 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1492 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:11.279769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16416af-024a-4b0e-8627-af618e653b41", "name": "network-vif-deleted", "tag": "a81e72be-360a-4fac-9704-5eabd4716cf0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:11.322128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:11.326308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:11.327000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:11.387819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] Creating event network-vif-deleted:a81e72be-360a-4fac-9704-5eabd4716cf0 for instance a16416af-024a-4b0e-8627-af618e653b41 on nch2-master-1 Aug 27 21:18:11.419071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ac62e7e1-3f62-4d40-bf7f-1ab123e37a60 req-42353137-cf5b-4112-89f4-2f4718820e5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140328 Aug 27 21:18:11.420687 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3029/5953] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:11.902185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:11.902917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:11.932152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:11.933972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:11.935849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:11.936757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:11.942143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:11.942747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:12.228511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:12.229402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:12.246943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:12.259087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:12.259766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:12.260929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:12.261658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:12.262088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:12.360247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:12.367979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:12.368449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:12.368940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lazy-loading 'fault' on Instance uuid a16416af-024a-4b0e-8627-af618e653b41 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:12.581893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9054fd09ee6f4b3abe9279eb1166cbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecffcd3f1204f589fd2cb6bc942b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:12.597335 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84b2c23c-8db6-4a6a-8f77-93d3e94b7570 tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 200 len: 1304 microversion: 2.1 time: 0.374672 Aug 27 21:18:12.606250 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3030/5954] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:12 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 1304 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:12.649900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:12.664829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:12.670211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:12.671532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9d5bb65-017a-4841-84ef-b6348c35844c tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.774339 Aug 27 21:18:12.687465 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2925/5955] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:11 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:13.626283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:13.626900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] [instance: a16416af-024a-4b0e-8627-af618e653b41] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:13.641220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:13.641793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:13.642244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:13.643047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:13.643493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:13.644091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:13.661074 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] HTTP exception thrown: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Request method failure captured: Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 HTTP/1.1 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjComPZevXyCnY7fv4Bpj_Hk4X1c1gECIirdSrXRGNG-dsyQZsonkw7t8kM8QuFlZ8pPuqZNFDx4LoJ0wADlyjsIqc76D2-BoFooJKnS7U6c8L9yY8p88MN68ZYmln8ClCfyYiL2_tO8Telh6kz7mslYDo8PG_t8uAAknQyuX7cybay2I Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: cecffcd3f1204f589fd2cb6bc942b0f7 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cecffcd3f1204f589fd2cb6bc942b0f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/cecffcd3f1204f589fd2cb6bc942b0f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_cecffcd3f1204f589fd2cb6bc942b0f7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/cecffcd3f1204f589fd2cb6bc942b0f7"}]}] Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: cecffcd3f1204f589fd2cb6bc942b0f7 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerRescueTestJSON-2045283898 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerRescueTestJSON-2045283898-project Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9054fd09ee6f4b3abe9279eb1166cbc7 Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerRescueTestJSON-2045283898-project Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'a16416af-024a-4b0e-8627-af618e653b41'} Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:13.663186 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. Aug 27 21:18:13.667728 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:13.669418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] Returning 404 to user: Instance a16416af-024a-4b0e-8627-af618e653b41 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:18:13.670696 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-70cbb19f-86d1-4c79-a9bb-4270a7d897de tempest-ServerRescueTestJSON-2045283898 tempest-ServerRescueTestJSON-2045283898-project] 10.222.0.40 "GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41" status: 404 len: 111 microversion: 2.1 time: 0.048338 Aug 27 21:18:13.671811 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3031/5956] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:13 2022] GET /compute/v2.1/servers/a16416af-024a-4b0e-8627-af618e653b41 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:18:13.713234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:13.713860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:13.731591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:13.732096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:13.732547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:13.733273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:13.733736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:13.734168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:13.992822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:14.002974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:14.005917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:14.011772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-29373a74-c5b1-4572-89bb-0b80803c7674 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.302941 Aug 27 21:18:14.013971 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2926/5957] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:13 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:14.061774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Action: 'create', calling method: .version_select at 0x7ff84ec73430>, body: {"keypair": {"name": "tempest-TestServerBasicOps-461381666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvFGwIPJo3C7S1WYQJqtYGXiQlJrFxrvL96/q/DMOigKnxjU/9JqTTLQ1QGMLHT+y5IWJX8n1mvfIHYqJ28ZRzSy6Z8K73xFAPTFFOCMxXuxVjGAoxe4EQ8dsvRLeAbzA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:14.104705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for project e38ecb63e6bf464281287449b5c5eeed. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:18:14.119088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for user 4998bdbb5bae48aab1361ca88b0ca78b and project e38ecb63e6bf464281287449b5c5eeed. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:18:14.148180 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:18:15.044735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:15.047925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:15.052822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:15.057298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:15.058055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:15.058700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:15.059728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:15.060562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:15.061196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:15.158873 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 44116. Aug 27 21:18:15.185809 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3afc1f29-c007-4495-aa14-5576d3d4c667 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.447651 Aug 27 21:18:15.187979 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3032/5958] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:18:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:18:15.386906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:15.423797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:15.425569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:15.430746 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-20ada2bd-4ab7-41ee-9680-5ce3f08e0128 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.396879 Aug 27 21:18:15.432843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2927/5959] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:15 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:16.459724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:16.460280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:16.484579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:16.485774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:16.488522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:16.491455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:16.493187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:16.494611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:17.016791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:17.028841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:17.030625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:17.032068 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b28cfec-77df-4021-a1f7-a0deb695e8ad tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.578258 Aug 27 21:18:17.048300 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3033/5960] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:16 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:18.061278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:18.061889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:18.075467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:18.075965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:18.076999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:18.077962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:18.078595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:18.079532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:18.334811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:18.349740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:18.354521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:18.357950 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5896037b-3f1f-41dd-b630-555650b74729 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.302256 Aug 27 21:18:18.375536 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2928/5961] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:18 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:18.803139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1916249567", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-461381666", "security_groups": [{"name": "tempest-secgroup-smoke-2070229490"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "289d1258-918e-4ce8-a2cf-e87b795da44c"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:19.018400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] validate_networks() for [('289d1258-918e-4ce8-a2cf-e87b795da44c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:18:19.391605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:19.392862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:19.404843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:19.405713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:19.406844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:19.407740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:19.408476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:19.417407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:19.740664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for project e38ecb63e6bf464281287449b5c5eeed. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:18:19.747354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for user 4998bdbb5bae48aab1361ca88b0ca78b and project e38ecb63e6bf464281287449b5c5eeed. Resources: dict_keys(['metadata_items']) {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:18:19.776385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:18:19.776825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:18:19.781032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:18:19.781032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:18:19.781032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:18:19.791492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:19.791492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:19.791492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:19.791992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:19.792702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:19.793361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:19.812741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:19.820157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for project e38ecb63e6bf464281287449b5c5eeed. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:18:19.823956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:19.825692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:19.827249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Getting quotas for user 4998bdbb5bae48aab1361ca88b0ca78b and project e38ecb63e6bf464281287449b5c5eeed. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:18:19.827555 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66089f30-8d60-4572-a115-61336bc32e6f tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.448212 Aug 27 21:18:19.844411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2929/5962] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:19 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:18:19.877755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:18:19.880517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:18:19.968428 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c128f93-7134-489f-b6da-8bfb1fdee413 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.170999 Aug 27 21:18:19.974843 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3034/5963] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:18:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:18:19.980416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9bc6e271-9e9c-47fe-8dfe-994e30d63609 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:19.981054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9bc6e271-9e9c-47fe-8dfe-994e30d63609 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:20.111818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9bc6e271-9e9c-47fe-8dfe-994e30d63609 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:20.125728 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9bc6e271-9e9c-47fe-8dfe-994e30d63609 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1302 microversion: 2.1 time: 0.149468 Aug 27 21:18:20.131932 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2930/5964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:19 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1302 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:20.644921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "name": "network-vif-plugged", "status": "completed", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:20.676081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:20.677214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:20.679255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:20.723223 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] Creating event network-vif-plugged:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch2-master-1 Aug 27 21:18:20.735304 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a6d04705-70c8-4ee9-8153-bfb45092b4e4 req-fe86e9ae-04c2-47b4-ba98-6205ad829c40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094222 Aug 27 21:18:20.736492 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3035/5965] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:20.854629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:20.855253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:20.873705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:20.874220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:20.874668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:20.880995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:20.881485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:20.881976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:21.152323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:21.153041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:21.166142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:21.166658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:21.167119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:21.167873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:21.168341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:21.172808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:21.223224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:21.242355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:21.270548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:21.276889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-786b14dc-058c-49d4-b05f-18eac745317e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.425293 Aug 27 21:18:21.278786 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2931/5966] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:20 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:21.347856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:21.369281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0adb0ab8-8eab-4897-8f23-5d32270faf55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1298 microversion: 2.1 time: 0.222225 Aug 27 21:18:21.383365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3036/5967] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:21 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:22.312972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:22.312972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:22.334631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:22.336684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:22.337958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:22.341195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:22.346496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:22.349355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:22.397940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:22.399299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:22.409280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:22.414004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:22.414834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:22.415854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:22.416545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:22.417195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:22.720244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:22.735152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba29052e-a548-43de-a6e1-d7657c435be1 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1360 microversion: 2.1 time: 0.341806 Aug 27 21:18:22.738002 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3037/5968] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:22 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:22.855490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:22.869658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:22.872015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:22.874063 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1da3465b-2fe4-4e74-ba7f-56b85c5b0fd9 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.571214 Aug 27 21:18:22.889213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2932/5969] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:22 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:23.766239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:23.767265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:23.790653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:23.793233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:23.793697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:23.797629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:23.798127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:23.798574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:23.901222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:23.902552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:23.915137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:23.915955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:23.919397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:23.920292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:23.920852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:23.921349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:24.359034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:24.371787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:24.378685 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-60e35d47-979a-4bcf-ab2a-77503bb3b877 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.617990 Aug 27 21:18:24.392439 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3038/5970] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:23 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:24.404332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:24.406563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:24.408881 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1261b098-7597-4e0b-994b-46aefb143404 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1729 microversion: 2.20 time: 0.510925 Aug 27 21:18:24.409682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2933/5971] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:23 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1729 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:24.862499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c197098-5003-41e3-9d3c-ab09e9076ed4", "tag": "cf631e8a-0cea-4b51-ab22-88ff58b38e7a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:24.887078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:24.887897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:24.888672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:24.919471 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] Creating event network-changed:cf631e8a-0cea-4b51-ab22-88ff58b38e7a for instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 on nch1-master-1 Aug 27 21:18:24.941430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-0f56b29e-a3d4-4dc2-9f3e-bf74385da472 req-b8bdafa9-259e-4bd0-afac-6c1b08bd6378 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083721 Aug 27 21:18:24.942294 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3039/5972] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:25.401534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:25.402954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:25.422845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:25.424487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:25.426269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:25.427214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:25.428385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:25.435058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:25.436148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:25.441436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:25.455566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:25.458353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:25.459035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:25.460486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:25.461098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:25.465902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:25.978009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:25.991484 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-741f999d-ee15-43a2-808c-75608a09fde7 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.594583 Aug 27 21:18:25.994516 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2934/5973] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:25 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:26.171549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:26.182861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:26.185149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:26.186612 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f83169a-5d76-407e-a526-298d07412506 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1716 microversion: 2.20 time: 0.756122 Aug 27 21:18:26.187647 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3040/5974] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:25 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1716 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 21:18:27.017632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:27.018299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:27.033466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:27.034757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:27.037585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:27.041341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:27.042670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:27.043678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:27.737027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:27.749449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10a3f790-0619-4ab1-9974-e86afc8ac665 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.737235 Aug 27 21:18:27.763378 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2935/5975] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:27 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:28.778489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:28.779776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:28.795298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:28.796110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:28.798609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:28.799633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:28.802095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:28.802904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:29.535929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:29.557106 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07df74b7-c23a-4525-b32a-18fd7f3025a6 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.782645 Aug 27 21:18:29.570351 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3041/5976] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:28 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:30.603109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:30.603955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:30.609712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:30.629735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:30.632558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:30.633546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:30.634557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:30.636759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:30.638672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:31.319597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:31.552053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:31.553542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:31.655170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:31.676742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42a830b7-b9dc-4960-874e-15fe0efbe29c tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 1.080127 Aug 27 21:18:31.680162 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2936/5977] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:30 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:31.798750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-454290183", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "abb2f4a4-027c-4ab8-808c-124af7336f6d"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:31.820324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:31.902903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] validate_networks() for [('abb2f4a4-027c-4ab8-808c-124af7336f6d', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:18:32.451229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:18:32.451952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:18:32.452743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:18:32.453351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:18:32.453921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:18:32.467713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:32.468465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:32.469088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:32.470035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:32.470807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:32.471646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:32.495581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Getting quotas for project ef3fc0ca17b449838567169f7255d9bb. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:18:32.504305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Getting quotas for user 27558be0c1b24951a85525c5bae75935 and project ef3fc0ca17b449838567169f7255d9bb. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:18:32.524215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:18:32.530390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:18:32.640419 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd807519-e6eb-4a6d-9093-4503184d34e7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.101583 Aug 27 21:18:32.648736 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3042/5978] 10.222.0.40 () {62 vars in 1188 bytes} [Sat Aug 27 21:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 21:18:32.656531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:32.658882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:32.698398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:32.699016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:32.723193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:32.723747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:32.731242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:32.732817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:32.733929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:32.734839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:32.736456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:32.747991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:32.749827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:32.751028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e78f0644-aaaa-40ce-beff-1cc0861fe4ad tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1261 microversion: 2.26 time: 0.100187 Aug 27 21:18:32.769281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2937/5979] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:32 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:33.007742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:33.020461 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d551636a-01e2-4b3a-89a4-b2c1aa83f5a3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.325501 Aug 27 21:18:33.021134 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3043/5980] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:32 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:33.776762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:33.777409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:33.792463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:33.795083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:33.795620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:33.796471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:33.800280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:33.802638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:33.945838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:33.972496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:33.975549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:33.977163 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-446a1526-d592-442d-bdde-ef6f99f9bd7d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1257 microversion: 2.26 time: 0.206265 Aug 27 21:18:33.999520 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2938/5981] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:33 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1257 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:34.047599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:34.049929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:34.069460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:34.069959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:34.070374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:34.071097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:34.071585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:34.072048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:34.390721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:34.405777 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd4b995e-05ad-47cc-ac3b-39b455d5c28d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.363082 Aug 27 21:18:34.420941 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3044/5982] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:34 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:35.002342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:35.003737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:35.019002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:35.019785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:35.024194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:35.024970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:35.025444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:35.026057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:35.161855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:35.177464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:35.182477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:35.184119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1f1435c-ba61-4307-bf2c-82b5fb875128 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1319 microversion: 2.26 time: 0.185758 Aug 27 21:18:35.222868 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2939/5983] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:34 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:35.429345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:35.429892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:35.437329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:35.438118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:35.438713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:35.439920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:35.440888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:35.441820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:35.471583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:35.664619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:35.685483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd2ee70c-3789-47ae-a744-d3b6b9c8b620 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.262007 Aug 27 21:18:35.688524 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3045/5984] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:35 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:36.210851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:36.212513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:36.224747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:36.227053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:36.229042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:36.231189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:36.233904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:36.235809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:36.269587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c197098-5003-41e3-9d3c-ab09e9076ed4", "name": "network-vif-plugged", "status": "completed", "tag": "cf631e8a-0cea-4b51-ab22-88ff58b38e7a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:36.292872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:36.293512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:36.293900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:36.330326 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] Creating event network-vif-plugged:cf631e8a-0cea-4b51-ab22-88ff58b38e7a for instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 on nch1-master-1 Aug 27 21:18:36.348586 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-52b803ad-bf60-4a28-8aff-eff6f77e2317 req-4be0baaa-d9ed-4eaa-beb2-9e893363122a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083143 Aug 27 21:18:36.352150 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3046/5985] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:18:36.713523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:36.715738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:36.727395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:36.728850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:36.729773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:36.731790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:36.733434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:36.734345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:37.450506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:37.469278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:37.479001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:37.480846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51ee0899-7a53-4ba7-8fef-3f433c3680b7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 1.274096 Aug 27 21:18:37.482181 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2940/5986] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:36 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:37.584376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:37.596960 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2534b7db-291b-41c0-8014-b60c4f2c7a55 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1428 microversion: 2.1 time: 0.891270 Aug 27 21:18:37.631051 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3047/5987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:36 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1428 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:37.649693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bcff116-1f5e-4c32-8b61-e6fc172933f8", "tag": "2b726795-3895-4aa4-a987-248a326b8d4c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:37.665621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:37.666886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:37.667643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:37.687884 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] Creating event network-changed:2b726795-3895-4aa4-a987-248a326b8d4c for instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 on nch2-master-1 Aug 27 21:18:37.696737 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0f7fd20a-dee5-4bd4-8c16-03b5b1c09a6b req-b5a3b3c4-c5ac-48d6-9256-9729fb684784 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052060 Aug 27 21:18:37.699259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2941/5988] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:38.507870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:38.508477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:38.515692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:38.516223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:38.516671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:38.517388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:38.517836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:38.518438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:38.622857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:38.624514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:38.631977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:38.632734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:38.633337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:38.634202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:38.634819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:38.635502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:39.147613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:39.157464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:39.158939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:39.160519 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4e533501-48e1-48c3-a43c-67c09148f01d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.656775 Aug 27 21:18:39.161409 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3048/5989] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:38 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:39.214256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:39.224217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7958994-9742-409d-9f27-e2053c061196 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1608 microversion: 2.1 time: 0.606587 Aug 27 21:18:39.226124 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2942/5990] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:38 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1608 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:39.250357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:39.251375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:39.258736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:39.259407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:39.262226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:39.264195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:39.264895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:39.265577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:39.641026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:39.694421 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49e9db58-e31d-4fc4-822c-c7937d7a266a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1608 microversion: 2.1 time: 0.447914 Aug 27 21:18:39.695028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3049/5991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:39 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1608 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:39.716340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:39.717119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:39.725222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:39.726091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:39.726765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:39.727831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:39.728558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:39.729738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:40.049442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:40.065846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4fdee37-e209-4d53-b1ef-9832f7d2d00a tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1608 microversion: 2.1 time: 0.353184 Aug 27 21:18:40.067549 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2943/5992] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:18:39 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1608 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:40.186160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:40.189314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:40.197921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:40.198624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:40.199238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:40.200629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:40.201362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:40.202757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:40.536018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:40.545321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:40.546791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:40.548237 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b871a86-7778-41e7-9ee3-962c27cf097a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.366836 Aug 27 21:18:40.566454 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3050/5993] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:40 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:41.573027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:41.573653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:41.585637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:41.586832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:41.589442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:41.590411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:41.591076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:41.593181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:42.081022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:42.113566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:42.116321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:42.120779 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0120bbad-5120-4da8-87a3-44465d824532 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.553236 Aug 27 21:18:42.123434 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2944/5994] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:41 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:43.165264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:43.166377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:43.171570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:43.173468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:43.192008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:43.193294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:43.194704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:43.195634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:43.196276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:43.197052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:43.525745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:43.548285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:43.551943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:43.556124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a842ba3-a12a-4a17-b397-bb6bb32fb600 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.409746 Aug 27 21:18:43.560104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3051/5995] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:43 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:44.588041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:44.588824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:44.594753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:44.611475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:44.616598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:44.617548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:44.618623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:44.619324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:44.620085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:45.020790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:45.025368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c197098-5003-41e3-9d3c-ab09e9076ed4", "tag": "cf631e8a-0cea-4b51-ab22-88ff58b38e7a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:45.041593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:45.044082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:45.044651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:45.045237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:45.045820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:45.046012 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1307410a-12b2-445c-972d-ef1c269a5264 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.463376 Aug 27 21:18:45.046927 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2945/5996] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:44 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:45.077819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcff116-1f5e-4c32-8b61-e6fc172933f8", "name": "network-vif-plugged", "status": "completed", "tag": "2b726795-3895-4aa4-a987-248a326b8d4c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:45.081256 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] Creating event network-changed:cf631e8a-0cea-4b51-ab22-88ff58b38e7a for instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 on nch1-master-1 Aug 27 21:18:45.087494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:45.088388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d4ea3262-5fcd-4a33-aaa1-1198a7ee2dda req-9268135a-9cf2-49e2-b119-bd9e7d874c7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362206 Aug 27 21:18:45.089867 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3052/5997] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:45.096169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:45.096933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:45.097590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:45.119066 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] Creating event network-vif-plugged:2b726795-3895-4aa4-a987-248a326b8d4c for instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 on nch2-master-1 Aug 27 21:18:45.126890 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7c1c21d4-6dc8-44c6-a60d-95d834476dce req-39c2573a-8ab5-4334-9c20-ede44e891e0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060913 Aug 27 21:18:45.129238 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2946/5998] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:46.072077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:46.072816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:46.090518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:46.091011 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:46.091483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:46.092372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:46.093089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:46.093727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:46.372595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:46.387744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:46.389562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:46.390855 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3c37f8f-70ff-4941-844b-2809d392d863 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1361 microversion: 2.26 time: 0.324056 Aug 27 21:18:46.393767 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3053/5999] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:46 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:47.418044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:47.418765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:47.431060 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.431592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.432041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.432756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.433236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.433657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.745372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:47.766263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:47.769551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:47.771813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96395d72-b0fc-41e8-9350-078b87c4fec6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1545 microversion: 2.26 time: 0.358215 Aug 27 21:18:47.776140 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2947/6000] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:47 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1545 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:47.800432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84ed588b0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:47.812220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.812976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.813680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.814382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:47.823833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.824707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.825360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.826294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.827036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.827770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.861838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.862823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.863541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.883391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:47.884337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:47.885118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:47.922329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:47.979225 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-226a441c-ea58-44c6-8146-704970a29238 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-305160866" status: 201 len: 0 microversion: 2.26 time: 0.183429 Aug 27 21:18:47.997706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ffc848a7-a93a-402b-9d51-6411b5bdd990 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84e00ee50>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.002714 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3054/6001] 10.222.0.40 () {62 vars in 1377 bytes} [Sat Aug 27 21:18:47 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-305160866 => generated 0 bytes in 207 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 21:18:48.013469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ffc848a7-a93a-402b-9d51-6411b5bdd990 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.015564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ffc848a7-a93a-402b-9d51-6411b5bdd990 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.018204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ffc848a7-a93a-402b-9d51-6411b5bdd990 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.069503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ffc848a7-a93a-402b-9d51-6411b5bdd990 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-305160866" status: 204 len: 0 microversion: 2.26 time: 0.082551 Aug 27 21:18:48.070054 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2948/6002] 10.222.0.40 () {60 vars in 1358 bytes} [Sat Aug 27 21:18:47 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-305160866 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:18:48.081824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84f84f940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.093498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.094694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.095600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.096274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:48.103904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.104976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.105766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.107019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.107547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.109114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.141718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.142451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.143067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.167297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:48.190615 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f778b77-acf8-40e2-b67c-cab456b8b915 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.112823 Aug 27 21:18:48.192429 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3055/6003] 10.222.0.40 () {60 vars in 1295 bytes} [Sat Aug 27 21:18:48 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:18:48.204875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-54a1e6ce-4687-4d8d-864e-dbc93448f97a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84e00ed30>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.214900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54a1e6ce-4687-4d8d-864e-dbc93448f97a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.215456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54a1e6ce-4687-4d8d-864e-dbc93448f97a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.215913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54a1e6ce-4687-4d8d-864e-dbc93448f97a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.227585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-54a1e6ce-4687-4d8d-864e-dbc93448f97a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.028047 Aug 27 21:18:48.228777 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2949/6004] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 21:18:48 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:18:48.240346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84edc0f70>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.253198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.254406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.255531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.256458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:48.264835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.265987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.266723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.268274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.269412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.270674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.325709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.326220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.326951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.338741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.339471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.340276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.376820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:48.410328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c812ba89-1cb3-4dd4-9c65-f2edaee1ece4 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1763202581" status: 201 len: 0 microversion: 2.26 time: 0.174653 Aug 27 21:18:48.411486 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3056/6005] 10.222.0.40 () {62 vars in 1380 bytes} [Sat Aug 27 21:18:48 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1763202581 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 21:18:48.421255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4b56d1b2-0a31-4fc5-8f1e-a8dbfe541249 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84e008670>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.431739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b56d1b2-0a31-4fc5-8f1e-a8dbfe541249 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.432563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b56d1b2-0a31-4fc5-8f1e-a8dbfe541249 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.433219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4b56d1b2-0a31-4fc5-8f1e-a8dbfe541249 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.443836 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4b56d1b2-0a31-4fc5-8f1e-a8dbfe541249 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 36 microversion: 2.26 time: 0.026563 Aug 27 21:18:48.450776 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2950/6006] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 21:18:48 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 36 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:48.456349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84ec739d0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.469619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.470418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.471006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.471685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:48.478549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.479287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.479996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.481025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.481646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.482228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.523445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.523950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.524398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.574174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:48.580308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:48.597288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c414ce7-ad5a-4274-a52e-d4e343ff703c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1763202581" status: 204 len: 0 microversion: 2.26 time: 0.144778 Aug 27 21:18:48.598448 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3057/6007] 10.222.0.40 () {60 vars in 1364 bytes} [Sat Aug 27 21:18:48 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1763202581 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:18:48.606983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ead0068b-57d7-437c-a5b9-e50772fffe6d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dff8a60>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.614964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ead0068b-57d7-437c-a5b9-e50772fffe6d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.615755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ead0068b-57d7-437c-a5b9-e50772fffe6d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.616376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ead0068b-57d7-437c-a5b9-e50772fffe6d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.626758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ead0068b-57d7-437c-a5b9-e50772fffe6d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.023783 Aug 27 21:18:48.629964 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2951/6008] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 21:18:48 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 12 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:48.640102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84ecaedc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.650306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.650795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.651266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.655950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:48.666021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.667040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.667945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.668898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.669677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.670316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.701173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.701677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.703317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.720675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:48.739679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06ac2e61-49d0-4b47-b761-d2a9443c0db1 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.104067 Aug 27 21:18:48.743383 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3058/6009] 10.222.0.40 () {60 vars in 1295 bytes} [Sat Aug 27 21:18:48 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:18:48.751800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84e00edc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:48.762333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.763075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.763812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.764483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:48.771668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.773201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.773978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.774897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.775669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.776332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.809106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.810476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.811197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.822016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:48.822844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:48.824137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:48.864466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:48.889595 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:18:49.900856 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 45108. Aug 27 21:18:49.909560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59c941f3-1ea6-4e68-a9dc-ed8325c7ea8a tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-848274710" status: 201 len: 0 microversion: 2.26 time: 1.161724 Aug 27 21:18:49.910771 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2952/6010] 10.222.0.40 () {62 vars in 1377 bytes} [Sat Aug 27 21:18:48 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-848274710 => generated 0 bytes in 1165 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 21:18:49.922424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84f84f790>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:49.934097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:49.934580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:49.935017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:49.935524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:49.942981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:49.943737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:49.944385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:49.945103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:49.945558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:49.945981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:49.976068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:49.976860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:49.977443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:49.989081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:49.990033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:49.990530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.028706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.048797 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a2aaea4-dd78-4958-9e1f-8c02191df895 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-436371951" status: 201 len: 0 microversion: 2.26 time: 0.132342 Aug 27 21:18:50.050306 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3059/6011] 10.222.0.40 () {62 vars in 1377 bytes} [Sat Aug 27 21:18:49 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-436371951 => generated 0 bytes in 135 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 21:18:50.062669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dfcb3a0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.072865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.073728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.074509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.075262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.082426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.083217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.084232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.085366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.086899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.087716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.128334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.129162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.129750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.160204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.186905 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36327275-c31d-41e0-b022-7c1a521f22f7 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.129488 Aug 27 21:18:50.187668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2953/6012] 10.222.0.40 () {60 vars in 1295 bytes} [Sat Aug 27 21:18:50 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:18:50.199956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b40d76ab-ab60-41e9-8919-2c903bcfe8d6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dcc9af0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.215199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b40d76ab-ab60-41e9-8919-2c903bcfe8d6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.216013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b40d76ab-ab60-41e9-8919-2c903bcfe8d6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.217201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b40d76ab-ab60-41e9-8919-2c903bcfe8d6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.234511 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b40d76ab-ab60-41e9-8919-2c903bcfe8d6 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.042110 Aug 27 21:18:50.235769 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3060/6013] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 21:18:50 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:50.247277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dff8c10>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.256714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.257195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.258760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.259253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.265495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.266185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.266781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.267504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.268130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.268821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.296623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.297364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.297974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.306767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:18:50.311657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.358415 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef46b3e1-00b9-4f00-9eb4-b825cb214fff tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.115730 Aug 27 21:18:50.361086 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2954/6014] 10.222.0.40 () {60 vars in 1295 bytes} [Sat Aug 27 21:18:50 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:18:50.372258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84ed585e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.384463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.385191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.385435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.385888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.416530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.417116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.417628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.418415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.420018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.420524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.452269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.452775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.453474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.463943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.464670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.465175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.491994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.512276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c56bebd-e01e-4878-bf76-c26cca49f831 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-812207929" status: 201 len: 0 microversion: 2.26 time: 0.145011 Aug 27 21:18:50.513355 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3061/6015] 10.222.0.40 () {62 vars in 1377 bytes} [Sat Aug 27 21:18:50 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-812207929 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 21:18:50.524306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dfcb430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.538133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.538724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.539235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.539803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.548255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.548858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.549482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.550757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.551505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.552120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.588367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.589169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.589836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.601635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.603102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.603892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.637943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.661098 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3d19d8c7-329b-4f08-a380-637dab792072 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1202114521" status: 201 len: 0 microversion: 2.26 time: 0.142040 Aug 27 21:18:50.663236 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2955/6016] 10.222.0.40 () {62 vars in 1380 bytes} [Sat Aug 27 21:18:50 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags/tempest-tag-1202114521 => generated 0 bytes in 145 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 27 21:18:50.680990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Action: 'update_all', calling method: .version_select at 0x7ff84ee6a820>, body: {"tags": ["tempest-tag-1434447694", "tempest-tag-1151813847"]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:50.719528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.721919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.723025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.723736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.738896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.740087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.740951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.742437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.743008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.743581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.778898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.778898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.779826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.809799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:50.832861 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b9404bc8-41c7-46b0-9ed3-9827ab5aaa7c tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 62 microversion: 2.26 time: 0.163724 Aug 27 21:18:50.835084 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3062/6017] 10.222.0.40 () {62 vars in 1312 bytes} [Sat Aug 27 21:18:50 2022] PUT /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 62 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:50.845918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8b149cf-067a-4895-b062-9c885f8178a5 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84dff8ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.868864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b149cf-067a-4895-b062-9c885f8178a5 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.892825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b149cf-067a-4895-b062-9c885f8178a5 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.894092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8b149cf-067a-4895-b062-9c885f8178a5 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.908197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8b149cf-067a-4895-b062-9c885f8178a5 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 200 len: 62 microversion: 2.26 time: 0.067041 Aug 27 21:18:50.911496 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2956/6018] 10.222.0.40 () {60 vars in 1292 bytes} [Sat Aug 27 21:18:50 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 62 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:18:50.921889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '.version_select at 0x7ff84edc05e0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:50.937491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.938218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.939281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.943002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:50.955610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.956627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.957984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:50.959796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:50.961941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:50.963797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.011806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:51.012391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:51.017539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.035628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'flavor' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:51.053262 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac231061-df79-4536-b1cb-7ad3822a3201 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.135675 Aug 27 21:18:51.054329 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3063/6019] 10.222.0.40 () {60 vars in 1295 bytes} [Sat Aug 27 21:18:50 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8/tags => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:18:51.066092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:51.066853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:51.074429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:51.075505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:51.076976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.078032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:51.078961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:51.080382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.124558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:18:51.270551 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a24cadef-2c80-4c3f-929e-31d7259d00f8 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 204 len: 0 microversion: 2.26 time: 0.210297 Aug 27 21:18:51.272487 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2957/6020] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:18:51 2022] DELETE /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:18:51.285267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:51.286177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:51.295292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:51.296076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:51.321236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.322041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:51.322922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:51.323680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:51.560374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:51.572131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:51.574697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:51.578407 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c01609d5-552b-45ad-8efb-97f5a1b83c22 tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1551 microversion: 2.26 time: 0.301266 Aug 27 21:18:51.580311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3064/6021] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:51 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1551 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:52.608187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:52.609703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:52.618963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:52.619744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:52.620180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:52.621084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:52.621707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:52.622281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:53.191904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:53.201207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:53.202790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:53.204532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce97d7e6-10c3-4e98-9b8a-d2fe5cb0f48e tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1551 microversion: 2.26 time: 0.601529 Aug 27 21:18:53.205138 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2958/6022] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:52 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1551 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:53.839875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcff116-1f5e-4c32-8b61-e6fc172933f8", "name": "network-vif-deleted", "tag": "2b726795-3895-4aa4-a987-248a326b8d4c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:18:53.874078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:53.874978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:53.875694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:53.922903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] Creating event network-vif-deleted:2b726795-3895-4aa4-a987-248a326b8d4c for instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 on nch2-master-1 Aug 27 21:18:53.936047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3112f210-0dcf-42d5-82a6-203fcbcf6aa8 req-feacef09-3c89-4881-a0da-69d91e737b0a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108854 Aug 27 21:18:53.937674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3065/6023] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:18:54.231239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:54.232340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:54.240521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:54.241055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:54.241631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:54.242704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:54.243276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:54.243858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:54.283370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:54.284109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:54.284931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:54.285668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lazy-loading 'fault' on Instance uuid 5bcff116-1f5e-4c32-8b61-e6fc172933f8 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:18:54.363302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:54.378452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:54.382130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27558be0c1b24951a85525c5bae75935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef3fc0ca17b449838567169f7255d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:18:54.385337 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-65846b39-21d6-4122-937a-c0dede47e20d tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 200 len: 1351 microversion: 2.26 time: 0.158990 Aug 27 21:18:54.402114 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2959/6024] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:54 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 1351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:18:55.413557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:18:55.414744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] [instance: 5bcff116-1f5e-4c32-8b61-e6fc172933f8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:18:55.422532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:55.423264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:55.423828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:55.424850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:18:55.425580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:18:55.426220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:18:55.443312 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] HTTP exception thrown: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Request method failure captured: Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 HTTP/1.1 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCoonX_XSbIRhHwlw_E_P9GZsw-7vxyFkR5Zbo6QXvfJ2-ubbs0PJyj1zz6IHVcRn6J_UFR_-JBu6OdUpKgM76KLJKADj9DasqupU4LLiLooNd4hb1pF3eFONKuwgcrrI5FEnEQDtn4TW35AR3ccuOOUhkvlil6ZCXoCKktBWQKELJjM Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: ef3fc0ca17b449838567169f7255d9bb Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerTagsTestJSON-2019992246 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef3fc0ca17b449838567169f7255d9bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ef3fc0ca17b449838567169f7255d9bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ef3fc0ca17b449838567169f7255d9bb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ef3fc0ca17b449838567169f7255d9bb"}]}] Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerTagsTestJSON-2019992246 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: ef3fc0ca17b449838567169f7255d9bb Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerTagsTestJSON-2019992246 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerTagsTestJSON-2019992246-project Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 27558be0c1b24951a85525c5bae75935 Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerTagsTestJSON-2019992246-project Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '5bcff116-1f5e-4c32-8b61-e6fc172933f8'} Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:18:55.446418 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] Returning 404 to user: Instance 5bcff116-1f5e-4c32-8b61-e6fc172933f8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2554d50-d40b-4ef6-8180-74cdd6c76cdf tempest-ServerTagsTestJSON-2019992246 tempest-ServerTagsTestJSON-2019992246-project] 10.222.0.40 "GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8" status: 404 len: 111 microversion: 2.26 time: 0.041198 Aug 27 21:18:55.450466 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3066/6025] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:18:55 2022] GET /compute/v2.1/servers/5bcff116-1f5e-4c32-8b61-e6fc172933f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:04.564247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:04.565792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=47,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:04.727230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e206ead8-84c6-4e33-96b3-cc48287c5644 tempest-ComputeTenantNetworksTest-39223141 tempest-ComputeTenantNetworksTest-39223141-project] Calling method '.version_select at 0x7ff84ea8d0d0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:04.965346 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e206ead8-84c6-4e33-96b3-cc48287c5644 tempest-ComputeTenantNetworksTest-39223141 tempest-ComputeTenantNetworksTest-39223141-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.406682 Aug 27 21:19:04.966142 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2960/6026] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 21:19:04 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:04.977775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5959acc9-999e-4bc2-916f-299684f2b2c3 tempest-ComputeTenantNetworksTest-39223141 tempest-ComputeTenantNetworksTest-39223141-project] Calling method '.version_select at 0x7ff84ee6ab80>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:05.134069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5959acc9-999e-4bc2-916f-299684f2b2c3 tempest-ComputeTenantNetworksTest-39223141 tempest-ComputeTenantNetworksTest-39223141-project] 10.222.0.40 "GET /compute/v2.1/os-tenant-networks/a97017ad-8ac7-4ba6-b8cf-dcbcf74a9624" status: 200 len: 140 microversion: 2.1 time: 0.160088 Aug 27 21:19:05.142336 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3067/6027] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:19:04 2022] GET /compute/v2.1/os-tenant-networks/a97017ad-8ac7-4ba6-b8cf-dcbcf74a9624 => generated 140 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:21.483079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:21.486213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:21.500257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.501219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.502716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:21.504072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.505398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.506152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:21.546652 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8331b7af-9ae3-452a-b78f-9d74854a6f65 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070339 Aug 27 21:19:21.547769 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2961/6028] 10.222.0.40 () {60 vars in 1343 bytes} [Sat Aug 27 21:19:21 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:19:21.643768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:21.644567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=67,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:21.651626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:21.652595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:21.661798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.662296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.662738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:21.663465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.664103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.664677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:21.740819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:19:21.910794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d953248d-92ec-48c9-93a4-0dd99ecef545 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 204 len: 0 microversion: 2.20 time: 0.267489 Aug 27 21:19:21.911888 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3068/6029] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:19:21 2022] DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 21:19:21.924108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:21.925518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:21.934926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.935788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.936744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:21.937603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:21.938050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:21.938628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:22.614840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:22.650692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:22.653203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:22.654638 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-660c0732-00e0-40ab-b4f3-4117b74f91cf tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.738358 Aug 27 21:19:22.655413 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2962/6030] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:21 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:19:23.681497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:23.682220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:23.702897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:23.703883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:23.707647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:23.708428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:23.708916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:23.711477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:24.282002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:24.292484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:24.294212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:24.295843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d9828f1-13c8-4204-89b8-132c2e567511 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1722 microversion: 2.20 time: 0.620276 Aug 27 21:19:24.296701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3069/6031] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:23 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1722 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:19:25.174248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f610c2-8a16-43c6-b44d-3379a8593cf3", "name": "network-vif-deleted", "tag": "2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:19:25.191628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:25.192405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:25.192987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:25.218714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] Creating event network-vif-deleted:2707b677-c0d8-4f71-9ee8-ab69d4cf4c8b for instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 on nch2-master-1 Aug 27 21:19:25.224717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1961ac89-1bd5-439d-af56-208167f54cdf req-cc92fd6a-5b8c-4e0f-b9ca-d5f837ead4fc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054221 Aug 27 21:19:25.229518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2963/6032] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:25.322402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:25.323093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:25.333023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:25.333522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:25.333964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:25.334676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:25.335127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:25.335584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:25.645427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:25.664294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:25.666478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ed5b662d08e405395b930a185b78d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fcf33563bb4c08852f48ad3cb2eed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:19:25.667889 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1987fa25-190f-4ebe-8f38-b196bb443662 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 200 len: 1366 microversion: 2.20 time: 0.349491 Aug 27 21:19:25.679482 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3070/6033] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:25 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 21:19:26.700775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:26.702132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:26.725553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:26.727771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:26.730239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:26.732147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:26.732638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:26.733085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:26.770872 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 HTTP/1.1 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '77f610c2-8a16-43c6-b44d-3379a8593cf3'} Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:26.776718 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:26.780914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aaba414f-3de0-4beb-8999-88f96331f167 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 404 len: 111 microversion: 2.20 time: 0.087858 Aug 27 21:19:26.789829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e7d6026b-54e1-486d-a0f3-76093bcd37e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '.version_select at 0x7ff84f277670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:26.797309 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2964/6034] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:26 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:26.821357 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e7d6026b-54e1-486d-a0f3-76093bcd37e7 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170891779" status: 204 len: 0 microversion: 2.20 time: 0.035659 Aug 27 21:19:26.822385 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3071/6035] 10.222.0.40 () {60 vars in 1262 bytes} [Sat Aug 27 21:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170891779 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 21:19:29.072449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:29.073229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:29.088186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:29.088687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:29.089131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:29.089844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:29.090301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:29.090727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:29.120719 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 HTTP/1.1 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '77f610c2-8a16-43c6-b44d-3379a8593cf3'} Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:19:29.126026 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.132736 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.139794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:29.143698 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99fd53e5-09c8-45e9-91ac-2adcfceac646 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 404 len: 111 microversion: 2.20 time: 0.076244 Aug 27 21:19:29.144723 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2965/6036] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:19:29 2022] DELETE /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:29.153660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:29.154962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: 77f610c2-8a16-43c6-b44d-3379a8593cf3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:29.164538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:29.165040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:29.165463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:29.166326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:29.166758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:29.167406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:29.184336 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 HTTP/1.1 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '77f610c2-8a16-43c6-b44d-3379a8593cf3'} Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.186363 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance 77f610c2-8a16-43c6-b44d-3379a8593cf3 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9338465-aeb0-48e6-ad70-83d9226fb84e tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3" status: 404 len: 111 microversion: 2.20 time: 0.038473 Aug 27 21:19:29.192007 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3072/6037] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:29 2022] GET /compute/v2.1/servers/77f610c2-8a16-43c6-b44d-3379a8593cf3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:30.492410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:30.492936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:30.500739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:30.501479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:30.502242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:30.503156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:30.503802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:30.504407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:30.523549 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 HTTP/1.1 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'eafef7f1-0bed-4a72-8ab4-2bec00006e79'} Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:19:30.529850 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.534420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:30.535270 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9992598c-f2f0-4c5f-9eef-97a623ef702d tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 404 len: 111 microversion: 2.20 time: 0.047387 Aug 27 21:19:30.539231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2966/6038] 10.222.0.40 () {60 vars in 1280 bytes} [Sat Aug 27 21:19:30 2022] DELETE /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:30.548297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:30.551750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] [instance: eafef7f1-0bed-4a72-8ab4-2bec00006e79] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:30.579003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:30.579003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:30.579003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:30.581313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:30.581878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:30.583452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:30.622470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] HTTP exception thrown: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Request method failure captured: Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 HTTP/1.1 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCohunE2_RJAkIbkStlkQYa1iTZC60YFYkuFfTaF0ttxkP6rkEc8PJK6HiGCZLETwdo0Syug_51OYAIOV5l0LvEiCQdaZLNBFgndyEB--NjKt-qGQSGwbp-Iea5OrK8jXd2zlgvfDM6Y8JBnfQJwXahnw7oPhJjrLzbBstPjfbt2-tlQ Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/12fcf33563bb4c08852f48ad3cb2eed3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_12fcf33563bb4c08852f48ad3cb2eed3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/12fcf33563bb4c08852f48ad3cb2eed3"}]}] Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 12fcf33563bb4c08852f48ad3cb2eed3 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1808861972 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 3ed5b662d08e405395b930a185b78d47 Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1808861972-project Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'eafef7f1-0bed-4a72-8ab4-2bec00006e79'} Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.625311 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. Aug 27 21:19:30.629271 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:19:30.635568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] Returning 404 to user: Instance eafef7f1-0bed-4a72-8ab4-2bec00006e79 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:30.636651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b91cef4f-e7fd-4346-b017-3c8aeef37173 tempest-AttachVolumeShelveTestJSON-1808861972 tempest-AttachVolumeShelveTestJSON-1808861972-project] 10.222.0.40 "GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79" status: 404 len: 111 microversion: 2.20 time: 0.093939 Aug 27 21:19:30.643600 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3073/6039] 10.222.0.40 () {60 vars in 1277 bytes} [Sat Aug 27 21:19:30 2022] GET /compute/v2.1/servers/eafef7f1-0bed-4a72-8ab4-2bec00006e79 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:19:40.982795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:40.984822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=20 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:41.327189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Action: 'create', calling method: .version_select at 0x7ff84dfcbee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2042054670", "metadata": {"Type": "work"}}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:19:42.168174 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.200854 Aug 27 21:19:42.168721 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2967/6040] 10.222.0.40 () {60 vars in 1156 bytes} [Sat Aug 27 21:19:40 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1203 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 27 21:19:42.182192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1918080-65a9-44b8-94de-bccf234f00b9 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff84ee6a820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:42.191306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:42.198788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:19:42.294171 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1918080-65a9-44b8-94de-bccf234f00b9 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 200 len: 346 microversion: 2.1 time: 0.115503 Aug 27 21:19:42.295230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3074/6041] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:19:42 2022] GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:43.308725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c195111-2228-49fb-bf11-bb59ff4421b0 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff84dff8dc0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:43.367714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c195111-2228-49fb-bf11-bb59ff4421b0 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 200 len: 347 microversion: 2.1 time: 0.062864 Aug 27 21:19:43.368332 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2968/6042] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:19:43 2022] GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 347 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:43.381919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cbbfa632-4696-4183-9876-fc612a36aaf1 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff84ef3b280>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:43.483118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cbbfa632-4696-4183-9876-fc612a36aaf1 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 200 len: 347 microversion: 2.1 time: 0.105455 Aug 27 21:19:43.483932 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3075/6043] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:19:43 2022] GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 347 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:43.505969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff857c68820>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:43.635961 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 202 len: 0 microversion: 2.1 time: 0.135788 Aug 27 21:19:43.647367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-60c9c4ee-86f3-49bd-b6e1-7550bd7c7828 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff84ef3b820>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:43.647917 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2969/6044] 10.222.0.40 () {58 vars in 1248 bytes} [Sat Aug 27 21:19:43 2022] DELETE /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:19:43.751919 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-60c9c4ee-86f3-49bd-b6e1-7550bd7c7828 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 200 len: 346 microversion: 2.1 time: 0.109246 Aug 27 21:19:43.752524 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3076/6045] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:19:43 2022] GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:19:44.769315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96431637-e6a1-42ac-8450-16e43b667a68 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Calling method '.version_select at 0x7ff84df5b8b0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:44.803599 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-96431637-e6a1-42ac-8450-16e43b667a68 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] HTTP exception thrown: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96431637-e6a1-42ac-8450-16e43b667a68 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Request method failure captured: Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f HTTP/1.1 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCopslj1JuaLKTMpnZ0Ufr6Y8UHqXX3CKNFI_1f6DeNbUH-SJY0tiQMktr5NToqX8Rzel4b5l8K7S5XM9iS8a-c5R7XNyEPMZvZc0dEXE01Ao686hKn9D2tYqlmmzZzgujVf4DHbeleRfhO6EArCcstibJirwWyPa0lp3fWzUGZMpW5M Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 204c7f096bc64648a5574ebc8300eefd Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesGetTestJSON-678210298 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/204c7f096bc64648a5574ebc8300eefd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/204c7f096bc64648a5574ebc8300eefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_204c7f096bc64648a5574ebc8300eefd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/204c7f096bc64648a5574ebc8300eefd"}]}] Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesGetTestJSON-678210298 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 204c7f096bc64648a5574ebc8300eefd Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesGetTestJSON-678210298 Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesGetTestJSON-678210298-project Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: d52ee9a957404692a393e9f491dacf9d Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesGetTestJSON-678210298-project Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: method: Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: exception: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '570320b7-b528-486a-8248-c9d3f5211c7f'} Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. (HTTP 404) (Request-ID: req-91818f1d-b554-4d4e-b3a1-73f22b819b50) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 21:19:44.806831 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96431637-e6a1-42ac-8450-16e43b667a68 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] Returning 404 to user: Volume 570320b7-b528-486a-8248-c9d3f5211c7f could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:19:44.810772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96431637-e6a1-42ac-8450-16e43b667a68 tempest-VolumesGetTestJSON-678210298 tempest-VolumesGetTestJSON-678210298-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f" status: 404 len: 109 microversion: 2.1 time: 0.047436 Aug 27 21:19:44.815887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2970/6046] 10.222.0.40 () {58 vars in 1245 bytes} [Sat Aug 27 21:19:44 2022] GET /compute/v2.1/os-volumes/570320b7-b528-486a-8248-c9d3f5211c7f => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:19:48.565887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:19:48.566368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:19:48.578593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:48.580031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:48.581498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:48.582428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:19:48.583986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:19:48.584550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:19:48.629800 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f192ede7-148b-4e2d-8109-eb9df19948f3 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.068700 Aug 27 21:19:48.630806 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3077/6047] 10.222.0.40 () {58 vars in 1293 bytes} [Sat Aug 27 21:19:48 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4/os-server-password => generated 116 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:20:02.529434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Calling method '.version_select at 0x7ff84dfcb040>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:02.534677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:02.534677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:02.541175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:02.566084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:02.566867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:02.567561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:02.589110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:02.590161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:02.590873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:02.600373 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ceff1f2-caed-4b88-a159-21de14a0ca67 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554 tempest-PortsAdminExtendedAttrsIpV6TestJSON-788932554-project-admin] 10.222.0.40 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.823565 Aug 27 21:20:02.609405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2971/6048] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:20:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:20:12.734057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-509117819", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "cb5630dd-c0b5-401f-8ae0-ed4984796178"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:20:12.761289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:12.768725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:12.853669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] validate_networks() for [('cb5630dd-c0b5-401f-8ae0-ed4984796178', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:20:13.475004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:20:13.475462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:20:13.475992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:20:13.476345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:20:13.477892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:20:13.505733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:13.508969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:13.509639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:13.512621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:13.514863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:13.515576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:13.565607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Getting quotas for project c4b1b49ecb334270a40234aa2e1a16ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:20:13.582579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Getting quotas for user 9f8c78c1134e4202b1e571b37d84b6ca and project c4b1b49ecb334270a40234aa2e1a16ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:20:13.616002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:20:13.618824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:20:13.712390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c596016-793a-46e9-9671-1ed98082316e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982296 Aug 27 21:20:13.713593 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3078/6049] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:20:13.725831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e01aaae8-fa1f-4007-8df2-d6c8949ee92a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:13.726687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e01aaae8-fa1f-4007-8df2-d6c8949ee92a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:13.736614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:13.741021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:13.915178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e01aaae8-fa1f-4007-8df2-d6c8949ee92a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:13.929555 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e01aaae8-fa1f-4007-8df2-d6c8949ee92a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1218 microversion: 2.1 time: 0.207810 Aug 27 21:20:13.930340 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2972/6050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:13 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:14.951694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9660c61c-699d-4112-9678-ab81a2570775 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:14.952378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9660c61c-699d-4112-9678-ab81a2570775 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:15.107992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9660c61c-699d-4112-9678-ab81a2570775 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:15.117383 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9660c61c-699d-4112-9678-ab81a2570775 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1218 microversion: 2.1 time: 0.169778 Aug 27 21:20:15.120820 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3079/6051] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:14 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:20:16.139456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:16.140719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:16.151286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:16.155389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:16.156444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:16.159334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:16.162452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:16.163313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:16.307660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:16.328624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cb08f6f-4d59-41f1-b1c4-a1f0c8e177d4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1278 microversion: 2.1 time: 0.190960 Aug 27 21:20:16.330780 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2973/6052] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:16 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:17.352892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:17.353451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:17.372683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:17.373386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:17.374286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:17.377143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:17.377629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:17.378318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:17.486841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:17.499891 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfbc55c4-3142-406c-9c2c-1f8f5d8800e7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1276 microversion: 2.1 time: 0.149488 Aug 27 21:20:17.518038 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3080/6053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:17 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:18.523681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:18.524314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:18.539762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:18.540252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:18.544042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:18.546195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:18.546860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:18.548272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:18.906017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:18.915570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-107c4750-c2ce-4546-96c9-643e15557f84 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.396610 Aug 27 21:20:18.931531 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2974/6054] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:18 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:19.942613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:19.943288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:19.961075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:19.963230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:19.963831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:19.964571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:19.965034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:19.965462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:19.989735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "363c79bb-62fb-4375-ae24-35c5166fd70a", "tag": "5b930221-960d-41d9-8697-0d129c42b2c2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:20:20.013057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:20.023172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:20.029689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:20.065142 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] Creating event network-changed:5b930221-960d-41d9-8697-0d129c42b2c2 for instance 363c79bb-62fb-4375-ae24-35c5166fd70a on nch2-master-1 Aug 27 21:20:20.082910 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e907a083-b76e-437a-b3aa-16b88bed0abd req-53a906a5-0327-4dfa-b3c7-d806c18dc79a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483596 Aug 27 21:20:20.083962 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3081/6055] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:20:20.847986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:20.857729 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0b937014-ca49-436f-ae98-de8dab7e775a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.922842 Aug 27 21:20:20.858324 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2975/6056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:19 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:21.885295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:21.888829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:21.903579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:21.908253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:21.908951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:21.909914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:21.912299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:21.913040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:22.255792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:22.271277 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-325319be-dd90-463c-80f1-0a10ef0c6209 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.396205 Aug 27 21:20:22.272412 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3082/6057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:21 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:23.297019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:23.301007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:23.313799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:23.315100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:23.315810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:23.317406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:23.318126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:23.318807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:23.643025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:23.659998 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d120213-483c-41f7-b61b-1d63fd1d27e0 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.364755 Aug 27 21:20:23.661328 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2976/6058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:23 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:24.684614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:24.686529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:24.690717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:24.699027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:24.699571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:24.702371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:24.705933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:24.706656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:24.712853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:25.102952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:25.115479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2f08c494-be49-4566-9151-9722574e22db tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.433300 Aug 27 21:20:25.116685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3083/6059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:24 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:26.142265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:26.143807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:26.154431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:26.158772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:26.159796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:26.160547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:26.161707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:26.162424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:26.163090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:26.375300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:26.396557 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f420acfe-2861-47c9-bcf5-7573be1fbdee tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.262143 Aug 27 21:20:26.402812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2977/6060] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:26 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:27.423354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:27.424809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:27.430987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:20:27.433813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:27.434288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:27.434724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:27.435633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:27.436084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:27.436689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:27.703296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:27.714301 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-985b8991-8a48-4be7-896f-e1850b9ea463 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.295163 Aug 27 21:20:27.714846 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3084/6061] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:27 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:28.740203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:28.741761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:28.751376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:28.752226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:28.753075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:28.754013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:28.754682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:28.755359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:29.236874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:29.247997 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9710aea7-82e7-4c57-be2b-4efd11749ed4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.512953 Aug 27 21:20:29.250270 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2978/6062] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:28 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:29.648306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363c79bb-62fb-4375-ae24-35c5166fd70a", "name": "network-vif-plugged", "status": "completed", "tag": "5b930221-960d-41d9-8697-0d129c42b2c2"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:20:29.660347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:29.661162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:29.661787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:29.675448 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] Creating event network-vif-plugged:5b930221-960d-41d9-8697-0d129c42b2c2 for instance 363c79bb-62fb-4375-ae24-35c5166fd70a on nch2-master-1 Aug 27 21:20:29.682651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-817928ba-f5ab-4f95-a08a-ef363e0f4eec req-db35c15e-76ac-4692-8566-ab4a8d8c0a23 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259886 Aug 27 21:20:29.683623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3085/6063] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:20:30.286437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:30.287196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:30.324895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:30.325430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:30.325887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:30.337310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:30.337823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:30.338276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:31.094727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:31.128486 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-35f3cb0d-9f15-4deb-8581-1074b71c9a1b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1318 microversion: 2.1 time: 0.850211 Aug 27 21:20:31.131518 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2979/6064] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:30 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:32.155661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:20:32.156565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:32.178195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:32.179061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:32.179690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:32.180646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:32.182770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:32.184764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:32.568970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:20:32.584598 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e4e590e-9d89-4e8b-af0c-f80d411c1203 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1506 microversion: 2.1 time: 0.435223 Aug 27 21:20:32.590253 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3086/6065] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:20:32 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:20:35.671371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3805c1d-d467-4a3e-9b08-bf8f6b1f350a", "device": "/dev/sdb"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:20:35.674238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:20:35.684442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:35.685331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:35.686068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:35.687053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:20:35.688891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:20:35.689852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:20:36.293194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d86a3e21-1152-475e-b7e9-e1da4e898572 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "POST /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621787 Aug 27 21:20:36.295252 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2980/6066] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:20:35 2022] POST /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:21:37.058210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:37.059548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=36 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:37.319918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9226bb12-fcab-4314-8f6b-9339279ff1ed tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Action: 'create', calling method: .version_select at 0x7ff84ee8cdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-887459505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGsu89shZiQUunBIS3ht/bGojrdHnaMC3/bXqb8f0Q8m7xE2ZyrGVAu7jNcby5DBOEvcbAqKAXthCouRKMBWlHr8phKXqECAsPUYb4rGH8vv/RxUG80Ruek6j+ZSrdMag=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:21:37.353044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-9226bb12-fcab-4314-8f6b-9339279ff1ed tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for project 8871159ebe10493da1f399f35af1551d. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:21:37.359540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-9226bb12-fcab-4314-8f6b-9339279ff1ed tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for user 06b8f5ffc3f34f0bb499e7915dab4a80 and project 8871159ebe10493da1f399f35af1551d. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:21:37.399505 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9226bb12-fcab-4314-8f6b-9339279ff1ed tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.343407 Aug 27 21:21:37.400886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3087/6067] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:21:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:21:52.646794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=20 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:52.652631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:52.654157 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:21:52.654654 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 27 21:21:52.656266 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:21:52.656603 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 27 21:21:52.661825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-368624320-access_point-1602291952", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "0b39f8ee-517f-41a2-9301-4753ee670a19"}], "key_name": "tempest-TestSecurityGroupsBasicOps-887459505", "security_groups": [{"name": "tempest-secgroup_access--100540976"}, {"name": "tempest-secgroup_general--80562209"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:21:53.075240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] validate_networks() for [('0b39f8ee-517f-41a2-9301-4753ee670a19', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:21:54.975571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:21:54.976084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:21:54.976712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:21:54.977122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:21:54.977535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:21:54.993268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:54.993982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:54.994575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:54.995489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:54.996118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:54.996865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:55.020092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for project 8871159ebe10493da1f399f35af1551d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:21:55.029937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for user 06b8f5ffc3f34f0bb499e7915dab4a80 and project 8871159ebe10493da1f399f35af1551d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:21:55.047106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:21:55.050063 ncdv-master-1 devstack@n-api.service[140433]: WARNING nova.utils [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-368624320-access_point-1602291952 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-368624320-acc Aug 27 21:21:55.051161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:21:55.154095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66c41267-100c-488d-b9dd-73b4e516df14 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 2.509247 Aug 27 21:21:55.155325 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2981/6068] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:21:52 2022] POST /compute/v2.1/servers => generated 455 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:21:55.167076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9a68d5a-cef7-4093-948e-fb879a745b3f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:21:55.168099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9a68d5a-cef7-4093-948e-fb879a745b3f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:21:55.171823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:55.174595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:21:55.448076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c9a68d5a-cef7-4093-948e-fb879a745b3f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:21:55.471094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9a68d5a-cef7-4093-948e-fb879a745b3f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1293 microversion: 2.1 time: 0.306391 Aug 27 21:21:55.471810 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3088/6069] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:21:55 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1293 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:21:56.493982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:21:56.494773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:21:56.516422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:56.517437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:56.518013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:56.519647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:56.519647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:56.523247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:56.725912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:21:56.742369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50e0f70b-29a9-40b5-b4fe-03577bd8761c tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1289 microversion: 2.1 time: 0.253704 Aug 27 21:21:56.749560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2982/6070] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:21:56 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1289 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:21:57.775141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:21:57.778019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:21:57.802438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:57.803105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:57.803747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:57.804522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:57.807154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:57.812565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:57.899811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:21:57.910087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a953638e-1a7d-4c88-917b-37a6193d7614 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1351 microversion: 2.1 time: 0.143557 Aug 27 21:21:57.927083 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3089/6071] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:21:57 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:21:58.934399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:21:58.935036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:21:58.944482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:58.944931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:58.946063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:58.947305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:21:58.948085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:21:58.948696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:21:59.080354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:21:59.089618 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b3e72e74-d935-459a-84c4-859238390ed6 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1351 microversion: 2.1 time: 0.159222 Aug 27 21:21:59.103249 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2983/6072] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:21:58 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:00.111686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:00.112527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:00.120504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:00.121124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:00.121812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:00.122997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:00.124350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:00.125012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:00.556880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:00.573388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4b1fc601-6a1b-4b93-9ab6-1f01605da0ab tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.465330 Aug 27 21:22:00.574310 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3090/6073] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:00 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:01.444852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd0f8c5-ad6d-4229-95cb-640226fe3f0b", "tag": "3726135b-81f3-445e-8fce-6a5d5b9e4a23"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:01.458275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:01.459156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:01.459768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:01.474829 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] Creating event network-changed:3726135b-81f3-445e-8fce-6a5d5b9e4a23 for instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b on nch1-master-1 Aug 27 21:22:01.480887 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cd6be5cf-a1d4-40e2-bccb-5b0a8a2d66fe req-a2048fd9-de55-439c-978f-2258d813bfd4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040694 Aug 27 21:22:01.482127 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2984/6074] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:01.601966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:01.604026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:01.635775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:01.638273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:01.644188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:01.645146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:01.645735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:01.646272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:02.037060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:02.049514 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ebb26bde-cd94-44ca-b6a7-f37e52d53098 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.453614 Aug 27 21:22:02.051362 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3091/6075] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:01 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:03.073252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:03.073958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:03.087211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:03.087746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:03.088190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:03.088909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:03.089369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:03.089794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:03.551676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:03.567438 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7124ed11-ea9d-4490-9a35-6f5ea6d9eaa7 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.498146 Aug 27 21:22:03.568198 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2985/6076] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:03 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:04.596815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:04.597614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:04.608239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:04.608739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:04.609176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:04.609932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:04.610337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:04.610761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:04.831667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:04.842264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3929a932-0ca8-49fb-bc07-bb08b66e2912 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.250211 Aug 27 21:22:04.842866 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3092/6077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:04 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:05.864604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:05.865239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:05.868482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:05.869216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:05.876342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:05.877045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:05.877529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:05.878471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:05.879103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:05.879570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:06.039601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:06.048074 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-68f22ca9-6e30-443d-b9e0-2c14f3a53e98 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.187578 Aug 27 21:22:06.058302 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2986/6078] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:05 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:07.071699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:07.073002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:07.080206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:07.087973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:07.091473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:07.092187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:07.093362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:07.094051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:07.094723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:07.384603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:07.394948 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-df75955a-9c90-4845-88eb-e3070ac91cd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.329197 Aug 27 21:22:07.411157 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3093/6079] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:07 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:08.418063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:08.418844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:08.429236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:08.430124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:08.430798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:08.432406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:08.433986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:08.434688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:08.462237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd0f8c5-ad6d-4229-95cb-640226fe3f0b", "name": "network-vif-plugged", "status": "completed", "tag": "3726135b-81f3-445e-8fce-6a5d5b9e4a23"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:08.485515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:08.486747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:08.487719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:08.505544 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] Creating event network-vif-plugged:3726135b-81f3-445e-8fce-6a5d5b9e4a23 for instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b on nch1-master-1 Aug 27 21:22:08.519722 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-06e9c0f8-a2cf-42ad-9150-c2fc368bc180 req-b24a60ac-f9c7-4184-9ef8-4be18885136f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061663 Aug 27 21:22:08.521266 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3094/6080] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:22:08.658411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:08.666811 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e12a2365-d17e-4381-8f5b-3be5e06f0e69 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.252941 Aug 27 21:22:08.690003 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2987/6081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:08 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:09.692033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:09.693156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:09.699956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:09.700721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:09.701227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:09.702143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:09.702857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:09.703432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:09.887116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:09.895566 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-49c523f7-e3fd-485e-ad30-affed43d20ea tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1468 microversion: 2.1 time: 0.208755 Aug 27 21:22:09.896160 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3095/6082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:09 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1468 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:10.920461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:10.921921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:10.945684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:10.946339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:10.947011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:10.947819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:10.948340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:10.948848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:11.431066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:11.444366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-88ee555d-7e09-4ebe-9d56-f25bc1681428 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1641 microversion: 2.1 time: 0.531381 Aug 27 21:22:11.445201 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2988/6083] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:10 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1641 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:22:11.470336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:11.471774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:11.480067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:11.482798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:11.483141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:11.484135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:11.484802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:11.485446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:11.769639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:11.785719 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfccb2d8-3512-46b3-89f9-1e348823460d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1641 microversion: 2.1 time: 0.321407 Aug 27 21:22:11.786704 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3096/6084] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:11 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1641 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:11.808474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:11.809035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:11.815811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:11.816282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:11.817004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:11.817911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:11.818549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:11.819424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:12.400570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59925d57-14ab-4e5e-bf58-10e18be71ccc tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1792 microversion: 2.1 time: 0.594249 Aug 27 21:22:12.403973 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2989/6085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:11 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1792 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:16.223025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:16.224545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:16.242630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:16.243806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:16.244436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:16.245343 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:16.245995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:16.246588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:16.395292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lazy-loading 'services' on Instance uuid 363c79bb-62fb-4375-ae24-35c5166fd70a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:22:16.519431 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a716bb33-04e7-453a-972a-c026dbfbb4f4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a/os-volume_attachments/d3805c1d-d467-4a3e-9b08-bf8f6b1f350a" status: 202 len: 0 microversion: 2.1 time: 0.300706 Aug 27 21:22:16.520097 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3097/6086] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:22:16 2022] DELETE /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a/os-volume_attachments/d3805c1d-d467-4a3e-9b08-bf8f6b1f350a => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:22:16.879439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd0f8c5-ad6d-4229-95cb-640226fe3f0b", "tag": "3726135b-81f3-445e-8fce-6a5d5b9e4a23"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:16.902592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:16.903091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:16.903630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:16.932396 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] Creating event network-changed:3726135b-81f3-445e-8fce-6a5d5b9e4a23 for instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b on nch1-master-1 Aug 27 21:22:16.940927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-58290020-efba-4ee0-8930-8f50a3ec3dcd req-677322e7-01e8-4df6-95f3-524e15968857 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065368 Aug 27 21:22:16.942125 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2990/6087] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:17.714586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:17.715166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:17.722067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:17.723017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:17.724027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:17.725041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:17.725674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:17.728498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:17.759669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:22:17.896193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b3b0d868-46b7-4efe-bdfb-628d9d928224 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 204 len: 0 microversion: 2.1 time: 0.188161 Aug 27 21:22:17.897454 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3098/6088] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:22:17 2022] DELETE /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:22:17.907518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:17.908858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:17.917177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:17.917177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:17.917177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:17.918341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:17.919029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:17.919779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:18.291467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:18.313183 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c6940bd-5fc6-4ce2-8c48-b1a04701a244 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1512 microversion: 2.1 time: 0.410882 Aug 27 21:22:18.314478 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2991/6089] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:17 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:19.341057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:19.342664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:19.358720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:19.359200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:19.359859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:19.360757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:19.361375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:19.362709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:19.586550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:19.602907 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-695132bb-26b8-4464-b10a-23b812d56c62 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1512 microversion: 2.1 time: 0.267603 Aug 27 21:22:19.620240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3099/6090] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:19 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:22:20.472772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "363c79bb-62fb-4375-ae24-35c5166fd70a", "name": "network-vif-deleted", "tag": "5b930221-960d-41d9-8697-0d129c42b2c2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:20.486806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:20.487182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:20.487637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:20.500018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] Creating event network-vif-deleted:5b930221-960d-41d9-8697-0d129c42b2c2 for instance 363c79bb-62fb-4375-ae24-35c5166fd70a on nch2-master-1 Aug 27 21:22:20.505820 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a1d57c48-b094-428a-b619-ed1ddf767d7a req-b2f08384-1e1d-4bca-9198-b9b80424a989 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036912 Aug 27 21:22:20.506778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2992/6091] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:20.628331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:20.630492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:20.644794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:20.645619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:20.646064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:20.646795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:20.647251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:20.647723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:20.691992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:20.692484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:20.692924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:20.693376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lazy-loading 'fault' on Instance uuid 363c79bb-62fb-4375-ae24-35c5166fd70a {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:22:21.105069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:21.124981 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e245ea86-31b9-4670-92a2-429485b1594e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 200 len: 1308 microversion: 2.1 time: 0.498281 Aug 27 21:22:21.127583 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3100/6092] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:20 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:22.151783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:22.153435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 363c79bb-62fb-4375-ae24-35c5166fd70a] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:22.162893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:22.163754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:22.164426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:22.165360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:22.166047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:22.166649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:22.185674 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] HTTP exception thrown: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Request method failure captured: Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a HTTP/1.1 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCopzUKwbOJfKwqXQcmWpXlJbFEvoTM1PrtSRqsrL0F7bfBRqRYl6cbCQZQQZJAr01rej_f_G_4WCOfU0-UuWWRC1Tyze1p8LIydHbEW2j5l-WnW0hAabti7LAgp6cnbH3ynsSiVVyLJ1gL57oLHaq0iKLh0YgCw3IOOfIBfcZP28DHw Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c4b1b49ecb334270a40234aa2e1a16ce Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4b1b49ecb334270a40234aa2e1a16ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4b1b49ecb334270a40234aa2e1a16ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4b1b49ecb334270a40234aa2e1a16ce", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4b1b49ecb334270a40234aa2e1a16ce"}]}] Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c4b1b49ecb334270a40234aa2e1a16ce Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesSnapshotTestJSON-104348141-project Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 9f8c78c1134e4202b1e571b37d84b6ca Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesSnapshotTestJSON-104348141-project Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '363c79bb-62fb-4375-ae24-35c5166fd70a'} Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:22:22.187942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. Aug 27 21:22:22.192673 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:22:22.194404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Returning 404 to user: Instance 363c79bb-62fb-4375-ae24-35c5166fd70a could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:22:22.195539 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50648f3e-4f03-413a-9b37-4b86ff44d019 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a" status: 404 len: 111 microversion: 2.1 time: 0.049881 Aug 27 21:22:22.196620 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2993/6093] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:22 2022] GET /compute/v2.1/servers/363c79bb-62fb-4375-ae24-35c5166fd70a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:22:27.480951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1071757237", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "cb5630dd-c0b5-401f-8ae0-ed4984796178"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:27.492120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:27.590945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] validate_networks() for [('cb5630dd-c0b5-401f-8ae0-ed4984796178', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:22:28.376556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:22:28.377076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:22:28.377629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:22:28.378112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:22:28.378601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:22:28.398410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:28.399473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:28.400424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:28.401624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:28.402702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:28.404239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:28.422798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:28.459499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Getting quotas for project c4b1b49ecb334270a40234aa2e1a16ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:22:28.473254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Getting quotas for user 9f8c78c1134e4202b1e571b37d84b6ca and project c4b1b49ecb334270a40234aa2e1a16ce. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:22:28.505678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:22:28.508434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:22:28.567328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6be20cd0-8e7a-426e-9cb3-c6c04162f54c tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091255 Aug 27 21:22:28.568412 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3101/6094] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:22:28.595154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0468f1c0-70ba-464a-800f-a44070ee2b85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:28.596219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0468f1c0-70ba-464a-800f-a44070ee2b85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:28.598914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:28.685458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0468f1c0-70ba-464a-800f-a44070ee2b85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:28.706602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0468f1c0-70ba-464a-800f-a44070ee2b85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1219 microversion: 2.1 time: 0.127450 Aug 27 21:22:28.709195 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2994/6095] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:28 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:29.729894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c2befae-f50a-4b17-b7fb-f72eff67d819 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:29.731252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5c2befae-f50a-4b17-b7fb-f72eff67d819 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:29.862515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5c2befae-f50a-4b17-b7fb-f72eff67d819 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:29.880503 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5c2befae-f50a-4b17-b7fb-f72eff67d819 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1219 microversion: 2.1 time: 0.155447 Aug 27 21:22:29.881159 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3102/6096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:29 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:30.902559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-702e1554-e16d-483e-9188-073dae9dbdc7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:30.903828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-702e1554-e16d-483e-9188-073dae9dbdc7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:30.978136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-702e1554-e16d-483e-9188-073dae9dbdc7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:30.987240 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-702e1554-e16d-483e-9188-073dae9dbdc7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1219 microversion: 2.1 time: 0.088873 Aug 27 21:22:30.991490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2995/6097] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:30 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:32.013882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:32.014505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:32.026007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:32.026496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:32.029135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:32.029872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:32.030333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:32.030766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:32.118707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:32.130177 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3b981a45-0e09-4c0f-aafa-ed493e43e620 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1279 microversion: 2.1 time: 0.121289 Aug 27 21:22:32.131561 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3103/6098] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:32 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:33.152964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:33.154567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:33.165266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=58 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:33.167413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:33.168180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:33.168723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:33.169683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:33.170266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:33.170763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:33.241600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:33.250289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21b6e045-a80e-43e7-bf49-29c504b652fd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1277 microversion: 2.1 time: 0.101323 Aug 27 21:22:33.250877 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2996/6099] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:33 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:34.274527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:34.275949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:34.291890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:34.292393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:34.292848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:34.293642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:34.294109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:34.294743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:34.435421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "813f2409-4b32-4046-aeea-6b57e0150810", "tag": "9066a04e-ba7f-4ee5-8922-c87cdd992646"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:34.455725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:34.456681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:34.457530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:34.474602 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] Creating event network-changed:9066a04e-ba7f-4ee5-8922-c87cdd992646 for instance 813f2409-4b32-4046-aeea-6b57e0150810 on nch2-master-1 Aug 27 21:22:34.481906 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-624e6d39-0ee0-424f-8922-6255d2977950 req-d2590fa4-5821-4f71-99f1-e6cd8635f3bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060296 Aug 27 21:22:34.482715 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2997/6100] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:22:34.603446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:34.620635 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02e136aa-dc95-4759-9216-0d388440153e tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.349652 Aug 27 21:22:34.622429 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3104/6101] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:34 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:22:35.650423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:35.651143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:35.666025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:35.666765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:35.667049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:35.667793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:35.669843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:35.670338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:35.999555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:36.011895 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9646c91f-2990-4804-afef-1bb208267a85 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.369343 Aug 27 21:22:36.012567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2998/6102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:35 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:37.034600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:37.035238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:37.042793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:37.044549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:37.044549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:37.044549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:37.056619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:37.057092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:37.339230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:37.351746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0abbe88d-69aa-4bb3-a196-aebb07126dbd tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.321387 Aug 27 21:22:37.367059 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3105/6103] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:37 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:38.374892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:38.376844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:38.385751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:38.386543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:38.388921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:38.390408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:38.391461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:38.392297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:38.578537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:38.591832 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-823e64f5-4a82-47a2-9d1f-16dd51593084 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.220362 Aug 27 21:22:38.593072 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 2999/6104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:38 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:39.613905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:39.615558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:39.619680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:39.628276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:39.629148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:39.629719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:39.630682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:39.631210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:39.631797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:39.817226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:39.826242 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed348484-8504-4542-bdc6-3e9389d4ea05 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.216328 Aug 27 21:22:39.827179 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3106/6105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:39 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:40.848890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:40.849518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:40.857316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:40.857815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:40.858263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:40.858947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:40.859471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:40.859936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:40.986623 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:41.116517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:41.125597 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b2c48b53-9e9f-4d33-912b-cf3261cdeb3a tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.281814 Aug 27 21:22:41.126190 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3000/6106] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:40 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:41.565527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813f2409-4b32-4046-aeea-6b57e0150810", "name": "network-vif-plugged", "status": "completed", "tag": "9066a04e-ba7f-4ee5-8922-c87cdd992646"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:41.576381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:41.602185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:41.603424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:41.603826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:41.636026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] Creating event network-vif-plugged:9066a04e-ba7f-4ee5-8922-c87cdd992646 for instance 813f2409-4b32-4046-aeea-6b57e0150810 on nch2-master-1 Aug 27 21:22:41.645818 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aa679dc6-9da6-4dbf-aecb-67d6c745197c req-825544d3-2ee5-450d-a19e-d9c76f37019b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085761 Aug 27 21:22:41.646983 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3107/6107] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:41.657150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-941131073", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:41.742551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:22:42.148912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:42.149729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:42.157131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:42.157815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:42.158327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:42.159153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:42.159704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:42.160213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:42.683564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:22:42.684324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:22:42.684612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:22:42.685133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:22:42.685439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:22:42.706369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:42.707752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:42.708260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:42.708713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:42.710718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:42.711201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:42.711679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:42.722355 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62325d1b-1e7e-4841-b784-a8707b8ddefa tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1319 microversion: 2.1 time: 0.579166 Aug 27 21:22:42.723886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3108/6108] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:42 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:22:42.733162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Getting quotas for project bcf965d0edd34909ba62c56da03ffca5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:22:42.740226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Getting quotas for user 33bb65ddf7914202851c585a346be4c8 and project bcf965d0edd34909ba62c56da03ffca5. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:22:42.757680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:22:42.764860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:22:42.827967 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dd865ebe-fa3d-4901-a1c3-4a769a73a4e8 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175588 Aug 27 21:22:42.828863 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3001/6109] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 21:22:42.844082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-46d5f2f3-5fb3-4b1e-aa76-ba4d02b775bc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:42.844866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-46d5f2f3-5fb3-4b1e-aa76-ba4d02b775bc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:42.910680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-46d5f2f3-5fb3-4b1e-aa76-ba4d02b775bc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:42.918640 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-46d5f2f3-5fb3-4b1e-aa76-ba4d02b775bc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1214 microversion: 2.1 time: 0.082105 Aug 27 21:22:42.919575 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3109/6110] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:42 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:43.750233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:43.754486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:43.769206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:43.770416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:43.771265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:43.772577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:43.773456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:43.774689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:43.941101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:43.942620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:43.950841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:43.951532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:43.952077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:43.952894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:43.953516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:43.954008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:43.956688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:43.966659 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9e59378-9e78-465c-9921-54970eade40b tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1507 microversion: 2.1 time: 0.225513 Aug 27 21:22:43.967274 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3002/6111] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:43 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:44.000508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78f14686-a6e3-4290-b213-3298d690e345", "device": "/dev/sdb"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:44.004489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:44.014963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:44.015701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:44.016330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:44.017431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:44.018358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:44.019226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:44.037272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:44.053894 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b46cde64-1c5b-4427-b3b6-035d2f4c6639 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1266 microversion: 2.1 time: 0.116915 Aug 27 21:22:44.054994 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3110/6112] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:43 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:44.389160 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1616fac1-6155-4340-aabc-63a6e7c6d71f tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "POST /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402355 Aug 27 21:22:44.395979 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3003/6113] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:22:43 2022] POST /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:45.076038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:45.076785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:45.091040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:45.091976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:45.092427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:45.093486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:45.095983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:45.096449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:45.220754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:45.231993 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aaba4839-df82-4f38-af72-518117532983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1272 microversion: 2.1 time: 0.160080 Aug 27 21:22:45.232625 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3111/6114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:45 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:46.261873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:46.266100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:46.278102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:46.278879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:46.279750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:46.281879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:46.282710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:46.283411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:46.422435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:46.435620 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e89d898-7903-46f0-99dc-b4b0cc1b39e1 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1272 microversion: 2.1 time: 0.184580 Aug 27 21:22:46.437062 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3004/6115] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:46 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:47.460689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:47.461305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:47.472193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:47.472704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:47.473151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:47.473871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:47.480049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:47.480583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:47.737577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:47.748050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94ad4722-4e16-43ec-9d83-807ddfef9aa6 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.292713 Aug 27 21:22:47.759302 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3112/6116] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:47 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:22:48.786461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:48.788046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:48.798521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:48.799498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:48.800252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:48.803202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:48.805882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:48.806855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:49.603833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:49.616234 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed7cacf0-bfe1-470d-83a5-955810394550 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.839352 Aug 27 21:22:49.632474 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3005/6117] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:48 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:49.835806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b802096-fee4-456b-b067-bea473327d9b", "tag": "b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:49.857888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:49.858786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:49.860320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:49.889657 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] Creating event network-changed:b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e for instance 3b802096-fee4-456b-b067-bea473327d9b on nch2-master-1 Aug 27 21:22:49.899297 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-0e880f49-d51f-4cc9-bb38-906eb7e716df req-be8e5d98-1aea-460c-a03c-59e12d848414 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067906 Aug 27 21:22:49.903740 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3113/6118] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:50.639068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:50.639884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:50.647533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:50.648016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:50.648540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:50.649371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:50.649908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:50.650409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:51.018193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:51.030670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-721ef756-ba9d-4bfa-89bc-6a3785465f63 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.396187 Aug 27 21:22:51.031266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3006/6119] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:50 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:52.059794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:52.061611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:52.099766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:52.101089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:52.102060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:52.103221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:52.103560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:52.104102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:52.281684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:52.289977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6606469-2bc7-4457-ac22-0abb22dfaea2 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.237321 Aug 27 21:22:52.290562 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3114/6120] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:52 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:53.313779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:53.315097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:53.318077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:53.318835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:53.326207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:53.326713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:53.327163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:53.327924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:53.328380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:53.328809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:53.479484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:53.488662 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-363cae4b-7264-414a-b3bc-11c0a211d5e0 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.180609 Aug 27 21:22:53.489271 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3007/6121] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:53 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:54.510290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:54.511284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:54.513565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:54.520564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:54.521046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:54.521716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:54.522600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:54.523313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:54.523766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:55.017522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:55.025823 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-51438e87-9017-43bd-892c-2b979c328552 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.519970 Aug 27 21:22:55.026393 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3115/6122] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:54 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:56.046675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:56.047947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:56.059977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:56.063055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:56.063741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:56.064631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:56.067152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:56.067597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:56.342270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:56.353616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-750e31e5-cceb-4000-b35b-42eea8dbc6ed tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.310246 Aug 27 21:22:56.354380 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3008/6123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:56 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:57.374492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:57.375488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:57.383542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:57.384065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:57.384622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:57.385613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:57.386959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:57.387561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:57.585726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b802096-fee4-456b-b067-bea473327d9b", "name": "network-vif-plugged", "status": "completed", "tag": "b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:22:57.598481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:57.598952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:57.599732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:57.615388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] Creating event network-vif-plugged:b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e for instance 3b802096-fee4-456b-b067-bea473327d9b on nch2-master-1 Aug 27 21:22:57.621420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-218f36af-aa11-4c9b-be1c-447c0fc07e45 req-ca6eacc4-d7a7-47a8-8b94-d766f0048d90 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041626 Aug 27 21:22:57.622386 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3009/6124] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:22:57.761381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:57.769824 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ec7d23b-56ab-4060-83fa-a1d90cf539bb tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.399377 Aug 27 21:22:57.770388 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3116/6125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:57 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:22:58.791905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:22:58.793353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:22:58.799448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:22:58.801409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:58.802088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:58.802708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:58.803661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:22:58.804431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:22:58.805034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:22:59.098500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:22:59.113481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12a61ec4-630d-4060-b207-7eeca33939cc tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1314 microversion: 2.1 time: 0.326650 Aug 27 21:22:59.127993 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3010/6126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:22:58 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:00.135327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:00.137277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:00.144383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:00.145838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.146336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.146800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.148166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.148633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.149249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.154212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=72 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:00.379882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:00.393488 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5150e769-324e-44e3-80cb-d094865cdf73 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1464 microversion: 2.1 time: 0.262185 Aug 27 21:23:00.394098 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3117/6127] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:00 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:00.450151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:00.450831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:00.458783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.460304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.460968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.461912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.462929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.464000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.495040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:23:00.586873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:00.655723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-acdbfafb-99ce-42ac-ac2a-1d3fd32250ab tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 204 len: 0 microversion: 2.1 time: 0.205260 Aug 27 21:23:00.666162 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3011/6128] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:23:00 2022] DELETE /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:23:00.675161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:00.676347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:00.687389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.689103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.689724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.692020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:00.693439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:00.694060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:00.994778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:01.006457 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14b7d49a-129d-418d-b123-fef64b500f0b tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1470 microversion: 2.1 time: 0.338949 Aug 27 21:23:01.010478 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3118/6129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:00 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:02.031958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:02.033606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:02.041630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:02.042810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:02.043670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:02.045015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:02.045720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:02.046307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:02.296985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:02.307959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3ad31e6-01e5-4f3e-8688-486cb9f87294 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1470 microversion: 2.1 time: 0.280896 Aug 27 21:23:02.308664 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3012/6130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:02 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:03.337375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:03.340244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:03.356010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:03.368110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:03.369125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:03.370067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:03.370796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:03.371616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:03.549523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b802096-fee4-456b-b067-bea473327d9b", "name": "network-vif-deleted", "tag": "b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:03.572112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:03.572857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:03.573479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:03.580777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33bb65ddf7914202851c585a346be4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf965d0edd34909ba62c56da03ffca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:03.593440 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91a12607-72ef-469a-a6b3-668e13864983 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 200 len: 1428 microversion: 2.1 time: 0.264799 Aug 27 21:23:03.594055 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3119/6131] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:03 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 1428 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:03.606781 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] Creating event network-vif-deleted:b7d11c1b-4d2a-4a8d-adfd-3e6d3f5f934e for instance 3b802096-fee4-456b-b067-bea473327d9b on nch2-master-1 Aug 27 21:23:03.612658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-24a8bf98-b6d1-41fd-b62c-86487724af2a req-3df788d4-831f-4a06-a486-fc1885de314e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067655 Aug 27 21:23:03.613718 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3013/6132] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:23:04.616647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:04.617390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] [instance: 3b802096-fee4-456b-b067-bea473327d9b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:04.630731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:04.631236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:04.631714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:04.632437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:04.632896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:04.633324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:04.657042 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] HTTP exception thrown: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Request method failure captured: Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b HTTP/1.1 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCosfTeYPwiuqYrRUhieso2AkjdAddal6fV4vROqCMcgyA3WO6N4fY8NBk0hDB32lNRMBrEg373u3J6smf9Eqays0iNzHC2y--0iYxAmqhrvo-tl_cKQt8iMsETQVCvleTWXkeWDKI1oFfBcWGA-TX1UIyF9rlYb7rkfOqO7ZeqCADh4 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: bcf965d0edd34909ba62c56da03ffca5 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesNegativeTest-372573996 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bcf965d0edd34909ba62c56da03ffca5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bcf965d0edd34909ba62c56da03ffca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bcf965d0edd34909ba62c56da03ffca5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bcf965d0edd34909ba62c56da03ffca5"}]}] Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesNegativeTest-372573996 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: bcf965d0edd34909ba62c56da03ffca5 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesNegativeTest-372573996 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesNegativeTest-372573996-project Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 33bb65ddf7914202851c585a346be4c8 Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesNegativeTest-372573996-project Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '3b802096-fee4-456b-b067-bea473327d9b'} Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:04.659168 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. Aug 27 21:23:04.664533 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:04.666377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] Returning 404 to user: Instance 3b802096-fee4-456b-b067-bea473327d9b could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:23:04.667968 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b388e23-0210-4aec-a74e-8cc7c42a2824 tempest-VolumesNegativeTest-372573996 tempest-VolumesNegativeTest-372573996-project] 10.222.0.40 "GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b" status: 404 len: 111 microversion: 2.1 time: 0.055382 Aug 27 21:23:04.669106 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3120/6133] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:04 2022] GET /compute/v2.1/servers/3b802096-fee4-456b-b067-bea473327d9b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:23:29.621902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:29.624057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:29.630207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-967555271", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "ac691ae3-633f-4a0d-a5ec-7b7c4ce59373"}], "key_name": "tempest-TestSecurityGroupsBasicOps-887459505", "security_groups": []}, "os:scheduler_hints": {"different_host": ["bcd0f8c5-ad6d-4229-95cb-640226fe3f0b"]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:29.694355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] validate_networks() for [('ac691ae3-633f-4a0d-a5ec-7b7c4ce59373', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:23:30.641954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:23:30.643086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:23:30.645328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:23:30.646018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:23:30.646660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:23:30.668845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:30.670476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:30.671197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:30.673247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:30.674494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:30.675303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:30.706426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for project 8871159ebe10493da1f399f35af1551d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:23:30.714951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Getting quotas for user 06b8f5ffc3f34f0bb499e7915dab4a80 and project 8871159ebe10493da1f399f35af1551d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:23:30.728388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:23:30.731640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:23:30.811845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92b87bbf-7d2a-4e73-a250-c91fb6bbc3aa tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.190761 Aug 27 21:23:30.820838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3014/6134] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:23:29 2022] POST /compute/v2.1/servers => generated 361 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:23:30.825329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47c1d3e7-e215-4cb7-a0fa-d789b33fb33f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:30.825951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-47c1d3e7-e215-4cb7-a0fa-d789b33fb33f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:30.832484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=7 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:30.833773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=19 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:30.923426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-47c1d3e7-e215-4cb7-a0fa-d789b33fb33f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:30.945446 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47c1d3e7-e215-4cb7-a0fa-d789b33fb33f tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1240 microversion: 2.1 time: 0.124254 Aug 27 21:23:30.949690 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3121/6135] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:30 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:31.981178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:31.982475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:31.993616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:31.998674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:31.999104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:31.999877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:32.000338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:32.000764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:32.132668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:32.180264 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0829444-7cff-41d5-9c81-c98386387dd1 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1292 microversion: 2.1 time: 0.207508 Aug 27 21:23:32.182925 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3015/6136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:31 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1292 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:33.207552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:33.208667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:33.224744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:33.225639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:33.226334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:33.227476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:33.228190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:33.228902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:33.414536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:33.430109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ba13a5b-ba2d-41e6-83b4-6d00cd68a1cb tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.229815 Aug 27 21:23:33.450301 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3122/6137] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:33 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:34.454291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:34.455698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:34.474040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:34.474580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:34.475044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:34.476395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:34.476884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:34.477332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:35.038977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:35.053297 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e50a9f4-371c-497e-a627-3ca999083419 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.604249 Aug 27 21:23:35.054342 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3016/6138] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:34 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:36.082285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:36.083674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:36.094961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:36.096112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:36.099693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:36.100657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:36.101643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:36.102272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:36.612245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:36.631034 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-09c8217f-2d58-4502-85d5-71fb91ff0f25 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.559992 Aug 27 21:23:36.633337 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3123/6139] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:36 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:37.225367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c3dd74-7b2c-47ec-b229-f2f42460add1", "tag": "05ca2cd3-1115-4554-bfd0-bedeccca01f3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:37.253165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:37.254526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:37.260739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:37.296646 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] Creating event network-changed:05ca2cd3-1115-4554-bfd0-bedeccca01f3 for instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 on nch2-master-1 Aug 27 21:23:37.309100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-300c4602-c6c2-4b65-abfd-25505ecd00f4 req-a73a74be-8d17-4116-b5d9-d793eb13e299 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089948 Aug 27 21:23:37.317977 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3017/6140] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:23:37.654790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:37.655594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:37.668966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:37.670047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:37.672633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:37.675729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:37.676842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:37.683712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:37.861820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:37.872763 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9bdb7af-8a20-4050-bd12-00e2be1348c5 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.222355 Aug 27 21:23:37.884113 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3124/6141] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:37 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:38.905280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:38.906043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:38.913540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:38.913765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:38.920603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:38.921882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:38.924211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:38.924885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:39.386416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:39.402656 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-553abcf9-9195-4da7-9617-4741db41e329 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.501765 Aug 27 21:23:39.403904 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3018/6142] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:38 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:40.439665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:40.441001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:40.450552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:40.451732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:40.452328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:40.467165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:40.469142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:40.470612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:40.685837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:40.697434 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4987c073-8014-4e3f-a381-1d0483f47ac2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.271694 Aug 27 21:23:40.700705 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3125/6143] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:40 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:41.727948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:41.730285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:41.744795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:41.746231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:41.750252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:41.751081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:41.751788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:41.753088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:41.753972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:41.755178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:41.915582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:41.929344 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c61c78bb-f2f2-443f-9d04-d57dff1d4368 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.211315 Aug 27 21:23:41.930019 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3019/6144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:41 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:42.951998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:42.952627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:42.954610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:42.970319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:42.970983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:42.980064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:42.982256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:42.985441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:42.986006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:43.199213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:43.216421 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0469c8b8-8b4a-49d5-afb0-04fae8ec6fb2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.268638 Aug 27 21:23:43.218226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3126/6145] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:42 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:44.238086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:44.239297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:44.246548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:44.260347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:44.260908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:44.261681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:44.262137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:44.262564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:44.436429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:44.455219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b06ce059-4b1a-4acd-a20e-5bb895350412 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.220437 Aug 27 21:23:44.457882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3020/6146] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:44 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:44.723075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c3dd74-7b2c-47ec-b229-f2f42460add1", "name": "network-vif-plugged", "status": "completed", "tag": "05ca2cd3-1115-4554-bfd0-bedeccca01f3"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:44.753843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:44.765514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:44.766038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:44.784262 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] Creating event network-vif-plugged:05ca2cd3-1115-4554-bfd0-bedeccca01f3 for instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 on nch2-master-1 Aug 27 21:23:44.790118 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-87c613e0-0013-46cd-a6ff-1a2aa424dfb1 req-d42beb0e-0cd9-492a-81db-147f5dea887c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079312 Aug 27 21:23:44.791258 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3127/6147] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:23:45.485423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:45.486881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:45.494981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:45.496301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:45.497602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:45.498820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:45.499750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:45.500445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:45.666729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:45.684560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-029d5e15-4429-4b96-bbd3-59baa8cf59f8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1298 microversion: 2.1 time: 0.205126 Aug 27 21:23:45.697728 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3021/6148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:45 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:46.713350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:46.714457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:46.732226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:46.732720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:46.733158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:46.733869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:46.734323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:46.734747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:47.017918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:47.027269 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1ee3451a-ff68-4132-8a36-2a814d49a020 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1471 microversion: 2.1 time: 0.320409 Aug 27 21:23:47.050566 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3128/6149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:46 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:47.075077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:47.077541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:47.102503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:47.106328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:47.110716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:47.112101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:47.115399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:47.116202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:47.595913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:47.608682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2df2c192-8427-4da2-9c48-1bee4c977bd3 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1471 microversion: 2.1 time: 0.557103 Aug 27 21:23:47.611450 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3022/6150] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:47 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1471 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:47.635876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:47.637377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:47.661688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:47.662208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:47.662719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:47.663535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:47.663994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:47.664419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:47.991930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19a00a1e-25b4-4fc2-8473-6389dd7a4ff0 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1622 microversion: 2.1 time: 0.361499 Aug 27 21:23:47.995989 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3129/6151] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:47 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1622 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:48.016609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:48.017578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:48.028424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.031056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.031784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:48.037573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.038351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.039054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:48.353720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-257bdd56-0705-4d34-b16b-812440ae6742 tempest-TestSecurityGroupsBasicOps-2029695277 tempest-TestSecurityGroupsBasicOps-2029695277-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1910 microversion: 2.1 time: 0.340642 Aug 27 21:23:48.354971 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3023/6152] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:48 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1910 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:48.501838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:48.502467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:48.518030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.518166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.518700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:48.520759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.522164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.530262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:48.598012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:23:48.777084 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79251cdf-4c9a-477c-937f-805ea3005d21 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "DELETE /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 204 len: 0 microversion: 2.1 time: 0.284319 Aug 27 21:23:48.778097 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3130/6153] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:23:48 2022] DELETE /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:23:48.793665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:48.795236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:48.813966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.814825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.815519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:48.816456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:48.817244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:48.817857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:49.050435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:49.059684 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2368fbe4-0f44-4597-8e47-880ff517300d tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1477 microversion: 2.1 time: 0.272860 Aug 27 21:23:49.060285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3024/6154] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:48 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:50.085747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:50.086454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:50.096852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:50.097365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:50.097821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:50.101984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:50.102483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:50.106857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:50.373107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:50.382855 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de93a727-e95b-47ce-a87a-a8d4301dc70a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1477 microversion: 2.1 time: 0.301504 Aug 27 21:23:50.384233 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3131/6155] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:50 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:51.406776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:51.407545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:51.424656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:51.425175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:51.425619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:51.430449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:51.431191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:51.431789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:51.570170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:51.573489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:51.574226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:51.574913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:51.576039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:51.576734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:51.577431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:51.605719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:51.620690 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aa9ae4e6-2521-4250-bb35-56d2b6f5b3d2 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1477 microversion: 2.1 time: 0.218139 Aug 27 21:23:51.622792 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3132/6156] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:51 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:51.646043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d08cdae-af73-4955-a9e8-0d9067b8019f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.285888 Aug 27 21:23:51.647063 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3025/6157] 10.222.0.40 () {58 vars in 1185 bytes} [Sat Aug 27 21:23:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:23:51.815316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1262039515", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "ab4da7ab-9ca7-42af-9d9d-53cc3303bddf"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:51.907703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] validate_networks() for [('ab4da7ab-9ca7-42af-9d9d-53cc3303bddf', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:23:52.330637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:52.340234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:52.358444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.359868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.363492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.364442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.365057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.365622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.433340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:23:52.680947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dcc7ecb8-2bc9-4294-98bd-6592a61d109e tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 204 len: 0 microversion: 2.1 time: 0.649101 Aug 27 21:23:52.681925 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3026/6158] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:23:52 2022] DELETE /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:23:52.690770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c3dd74-7b2c-47ec-b229-f2f42460add1", "name": "network-vif-deleted", "tag": "05ca2cd3-1115-4554-bfd0-bedeccca01f3"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:52.721106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.721744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.722208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.749637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] Creating event network-vif-deleted:05ca2cd3-1115-4554-bfd0-bedeccca01f3 for instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 on nch2-master-1 Aug 27 21:23:52.762463 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-214daf38-481d-4b2e-956a-49a6cbf6a38a req-537c4026-2533-4e19-9c18-6a5f339719e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077462 Aug 27 21:23:52.763740 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3027/6159] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:23:52.770372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:52.773138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:52.782396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.783611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.784355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.785991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.787255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.787884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.908622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:52.909173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:52.909635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:52.912230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lazy-loading 'fault' on Instance uuid 96c3dd74-7b2c-47ec-b229-f2f42460add1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:23:53.271205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:53.283986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25f283af-aa4b-4323-86c4-30231c64d0dd tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 200 len: 1330 microversion: 2.1 time: 0.517704 Aug 27 21:23:53.284928 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3028/6160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:52 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 1330 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:53.292265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:53.292775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:53.318535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:53.318535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:53.318535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:53.320638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:53.321185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:53.321690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:53.382232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:23:53.382869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:23:53.383650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:23:53.384295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:23:53.386336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:23:53.406431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:53.407221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:53.408442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:53.409442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:53.410084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:53.411000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:53.440218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Getting quotas for project a0e17e61aa354b11864349de5d5c6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:23:53.449774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Getting quotas for user 7dead7ab5f834c8d9c260c7cf443ad64 and project a0e17e61aa354b11864349de5d5c6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:23:53.469302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:23:53.471950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:23:53.585770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:53.591966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e08b0019-beec-43d8-a328-86dfcd481f11 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780423 Aug 27 21:23:53.602341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49d4e2ff-3735-4a53-ab9c-49467b7ac310 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1732 microversion: 2.1 time: 0.315885 Aug 27 21:23:53.602598 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3133/6161] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:23:53.613979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a74495f-e7d1-4d11-8751-1342a4009004 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:53.617241 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3029/6162] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:53 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:53.617417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a74495f-e7d1-4d11-8751-1342a4009004 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:53.787089 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a74495f-e7d1-4d11-8751-1342a4009004 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1329 microversion: 2.1 time: 0.177347 Aug 27 21:23:53.787662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3134/6163] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:53 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1329 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:54.321870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:54.324066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: 96c3dd74-7b2c-47ec-b229-f2f42460add1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:54.332756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.333603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.334621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:54.335808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.342583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.343452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:54.372142 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] HTTP exception thrown: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Request method failure captured: Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 HTTP/1.1 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCorfjtaR6nIIj_Nr4W6GUQ3mHCzDx1tYBH4WCp_x3D1pM9rhA58p8M1xyCQowOWki_ijr2XWeKUS7LC5kI6pwnZECMekgp5SFvLSdC0-T0mm0NGlVCUpl-DMbiIB8ZWmot8g9gO4qrdO5PhKv5AN9m-qYt41HHjZlEpTiz-W4HoBx3s Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8871159ebe10493da1f399f35af1551d Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8871159ebe10493da1f399f35af1551d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8871159ebe10493da1f399f35af1551d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8871159ebe10493da1f399f35af1551d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8871159ebe10493da1f399f35af1551d"}]}] Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8871159ebe10493da1f399f35af1551d Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestSecurityGroupsBasicOps-368624320-project Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 06b8f5ffc3f34f0bb499e7915dab4a80 Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestSecurityGroupsBasicOps-368624320-project Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '96c3dd74-7b2c-47ec-b229-f2f42460add1'} Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:54.374498 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. Aug 27 21:23:54.380942 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:54.382969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Returning 404 to user: Instance 96c3dd74-7b2c-47ec-b229-f2f42460add1 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:23:54.384666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7e6c3db2-345d-436f-820a-426e331ea188 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1" status: 404 len: 111 microversion: 2.1 time: 0.079323 Aug 27 21:23:54.385495 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3030/6164] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:54 2022] GET /compute/v2.1/servers/96c3dd74-7b2c-47ec-b229-f2f42460add1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:23:54.625184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:54.625814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:54.634850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.635745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.644102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:54.645608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.650922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.651712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:54.809860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:54.810519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:54.821077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.825634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.828227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:54.835575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:54.836337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:54.836944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:55.037763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:55.048622 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7a8200c9-9cb8-4034-af1e-c60ba6a098ca tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1338 microversion: 2.1 time: 0.239737 Aug 27 21:23:55.049986 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3031/6165] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:54 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1338 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:23:55.095448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:55.109884 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-26609f4d-dc7e-4711-919c-dbe3005e15fb tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1732 microversion: 2.1 time: 0.488612 Aug 27 21:23:55.124280 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3135/6166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:54 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1732 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:56.075147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:56.076325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:56.097476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:56.097980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:56.098846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:56.099638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:56.100100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:56.100529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:56.136265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:56.136983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:56.154442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:56.155075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:56.155665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:56.156505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:56.157186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:56.157727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:56.269968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-01f014a9-3986-48cf-85bf-793a0221f0d2 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1422 microversion: 2.1 time: 0.189585 Aug 27 21:23:56.283764 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3032/6167] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:56 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1422 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:56.357132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:56.368402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94178f6a-e276-479d-b8b5-e58c13c1fe10 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1664 microversion: 2.1 time: 0.238020 Aug 27 21:23:56.373863 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3136/6168] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:56 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:23:57.110120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c197098-5003-41e3-9d3c-ab09e9076ed4", "name": "network-vif-deleted", "tag": "cf631e8a-0cea-4b51-ab22-88ff58b38e7a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:57.136371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.136851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.137293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.194798 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] Creating event network-vif-deleted:cf631e8a-0cea-4b51-ab22-88ff58b38e7a for instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 on nch1-master-1 Aug 27 21:23:57.205590 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d785b0c0-ec62-4eb0-88f9-f2e521bd9bb4 req-bc57b884-6c2f-47e7-a580-2b614121852a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100214 Aug 27 21:23:57.208057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3033/6169] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:23:57.292269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:57.292901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:57.315186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.317430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.320498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.322358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.323995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.325520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.394714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:57.395452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:57.408588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.416513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.417473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.418155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.420756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.422903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.498650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:57.517909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:57.518706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:57.519534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lazy-loading 'fault' on Instance uuid 4c197098-5003-41e3-9d3c-ab09e9076ed4 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:23:57.592470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a6f961bc-938c-4fd0-95c2-caa14c909e54 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.304364 Aug 27 21:23:57.593090 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3137/6170] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:57 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:57.641883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4998bdbb5bae48aab1361ca88b0ca78b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38ecb63e6bf464281287449b5c5eeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:23:57.657388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-991a24c9-8a9d-4c9a-ab4e-a75556d44d11 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 200 len: 1388 microversion: 2.1 time: 0.264265 Aug 27 21:23:57.658829 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3034/6171] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:57 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 1388 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:23:58.615445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:58.616855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:58.654728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:58.655231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:58.661094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:58.661910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:58.662402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:58.662849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:58.682944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:58.684227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:58.700180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:58.700687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:58.701139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:58.701876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:58.721584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:58.723692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:58.742360 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] HTTP exception thrown: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Request method failure captured: Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 HTTP/1.1 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCooEynGM_r3vil0KQIH4FpkuFrhG5SYolL3NgoszGvcr770Qjnll-ZTNvZV22LypSBasw2z8HiBLrnChAuwV41B69tOGyqdpGXJ96OEJ0t7m-sCuQ00pzjmIX_aFhg1T8eaWyW6sJmtMMZzz7rjFoLVSoj_MNIDH2NXQmirksozi37Y Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e38ecb63e6bf464281287449b5c5eeed", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}] Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestServerBasicOps-782575008 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4998bdbb5bae48aab1361ca88b0ca78b Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4c197098-5003-41e3-9d3c-ab09e9076ed4'} Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:58.744692 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:58.750265 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:58.751972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Returning 404 to user: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:23:58.753304 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c391950-ee62-4acf-886c-dd31dbc38cda tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 404 len: 111 microversion: 2.1 time: 0.074799 Aug 27 21:23:58.758563 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3035/6172] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:58 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:23:59.153406 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b56b870e-e895-4adc-a8d6-7b6602b21197 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.543644 Aug 27 21:23:59.171538 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3138/6173] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:58 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:23:59.502420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:59.503561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:59.510991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:59.511579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:59.512055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:59.513095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:59.513566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:59.514002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:59.530774 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] HTTP exception thrown: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Request method failure captured: Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 HTTP/1.1 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCooEynGM_r3vil0KQIH4FpkuFrhG5SYolL3NgoszGvcr770Qjnll-ZTNvZV22LypSBasw2z8HiBLrnChAuwV41B69tOGyqdpGXJ96OEJ0t7m-sCuQ00pzjmIX_aFhg1T8eaWyW6sJmtMMZzz7rjFoLVSoj_MNIDH2NXQmirksozi37Y Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e38ecb63e6bf464281287449b5c5eeed", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}] Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4998bdbb5bae48aab1361ca88b0ca78b Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4c197098-5003-41e3-9d3c-ab09e9076ed4'} Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:23:59.533093 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Returning 404 to user: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:23:59.538095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a8e7adf-dd2b-4e52-ae0c-f8d496660fd8 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 404 len: 111 microversion: 2.1 time: 0.037372 Aug 27 21:23:59.539112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3036/6174] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:23:59 2022] DELETE /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:23:59.547629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:59.548352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] [instance: 4c197098-5003-41e3-9d3c-ab09e9076ed4] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:23:59.555459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:59.555965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:59.557374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:59.558231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:59.558768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:59.559478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:59.564266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:59.577323 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] HTTP exception thrown: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Request method failure captured: Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 HTTP/1.1 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCooEynGM_r3vil0KQIH4FpkuFrhG5SYolL3NgoszGvcr770Qjnll-ZTNvZV22LypSBasw2z8HiBLrnChAuwV41B69tOGyqdpGXJ96OEJ0t7m-sCuQ00pzjmIX_aFhg1T8eaWyW6sJmtMMZzz7rjFoLVSoj_MNIDH2NXQmirksozi37Y Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e38ecb63e6bf464281287449b5c5eeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e38ecb63e6bf464281287449b5c5eeed", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e38ecb63e6bf464281287449b5c5eeed"}]}] Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: e38ecb63e6bf464281287449b5c5eeed Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestServerBasicOps-782575008 Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4998bdbb5bae48aab1361ca88b0ca78b Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestServerBasicOps-782575008-project Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '4c197098-5003-41e3-9d3c-ab09e9076ed4'} Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:23:59.579425 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. Aug 27 21:23:59.585188 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:23:59.588758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Returning 404 to user: Instance 4c197098-5003-41e3-9d3c-ab09e9076ed4 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:23:59.589871 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e0638680-eb5e-416f-84c8-15f41c799fb5 tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4" status: 404 len: 111 microversion: 2.1 time: 0.049236 Aug 27 21:23:59.590925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3139/6175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:23:59 2022] GET /compute/v2.1/servers/4c197098-5003-41e3-9d3c-ab09e9076ed4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:23:59.784304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e08d3b60-cac0-4054-b47d-17d33b1a4c1d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] Calling method '.version_select at 0x7ff84e66fe50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:23:59.785277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d37317-eff3-4440-a524-e9a93db129a9", "tag": "1e6fb6e5-042f-43fe-91b0-321ce954cb37"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:23:59.822730 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e08d3b60-cac0-4054-b47d-17d33b1a4c1d tempest-TestServerBasicOps-782575008 tempest-TestServerBasicOps-782575008-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-461381666" status: 202 len: 0 microversion: 2.1 time: 0.043537 Aug 27 21:23:59.824169 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3140/6176] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 21:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-461381666 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:23:59.833130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:23:59.860669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:23:59.865591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:23:59.866117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:23:59.884438 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] Creating event network-changed:1e6fb6e5-042f-43fe-91b0-321ce954cb37 for instance f9d37317-eff3-4440-a524-e9a93db129a9 on nch2-master-1 Aug 27 21:23:59.890501 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4a3fd306-3dc7-413f-8962-8afe023624da req-896fadd1-6e48-4567-8761-7532348cd4eb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117803 Aug 27 21:23:59.892428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3037/6177] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:00.175809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:00.176449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:00.184397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:00.185901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:00.186377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:00.187218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:00.187720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:00.188206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:00.482123 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fcbb150f-4e3f-47d7-91c4-82a4bf471988 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.311231 Aug 27 21:24:00.497610 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3141/6178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:00 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:01.508278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:01.509508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:01.529621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:01.530333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:01.530798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:01.531588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:01.534979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:01.540798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:01.604776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:02.385923 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d980ec54-5471-45f1-a0e3-dd7b67dbf9c9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.882089 Aug 27 21:24:02.386845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3038/6179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:01 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:03.413033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:03.413801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:03.426618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:03.428922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:03.433852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:03.434677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:03.435411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:03.436697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:03.437337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:03.438130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:03.786913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:04.140533 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-471c017b-a27d-4711-863e-687fec40020f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.735165 Aug 27 21:24:04.144032 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3142/6180] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:03 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:05.062099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:05.062660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:05.065242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd0f8c5-ad6d-4229-95cb-640226fe3f0b", "tag": "3726135b-81f3-445e-8fce-6a5d5b9e4a23"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:05.081280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.082615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.082615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.082908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.096529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.097018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.097459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.101520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.102418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.147442 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] Creating event network-changed:3726135b-81f3-445e-8fce-6a5d5b9e4a23 for instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b on nch1-master-1 Aug 27 21:24:05.164556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d9d37b77-29e7-4a35-9a2d-b485ebf5360c req-b19fc6a0-3c7a-46eb-8e4c-e81ce6bb35d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107512 Aug 27 21:24:05.168502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3143/6181] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:24:05.173687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:05.174393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:05.177076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:24:05.228439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.232275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.233152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.239693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.240356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.240812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.403765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25561435-b8cf-4887-bc75-562cdf7ed804 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 204 len: 0 microversion: 2.1 time: 0.352103 Aug 27 21:24:05.410497 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3039/6182] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:24:05 2022] DELETE /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:24:05.417797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:05.418565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:05.427805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.428611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.429880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.430837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:05.431777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:05.432526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:05.735030 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c2223f7a-d10d-44b5-8ba4-febc77fec91e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.565205 Aug 27 21:24:05.746441 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3144/6183] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:05 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:05.949359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:05.958778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-93946dd2-8371-40f3-af1a-68454574cf5b tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1765 microversion: 2.1 time: 0.545823 Aug 27 21:24:05.971403 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3040/6184] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:05 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1765 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:06.764355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:06.765130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:06.781280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:06.781863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:06.782385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:06.783408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:06.783937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:06.784740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:06.986684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:06.988438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:07.004952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:07.005957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:07.008446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:07.015873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:07.016623 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4834dda8-d765-4110-bcbd-a3c17b7b6964 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.253989 Aug 27 21:24:07.016965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:07.017635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:07.027443 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3145/6185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:06 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:07.286787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:07.305856 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2867dfa3-b8f3-446d-9a61-57d974eefd0a tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1765 microversion: 2.1 time: 0.323469 Aug 27 21:24:07.306843 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3041/6186] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:06 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1765 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:07.954169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d37317-eff3-4440-a524-e9a93db129a9", "name": "network-vif-plugged", "status": "completed", "tag": "1e6fb6e5-042f-43fe-91b0-321ce954cb37"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:07.965705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:07.966561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:07.967213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:07.992658 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] Creating event network-vif-plugged:1e6fb6e5-042f-43fe-91b0-321ce954cb37 for instance f9d37317-eff3-4440-a524-e9a93db129a9 on nch2-master-1 Aug 27 21:24:07.998991 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b667885f-d977-451b-80fc-6d265157882a req-ffee1b57-79fc-4874-91bb-d81def68bf66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048608 Aug 27 21:24:08.000274 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3146/6187] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:08.051528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:08.051528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:08.064618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:08.065117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:08.065749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:08.066649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:08.067143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:08.075951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:08.238490 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9490fd2e-b5cd-435f-a0c8-781384cf6a33 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.199105 Aug 27 21:24:08.239803 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3042/6188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:08 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:08.329674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:08.330521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:08.338846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:08.339500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:08.340217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:08.341010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:08.341537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:08.342034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:08.574243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:08.583854 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4eb272d2-f3aa-4340-b95c-ac8242618cb8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1647 microversion: 2.1 time: 0.259433 Aug 27 21:24:08.584973 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3147/6189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:08 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1647 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:09.094336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd0f8c5-ad6d-4229-95cb-640226fe3f0b", "name": "network-vif-deleted", "tag": "3726135b-81f3-445e-8fce-6a5d5b9e4a23"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:09.106774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.107864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.108312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.121333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] Creating event network-vif-deleted:3726135b-81f3-445e-8fce-6a5d5b9e4a23 for instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b on nch1-master-1 Aug 27 21:24:09.129692 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-7a6ba496-db6e-41ca-95cd-ea08380e2761 req-d87d4576-39a2-4a1d-a98e-2c0f193ffd8e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040122 Aug 27 21:24:09.130893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3043/6190] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:09.263608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:09.264355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:09.278532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.280771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.281713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.282597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.285991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.289474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.609590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:09.610954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:09.651999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.652487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.652939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.654718 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd60534c-98eb-4c1f-b43e-addb0251b82b tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1464 microversion: 2.1 time: 0.394727 Aug 27 21:24:09.655635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.657546 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3148/6191] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:09 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:09.658171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.658967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.793578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:09.796050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:09.799432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:09.800230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lazy-loading 'fault' on Instance uuid bcd0f8c5-ad6d-4229-95cb-640226fe3f0b {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:09.890509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b8f5ffc3f34f0bb499e7915dab4a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8871159ebe10493da1f399f35af1551d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:09.902682 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5fd9f8de-89cd-4575-8090-ac9682cb66bc tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 200 len: 1383 microversion: 2.1 time: 0.299999 Aug 27 21:24:09.916814 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3044/6192] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:09 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 1383 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:10.679170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:10.680665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:10.691664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:10.693139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:10.694017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:10.695074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:10.695629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:10.696586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:10.925867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:10.926801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] [instance: bcd0f8c5-ad6d-4229-95cb-640226fe3f0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:10.948979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:10.949887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:10.951545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:10.952708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:10.953269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:10.953978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:10.973876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] HTTP exception thrown: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Request method failure captured: Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b HTTP/1.1 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCorfjtaR6nIIj_Nr4W6GUQ3mHCzDx1tYBH4WCp_x3D1pM9rhA58p8M1xyCQowOWki_ijr2XWeKUS7LC5kI6pwnZECMekgp5SFvLSdC0-T0mm0NGlVCUpl-DMbiIB8ZWmot8g9gO4qrdO5PhKv5AN9m-qYt41HHjZlEpTiz-W4HoBx3s Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8871159ebe10493da1f399f35af1551d Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8871159ebe10493da1f399f35af1551d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8871159ebe10493da1f399f35af1551d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8871159ebe10493da1f399f35af1551d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8871159ebe10493da1f399f35af1551d"}]}] Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8871159ebe10493da1f399f35af1551d Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-368624320 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestSecurityGroupsBasicOps-368624320-project Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 06b8f5ffc3f34f0bb499e7915dab4a80 Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestSecurityGroupsBasicOps-368624320-project Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'bcd0f8c5-ad6d-4229-95cb-640226fe3f0b'} Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:10.975949 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. Aug 27 21:24:10.980906 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:10.988141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Returning 404 to user: Instance bcd0f8c5-ad6d-4229-95cb-640226fe3f0b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:24:10.989933 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36f43614-fc7d-414f-b247-b0761c85224e tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b" status: 404 len: 111 microversion: 2.1 time: 0.068604 Aug 27 21:24:10.990727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3045/6193] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:10 2022] GET /compute/v2.1/servers/bcd0f8c5-ad6d-4229-95cb-640226fe3f0b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:24:11.117623 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b327700-90a9-44e1-a1fe-4ea1aaa79e08 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1648 microversion: 2.1 time: 0.442976 Aug 27 21:24:11.118657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3149/6194] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:10 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1648 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:11.137985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:11.138936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:11.146480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:11.147691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:11.148464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:11.149418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:11.150621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:11.152180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:11.474347 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a51f2729-f346-45d4-a3a9-eef32d9131f4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1648 microversion: 2.1 time: 0.340074 Aug 27 21:24:11.475357 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3046/6195] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:11 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1648 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:11.495040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:11.495685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:11.502560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:11.503050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:11.503513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:11.504477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:11.505140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:11.505717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:11.838963 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ef21fc97-d6b0-4c17-95fe-3f1f87d01849 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1648 microversion: 2.1 time: 0.347708 Aug 27 21:24:11.840304 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3150/6196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:11 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1648 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:12.089640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1884861370", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "ab4da7ab-9ca7-42af-9d9d-53cc3303bddf"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:12.172972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] validate_networks() for [('ab4da7ab-9ca7-42af-9d9d-53cc3303bddf', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:24:13.258721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:24:13.259745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:24:13.259745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:24:13.260353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:24:13.260767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:24:13.273140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:13.273590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:13.274032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:13.274771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:13.275426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:13.276112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:13.301662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Getting quotas for project a0e17e61aa354b11864349de5d5c6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:24:13.338499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Getting quotas for user 7dead7ab5f834c8d9c260c7cf443ad64 and project a0e17e61aa354b11864349de5d5c6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:24:13.367014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:24:13.370978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:24:13.485205 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d2d1ef8-a09f-46b3-98a8-fb5678e43501 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400455 Aug 27 21:24:13.490071 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3047/6197] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:24:13.504784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5fe93e8f-5dde-4f9d-a77b-c753f8cc162a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:13.506649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5fe93e8f-5dde-4f9d-a77b-c753f8cc162a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:13.689977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5fe93e8f-5dde-4f9d-a77b-c753f8cc162a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1329 microversion: 2.1 time: 0.190258 Aug 27 21:24:13.700619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3151/6198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:13 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1329 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:14.711028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:14.711770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:14.732001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:14.732504 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:14.732953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:14.733678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:14.735763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:14.736231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:14.911233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dda81c60-6b38-4a46-9cee-fa54ffe22852 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1416 microversion: 2.1 time: 0.202056 Aug 27 21:24:14.913591 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3048/6199] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:14 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1416 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:15.951451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:15.954527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:15.986360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:15.986673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:15.995004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:15.995907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:15.996530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:15.997337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:16.159842 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d57180ca-ec7c-47e3-b12e-dc28e43bacc4 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1422 microversion: 2.1 time: 0.225450 Aug 27 21:24:16.161453 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3152/6200] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:15 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1422 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:17.184238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:17.185737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:17.199953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:17.218130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:17.218832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:17.219797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:17.220424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:17.221039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:18.054121 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f303462-ef0c-4d3f-8aac-e287c8f93435 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.875627 Aug 27 21:24:18.058701 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3049/6201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:17 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:18.158578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c380468-3553-4470-94e2-8834da2b8d3b", "tag": "e59041af-cb10-4edb-80ba-795802d0d8ed"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:18.175483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:18.194580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:18.195196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:18.228430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] Creating event network-changed:e59041af-cb10-4edb-80ba-795802d0d8ed for instance 4c380468-3553-4470-94e2-8834da2b8d3b on nch1-master-1 Aug 27 21:24:18.234978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6a80c2a2-545a-4ec0-a980-519f8039b293 req-7bb3866a-8dd1-4171-868d-0f1d85bb201e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090510 Aug 27 21:24:18.235682 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3153/6202] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:18.366938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cd84cc5-2922-4a64-ba40-2aaf3a17c2d8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] Calling method '.version_select at 0x7ff84f650550>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:18.413077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cd84cc5-2922-4a64-ba40-2aaf3a17c2d8 tempest-TestSecurityGroupsBasicOps-368624320 tempest-TestSecurityGroupsBasicOps-368624320-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-887459505" status: 202 len: 0 microversion: 2.1 time: 0.050186 Aug 27 21:24:18.413690 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3050/6203] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-887459505 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:24:19.082256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:19.083230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:19.093165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:19.094102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:19.095604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:19.096719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:19.097513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:19.098148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:19.362523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-010cc540-2525-447c-82ab-05563a70d335 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.285989 Aug 27 21:24:19.363130 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3154/6204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:19 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:20.386931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:20.388372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:20.397666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:20.399061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:20.399984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:20.401373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:20.402625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:20.404398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:20.573163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:20.576652 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51165679-b1f5-40e3-b4a2-8493729dfea1 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.196589 Aug 27 21:24:20.577428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3051/6205] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:20 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:21.600981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:21.602213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:21.618198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:21.620407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:21.622143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:21.623406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:21.624926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:21.625638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:22.049255 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a74740f9-49f1-4be3-bc56-2231ca19568e tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.453489 Aug 27 21:24:22.060247 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3155/6206] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:21 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:23.086682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:23.088056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:23.100261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:23.101898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:23.104420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:23.107698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:23.110184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:23.111051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:23.289396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:23.352582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:23.796718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-67cf0df5-ffa2-420d-a9da-61007fd07df0 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.721737 Aug 27 21:24:23.811623 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3052/6207] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:23 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:24.412816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:24.413249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:24.424292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:24.431514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:24.432358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:24.432700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:24.433423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:24.440599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:24.441053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:24.820276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:24.821095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:24.846156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:24.847310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:24.851527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:24.855358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:24.856579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:24.858176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:25.028016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lazy-loading 'services' on Instance uuid 813f2409-4b32-4046-aeea-6b57e0150810 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:25.161339 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810/os-volume_attachments/78f14686-a6e3-4290-b213-3298d690e345" status: 202 len: 0 microversion: 2.1 time: 0.752458 Aug 27 21:24:25.163490 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3156/6208] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:24:24 2022] DELETE /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810/os-volume_attachments/78f14686-a6e3-4290-b213-3298d690e345 => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:24:25.384312 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6fbc4f2-252f-4d48-92d7-93cd0d056270 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.568216 Aug 27 21:24:25.388253 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3053/6209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:24 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:24:25.921942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c380468-3553-4470-94e2-8834da2b8d3b", "name": "network-vif-plugged", "status": "completed", "tag": "e59041af-cb10-4edb-80ba-795802d0d8ed"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:25.940478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:25.941281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:25.941816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.002508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] Creating event network-vif-plugged:e59041af-cb10-4edb-80ba-795802d0d8ed for instance 4c380468-3553-4470-94e2-8834da2b8d3b on nch1-master-1 Aug 27 21:24:26.054770 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-022b8b4c-9f4d-4485-bc93-ed19a91ed648 req-bf9c5230-d897-4d9f-8586-6014b0826488 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135140 Aug 27 21:24:26.065703 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3157/6210] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:26.414084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:26.418614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:26.419912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:26.422746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:26.434165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.435231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.436282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.437344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.438044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.438696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.448718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.452689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.453875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.457162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.457663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.458102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.477451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:24:26.566913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:26.622935 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97b6ce35-d6e3-4459-92ba-cc97bbf96ef2 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "DELETE /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 204 len: 0 microversion: 2.1 time: 0.212370 Aug 27 21:24:26.626072 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3158/6211] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:24:26 2022] DELETE /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:24:26.640247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:26.641336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:26.649340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.650879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.651606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.653121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:26.653828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:26.654536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:26.992597 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-031fca99-c962-4a04-ba72-729bbcf3e563 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.584023 Aug 27 21:24:26.993226 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3054/6212] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:26 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:27.026084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:27.095389 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0e6353b5-0c1a-4788-ac40-6642b1258d82 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1513 microversion: 2.1 time: 0.451876 Aug 27 21:24:27.096311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3159/6213] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:26 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1513 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:28.013913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:28.014550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:28.024879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:28.025948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:28.027841 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:28.030019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:28.030697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:28.031437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:28.122551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:28.122954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:28.135492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:28.158695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:28.159310 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:28.160318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:28.166316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:28.173803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:28.692219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:28.704637 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a350e5f-fb79-42bc-94e3-9555d01884b4 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1513 microversion: 2.1 time: 0.587653 Aug 27 21:24:28.706282 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3160/6214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:28 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1513 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:28.721513 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dbeef597-4fc9-403d-b010-939a77983395 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1464 microversion: 2.1 time: 0.709584 Aug 27 21:24:28.726549 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3055/6215] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:28 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1464 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:29.415890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1340643488", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "0df2d588-cba6-4056-bcc0-954102e43f0a"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:29.495655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] validate_networks() for [('0df2d588-cba6-4056-bcc0-954102e43f0a', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:24:29.741667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:29.742401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:29.754550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:29.755021 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:29.759697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:29.761332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:29.763261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:29.766466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:29.984126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f8c78c1134e4202b1e571b37d84b6ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b1b49ecb334270a40234aa2e1a16ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:29.994290 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2d38719d-7ddb-4049-93b3-aa55017f7dec tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 200 len: 1471 microversion: 2.1 time: 0.268756 Aug 27 21:24:29.999883 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3056/6216] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:29 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:30.005892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:30.006519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:30.022904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.025511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.026041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.026756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.027217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.029473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.426796 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa2f1bba-b6c8-4465-bb11-533d83480c2d tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1649 microversion: 2.1 time: 0.425693 Aug 27 21:24:30.443853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:24:30.445477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:24:30.448354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:24:30.449317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:24:30.451083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:24:30.463080 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3057/6217] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:29 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1649 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:30.472994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813f2409-4b32-4046-aeea-6b57e0150810", "name": "network-vif-deleted", "tag": "9066a04e-ba7f-4ee5-8922-c87cdd992646"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:30.526358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.530542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.533282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.533772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.534204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.535272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.540529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.546756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.550350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.567723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] Creating event network-vif-deleted:9066a04e-ba7f-4ee5-8922-c87cdd992646 for instance 813f2409-4b32-4046-aeea-6b57e0150810 on nch2-master-1 Aug 27 21:24:30.576507 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ded41c9d-e5fa-4f2a-9374-69fd421492d5 req-90bf944a-5cf6-4cf1-92e1-0d78ae74a1c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111569 Aug 27 21:24:30.577893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3058/6218] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:30.586121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:30.587180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:30.596154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.597547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.598149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.599044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:30.599689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:30.600365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:30.624990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Getting quotas for project 804dcbb6b47044acad96ccd20a35f179. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:24:30.661923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Getting quotas for user 30966555091543939a7f4e3ccf8aab0b and project 804dcbb6b47044acad96ccd20a35f179. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:24:30.702892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:24:30.710090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:24:30.805919 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b31b0e2b-8bb6-4906-b03a-8a2348f4b488 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660288 Aug 27 21:24:30.812694 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3161/6219] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:24:30.820166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd07b87a-2d66-485c-9d9f-ee41268f2a6e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:30.823454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd07b87a-2d66-485c-9d9f-ee41268f2a6e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:30.945128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd07b87a-2d66-485c-9d9f-ee41268f2a6e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:30.956226 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd07b87a-2d66-485c-9d9f-ee41268f2a6e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1215 microversion: 2.1 time: 0.141957 Aug 27 21:24:30.971523 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3162/6220] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:30 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:24:31.023328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:31.024017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] [instance: 813f2409-4b32-4046-aeea-6b57e0150810] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:31.048230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb368d23-4cb7-4d53-a741-94fdbb2afc80 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1649 microversion: 2.1 time: 0.466125 Aug 27 21:24:31.053839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.054361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.054813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.055577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.056102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.060048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.064882 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3059/6221] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:30 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1649 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:31.082738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:31.083516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:31.097011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] HTTP exception thrown: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Request method failure captured: Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 HTTP/1.1 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCopzUKwbOJfKwqXQcmWpXlJbFEvoTM1PrtSRqsrL0F7bfBRqRYl6cbCQZQQZJAr01rej_f_G_4WCOfU0-UuWWRC1Tyze1p8LIydHbEW2j5l-WnW0hAabti7LAgp6cnbH3ynsSiVVyLJ1gL57oLHaq0iKLh0YgCw3IOOfIBfcZP28DHw Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: c4b1b49ecb334270a40234aa2e1a16ce Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4b1b49ecb334270a40234aa2e1a16ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c4b1b49ecb334270a40234aa2e1a16ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c4b1b49ecb334270a40234aa2e1a16ce", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c4b1b49ecb334270a40234aa2e1a16ce"}]}] Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: c4b1b49ecb334270a40234aa2e1a16ce Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-104348141 Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-VolumesSnapshotTestJSON-104348141-project Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9f8c78c1134e4202b1e571b37d84b6ca Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-VolumesSnapshotTestJSON-104348141-project Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '813f2409-4b32-4046-aeea-6b57e0150810'} Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:31.098901 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. Aug 27 21:24:31.105220 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:24:31.106260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.106260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.106260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.106260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.106834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.108954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] Returning 404 to user: Instance 813f2409-4b32-4046-aeea-6b57e0150810 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:24:31.109140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.109295 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cfda6361-be3d-4946-bd39-579cb36566b7 tempest-VolumesSnapshotTestJSON-104348141 tempest-VolumesSnapshotTestJSON-104348141-project] 10.222.0.40 "GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810" status: 404 len: 111 microversion: 2.1 time: 0.089804 Aug 27 21:24:31.109295 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3163/6222] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:31 2022] GET /compute/v2.1/servers/813f2409-4b32-4046-aeea-6b57e0150810 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:24:31.632585 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42c95a81-5ad3-45c4-8f64-1422c54f2d15 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1649 microversion: 2.1 time: 0.558230 Aug 27 21:24:31.633212 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3060/6223] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:31 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1649 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:31.654053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:31.655284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:31.675113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.680327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.681025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.682530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.683547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.683824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.735242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:24:31.898885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbbc10bc-e7c4-4d3d-9962-74e02f1efe4f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 204 len: 0 microversion: 2.1 time: 0.246888 Aug 27 21:24:31.903029 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3164/6224] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:24:31 2022] DELETE /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:24:31.910920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:31.911926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:31.920555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:31.922304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.922881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.923375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.924302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.925163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.926802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.980114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:31.980986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:31.990264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.993410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.995156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:31.997353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:31.997833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:31.999521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:32.113406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:32.133523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-305b6a18-bcf0-4f03-97a6-123e558d5922 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1219 microversion: 2.1 time: 0.157188 Aug 27 21:24:32.134773 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3165/6225] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:31 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:24:32.323987 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9d66b0d0-7f2b-48fc-86b2-0f658c0b394f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1655 microversion: 2.1 time: 0.418838 Aug 27 21:24:32.328516 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3061/6226] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:31 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1655 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:33.157690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:33.159820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:33.172034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:33.173093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:33.174907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:33.176261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:33.177553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:33.180416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:33.352329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:33.353615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:33.384068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:33.388781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:33.418007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:33.420323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:33.424124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:33.424644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:33.505074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:33.516636 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dbdbd19e-9cb1-4d07-911a-6568c93dcf00 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1219 microversion: 2.1 time: 0.363426 Aug 27 21:24:33.517410 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3166/6227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:33 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1219 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:33.901911 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1f71ff66-e023-4901-a4d3-79e6f6ffde45 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1655 microversion: 2.1 time: 0.551471 Aug 27 21:24:33.914979 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3062/6228] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:33 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1655 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:24:34.537982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:34.542813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:34.566043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:34.588119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:34.590415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:34.598021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:34.601956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:34.604747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:34.608507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:34.944962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:34.952249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:34.973637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:34.975730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:34.976445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:34.977680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:34.978676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:34.979520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:35.041101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:35.058592 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07629ee0-b13d-4de7-8416-1b2af136e875 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1275 microversion: 2.1 time: 0.521219 Aug 27 21:24:35.061904 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3167/6229] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:34 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1275 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:35.752921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-99ac4cec-f373-4205-a1af-02e9b55e351a tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1655 microversion: 2.1 time: 0.821203 Aug 27 21:24:35.758316 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3063/6230] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:34 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1655 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:36.100769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:36.101584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:36.152975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.153490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.168872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.170756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.171250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.171739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.181646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c380468-3553-4470-94e2-8834da2b8d3b", "name": "network-vif-deleted", "tag": "e59041af-cb10-4edb-80ba-795802d0d8ed"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:36.235121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.236031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.239131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.320767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] Creating event network-vif-deleted:e59041af-cb10-4edb-80ba-795802d0d8ed for instance 4c380468-3553-4470-94e2-8834da2b8d3b on nch1-master-1 Aug 27 21:24:36.345813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-543078f9-8c15-4dfe-85b8-b73e66e5c00d req-aa2b6ccb-6f6a-412e-80cb-4d02eabaf8fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168218 Aug 27 21:24:36.351899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3064/6231] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:36.774549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:36.793041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:36.793864 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2935392-c0e4-49a6-a514-365fe60b21c6 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1273 microversion: 2.1 time: 0.696917 Aug 27 21:24:36.794105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:36.795381 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3168/6232] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:36 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1273 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:36.812170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.813127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.814237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.824845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.826870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.827788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.886141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:36.887257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:36.888024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:36.888810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lazy-loading 'fault' on Instance uuid 4c380468-3553-4470-94e2-8834da2b8d3b {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:36.969455 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2202bc4a-a28b-4f4b-9746-e1022a7df1c7 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 200 len: 1454 microversion: 2.1 time: 0.182567 Aug 27 21:24:36.971806 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3065/6233] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:36 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:37.821776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:37.823142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:37.838895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:37.839448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:37.850533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:37.851495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:37.852147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:37.852993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:37.999171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:38.000422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: 4c380468-3553-4470-94e2-8834da2b8d3b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:38.013734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.014323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.017301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.018083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.018619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.019560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.042173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] HTTP exception thrown: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Request method failure captured: Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b HTTP/1.1 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCotnhTtHL311cpEh8iU3tOqGcpRM-m4UZk0XcuSWUPLHkOIKwaqol3z7jVJuJiSYuOmkxmBkcQlqMmLmdAtj_oZ9eNN_LASiiilSjTuX-w-6aAgqkF89h0iRrbYfxVRbivzry5cNDBZW16Jodl_PTqzgQUBgKzI2ALEyMuKcEpd6e7I Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a0e17e61aa354b11864349de5d5c6a54 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestServerMultinode-1692266343 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0e17e61aa354b11864349de5d5c6a54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0e17e61aa354b11864349de5d5c6a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0e17e61aa354b11864349de5d5c6a54", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0e17e61aa354b11864349de5d5c6a54"}]}] Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestServerMultinode-1692266343 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a0e17e61aa354b11864349de5d5c6a54 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestServerMultinode-1692266343 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestServerMultinode-1692266343-project-admin Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7dead7ab5f834c8d9c260c7cf443ad64 Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestServerMultinode-1692266343-project-admin Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '4c380468-3553-4470-94e2-8834da2b8d3b'} Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:38.060329 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Returning 404 to user: Instance 4c380468-3553-4470-94e2-8834da2b8d3b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:24:38.064247 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4285267-c77b-4937-955c-6c63fff02af9 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b" status: 404 len: 111 microversion: 2.1 time: 0.066650 Aug 27 21:24:38.066084 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3066/6234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:37 2022] GET /compute/v2.1/servers/4c380468-3553-4470-94e2-8834da2b8d3b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:24:38.070806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:38.071495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:38.093684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.094182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.094637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.095394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.095852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.096441 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.138654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:24:38.293959 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-93a1f762-a3b3-4f08-8819-34b88b33b69f tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "DELETE /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 204 len: 0 microversion: 2.1 time: 0.226394 Aug 27 21:24:38.299239 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3067/6235] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:24:38 2022] DELETE /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:24:38.312741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:38.313500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:38.328944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.329363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.332896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.333864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.336054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.336561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.401113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:38.529037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:38.554881 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a1db5fd0-453e-4b50-b2f3-544c47ccfc2b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.730458 Aug 27 21:24:38.557206 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3169/6236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:37 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:38.583191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64", "tag": "920e49e8-9294-42e5-a4d6-92d63d6f8a1a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:38.599651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:38.600462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:38.600993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:38.626785 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] Creating event network-changed:920e49e8-9294-42e5-a4d6-92d63d6f8a1a for instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 on nch1-master-1 Aug 27 21:24:38.643653 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-92957d17-450d-4b71-8a1b-a7d8eb6867f2 req-3e1c915d-294b-4d07-90f6-4b27b2b41cec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069331 Aug 27 21:24:38.644848 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3170/6237] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:38.840245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c07d11b4-d4a3-4b1a-a27c-14bbeae19510 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1654 microversion: 2.1 time: 0.539323 Aug 27 21:24:38.840871 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3068/6238] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:38 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1654 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:39.583923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:39.585367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:39.598787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:39.599458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:39.599899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:39.600786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:39.601874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:39.605897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:39.864281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:39.864972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:39.874993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:39.875810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:39.876414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:39.877340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:39.877993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:39.878607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:39.893809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:39.909674 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-62c0f303-eedd-4bf9-89e7-2368a5df7100 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.330925 Aug 27 21:24:39.912710 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3171/6239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:39 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:40.515807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3129a00-2346-4342-85ab-037e42f03862 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1654 microversion: 2.1 time: 0.654831 Aug 27 21:24:40.519321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3069/6240] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:39 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1654 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:40.934740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:40.936100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:40.939401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:40.955289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:40.979361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:40.980276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:40.981820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:40.983437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:40.984070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:40.985457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:41.402815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d37317-eff3-4440-a524-e9a93db129a9", "name": "network-vif-deleted", "tag": "1e6fb6e5-042f-43fe-91b0-321ce954cb37"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:41.427586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:41.428094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:41.432879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:41.471902 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] Creating event network-vif-deleted:1e6fb6e5-042f-43fe-91b0-321ce954cb37 for instance f9d37317-eff3-4440-a524-e9a93db129a9 on nch2-master-1 Aug 27 21:24:41.478641 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4b4e9389-afc1-4858-94b8-69e1b7033687 req-2db7d3d4-bdc2-4293-9b26-a47478b5b86f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083943 Aug 27 21:24:41.479782 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3070/6241] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:24:41.538650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:41.539790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:41.589505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:41.591431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:41.592729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:41.596101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:41.598098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:41.605833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:41.758175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:41.758729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:41.761634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:41.762150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lazy-loading 'fault' on Instance uuid f9d37317-eff3-4440-a524-e9a93db129a9 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:41.959536 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eda837bb-155a-41dd-a98d-196100369066 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 200 len: 1454 microversion: 2.1 time: 0.424554 Aug 27 21:24:41.960134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3071/6242] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:41 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 1454 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:41.981371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:41.997117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-af59d937-1599-4071-bd04-fac84bcf6862 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 1.066360 Aug 27 21:24:42.019627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3172/6243] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:40 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:42.982242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:42.982943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] [instance: f9d37317-eff3-4440-a524-e9a93db129a9] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:42.992430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:42.994304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:42.994815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:42.995735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:42.996474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:42.997528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:43.014648 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] HTTP exception thrown: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. Aug 27 21:24:43.025890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Request method failure captured: Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 HTTP/1.1 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCotnhTtHL311cpEh8iU3tOqGcpRM-m4UZk0XcuSWUPLHkOIKwaqol3z7jVJuJiSYuOmkxmBkcQlqMmLmdAtj_oZ9eNN_LASiiilSjTuX-w-6aAgqkF89h0iRrbYfxVRbivzry5cNDBZW16Jodl_PTqzgQUBgKzI2ALEyMuKcEpd6e7I Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a0e17e61aa354b11864349de5d5c6a54 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestServerMultinode-1692266343 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0e17e61aa354b11864349de5d5c6a54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0e17e61aa354b11864349de5d5c6a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0e17e61aa354b11864349de5d5c6a54", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0e17e61aa354b11864349de5d5c6a54"}]}] Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestServerMultinode-1692266343 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a0e17e61aa354b11864349de5d5c6a54 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestServerMultinode-1692266343 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestServerMultinode-1692266343-project-admin Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 7dead7ab5f834c8d9c260c7cf443ad64 Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestServerMultinode-1692266343-project-admin Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'f9d37317-eff3-4440-a524-e9a93db129a9'} Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:24:43.026268 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. Aug 27 21:24:43.029210 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:24:43.029667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:43.029734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] Returning 404 to user: Instance f9d37317-eff3-4440-a524-e9a93db129a9 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:24:43.030100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0dc9945-907a-4b25-9bdc-0b8f2b205929 tempest-TestServerMultinode-1692266343 tempest-TestServerMultinode-1692266343-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9" status: 404 len: 111 microversion: 2.1 time: 0.051623 Aug 27 21:24:43.035060 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3072/6244] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:42 2022] GET /compute/v2.1/servers/f9d37317-eff3-4440-a524-e9a93db129a9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:24:43.063210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:43.065932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:43.066414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:43.067189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:43.067681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:43.069814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:43.498352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:43.511166 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ab37fd61-1f64-4edf-a2fa-5d1d2822e711 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.489566 Aug 27 21:24:43.526389 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3173/6245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:43 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:44.536466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:44.537789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:44.547453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:44.548379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:44.549147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:44.550123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:44.550779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:44.552797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:44.883503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:44.896449 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed6e6f4b-60b1-42e4-acc9-18973a02ab81 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.364347 Aug 27 21:24:44.923899 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3073/6246] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:44 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:45.796589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64", "name": "network-vif-plugged", "status": "completed", "tag": "920e49e8-9294-42e5-a4d6-92d63d6f8a1a"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:45.808902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:45.809835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:45.810614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:45.851246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] Creating event network-vif-plugged:920e49e8-9294-42e5-a4d6-92d63d6f8a1a for instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 on nch1-master-1 Aug 27 21:24:45.857978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f3e62439-46a5-4118-911d-6e66d5788d2e req-a85cc369-36c6-44ae-a2c4-47fad15428b3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065279 Aug 27 21:24:45.859259 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3174/6247] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:24:45.963468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:45.966848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:45.983245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:45.984009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:45.984760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:45.985730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:45.987531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:46.004602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:46.507962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:46.529517 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb77cd50-0030-474c-a404-0b84f2f0090a tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.583006 Aug 27 21:24:46.530490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3074/6248] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:45 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:47.553981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:47.554854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:47.564257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:47.565090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:47.565751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:47.566764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:47.567484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:47.568091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:47.871158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:47.881119 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6292dd6-e559-4bb0-8146-e3dc31ab956b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1315 microversion: 2.1 time: 0.332187 Aug 27 21:24:47.895365 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3175/6249] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:47 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:48.905437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:48.906083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:48.916105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:48.916962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:48.917629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:48.918560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:48.919248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:48.919927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.160607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:49.172363 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9e5e6516-34f1-49c6-a849-0d5eee32b814 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1502 microversion: 2.1 time: 0.271780 Aug 27 21:24:49.173021 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3075/6250] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:48 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:49.193503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:49.194125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:49.200898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.201394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.201840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.202606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.203068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.203858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.448435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:49.458422 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-806de66c-c7a1-4a9a-9b65-53a352278c30 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1502 microversion: 2.1 time: 0.268962 Aug 27 21:24:49.459689 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3176/6251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:49 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:24:49.480412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:49.480957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:49.487593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.488091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.488530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.489228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.489772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.490203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.518153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lazy-loading 'flavor' on Instance uuid 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:49.610435 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-973d2a4c-fade-46bd-974b-22015fede2ac tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action" status: 202 len: 0 microversion: 2.1 time: 0.134511 Aug 27 21:24:49.611309 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3076/6252] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:24:49 2022] POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:24:49.619617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:49.620325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:49.627265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.627795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.628264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.629056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:49.629532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:49.630200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:49.649576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:50.171519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:50.182163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29b0abbf-60f9-45d5-8fa3-710d049c288e tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1510 microversion: 2.1 time: 0.566734 Aug 27 21:24:50.197486 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3177/6253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:49 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:51.210263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:51.211512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:51.221641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.222730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.223257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.224634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.225115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.225557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.411914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:51.421586 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-22acbade-43cb-45f6-be4f-8f94d3d351f0 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1493 microversion: 2.1 time: 0.219456 Aug 27 21:24:51.421991 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3077/6254] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:51 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:51.444375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:51.445519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:51.462405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.462978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.463703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.464452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.464908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.465647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.549524 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2d973d3c-16ce-4563-a3b7-12e654b366e3 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action" status: 202 len: 0 microversion: 2.1 time: 0.109962 Aug 27 21:24:51.553615 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3178/6255] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:24:51 2022] POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:24:51.558733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:51.559417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:51.566721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.567427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.568044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.569627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:51.570113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:51.570591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:51.816237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:51.827502 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f860c765-54be-4777-bda8-9994e438d95f tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1499 microversion: 2.1 time: 0.272593 Aug 27 21:24:51.828946 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3078/6256] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:51 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1499 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:52.850761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:52.851501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:52.866030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:52.867313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:52.872435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:52.873969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:52.876894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:52.878909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:53.190141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:53.201153 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1548cd72-cee6-4c4c-91d6-3e2c3fac270d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1499 microversion: 2.1 time: 0.354560 Aug 27 21:24:53.201758 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3179/6257] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:52 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1499 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:54.227224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:54.228622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:54.237361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.238343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.238974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.241195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.241914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.242770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.415771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:54.425448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1b711acc-7c3f-40db-860b-ee8e7ec16322 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1502 microversion: 2.1 time: 0.202277 Aug 27 21:24:54.426048 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3079/6258] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:54 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:54.446694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:54.447242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:54.454460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.454966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.455445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.456161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.456640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.457072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.483596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lazy-loading 'flavor' on Instance uuid 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:24:54.567418 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d7f6c81-ddd4-4626-b3fa-f299a1f1f69d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action" status: 202 len: 0 microversion: 2.1 time: 0.124352 Aug 27 21:24:54.571135 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3180/6259] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:24:54 2022] POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:24:54.577364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:54.578123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:54.595882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.596827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.597321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.598278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:54.599501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:54.600139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:54.808032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:54.818751 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-033d816f-b57f-407d-aecf-ba1813a2b83d tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1510 microversion: 2.1 time: 0.245987 Aug 27 21:24:54.819566 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3080/6260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:54 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:55.848985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:55.849838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:55.856883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:55.857381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:55.857819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:55.858604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:55.859796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:55.859796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:56.077480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:56.085778 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b312dc11-070a-4e75-b040-30531f9c1d37 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1493 microversion: 2.1 time: 0.242009 Aug 27 21:24:56.086500 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3181/6261] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:55 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1493 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:56.107241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:24:56.107879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:56.114905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:56.115424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:56.115866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:56.116584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:56.117040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:56.117524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:56.191431 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34081dbf-70c6-475a-8de2-43ffd9ca6f01 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action" status: 202 len: 0 microversion: 2.1 time: 0.088218 Aug 27 21:24:56.192107 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3081/6262] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:24:56 2022] POST /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:24:56.202333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:56.203057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:56.209916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:56.211129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:56.211815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:56.212545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:56.213257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:56.213783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:56.453692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:56.463897 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b85e050a-a262-40b4-8946-2c7e7c835b87 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1499 microversion: 2.1 time: 0.266893 Aug 27 21:24:56.464552 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3182/6263] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:56 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:57.488042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:57.488752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:57.495511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:57.500979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:57.501408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:57.502467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:57.502918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:57.503567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:57.641836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:57.650696 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9cc2b4c-d641-4318-92ec-40ab3fa0e559 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1499 microversion: 2.1 time: 0.168917 Aug 27 21:24:57.651278 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3082/6264] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:57 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1499 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:58.672286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:58.672906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:58.681002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:58.681501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:58.681948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:58.682665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:58.683161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:58.683597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:58.819705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:58.827865 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-747b829b-313a-4317-82d7-8ace5917dd0c tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1502 microversion: 2.1 time: 0.159416 Aug 27 21:24:58.828366 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3183/6265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:58 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:24:58.849100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:58.849846 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:58.856999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:58.857549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:58.858077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:58.858842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:58.859371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:58.859891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:58.878496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:24:58.888052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:24:58.984122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44a93a89-a3ec-4a74-9e19-9b4f2bc0819b tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 204 len: 0 microversion: 2.1 time: 0.132812 Aug 27 21:24:58.984122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3083/6266] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:24:58 2022] DELETE /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:24:58.992923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:24:58.993884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:24:59.003804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:59.004303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:59.004740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:59.005448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:24:59.006149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:24:59.006807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:24:59.144801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:24:59.154056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25864d21-1e86-48d2-816b-27dba7df4a46 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1508 microversion: 2.1 time: 0.167329 Aug 27 21:24:59.155386 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3184/6267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:24:58 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:00.180422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:00.181129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:00.188394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:00.188888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:00.189330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:00.190032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:00.190499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:00.190930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:00.341409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:00.349947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f3f7aa91-b1bf-4afe-bc77-e1f0b820d431 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1508 microversion: 2.1 time: 0.176425 Aug 27 21:25:00.350506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3084/6268] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:00 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:01.392626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:01.393606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:01.415239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:01.417720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:01.418693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:01.420392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:01.424719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:01.425903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:01.702511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30966555091543939a7f4e3ccf8aab0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804dcbb6b47044acad96ccd20a35f179', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:01.713705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8497e904-c88c-4ec4-b94f-5378b2ddfad7 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 200 len: 1508 microversion: 2.1 time: 0.336445 Aug 27 21:25:01.715054 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3185/6269] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:01 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:01.946633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64", "name": "network-vif-deleted", "tag": "920e49e8-9294-42e5-a4d6-92d63d6f8a1a"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:01.961196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:01.961774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:01.962413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:01.978716 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] Creating event network-vif-deleted:920e49e8-9294-42e5-a4d6-92d63d6f8a1a for instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 on nch1-master-1 Aug 27 21:25:01.987985 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-02ba7cb9-2b46-4889-8f9f-53e16d9b6db3 req-5c5d7c57-17b4-462a-b641-ebb9d1e90297 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045865 Aug 27 21:25:02.004427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3085/6270] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:25:02.735494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:02.737560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] [instance: 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:02.751773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:02.752490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:02.752961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:02.754143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:02.754759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:02.755445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:02.772643 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] HTTP exception thrown: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Request method failure captured: Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 HTTP/1.1 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCouJV3KlaOeRv5y3teEta_LUnpZfUnIu7U7zmAnVt6dPXblbNVP1cEMsyFHx5oywlBDkrZb2HvXrZoLl0LpA-DifQGbSfFpBjdg-E11cjOMTqd3_mKwoUFQJM3LSGoiktbqnvpLGR1BIVlbnreS_rA8Q_0xB6z1KFzUWQJgy1_qGPNc Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 804dcbb6b47044acad96ccd20a35f179 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestServerAdvancedOps-430464778 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/804dcbb6b47044acad96ccd20a35f179"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/804dcbb6b47044acad96ccd20a35f179"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_804dcbb6b47044acad96ccd20a35f179", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/804dcbb6b47044acad96ccd20a35f179"}]}] Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestServerAdvancedOps-430464778 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 804dcbb6b47044acad96ccd20a35f179 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestServerAdvancedOps-430464778 Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestServerAdvancedOps-430464778-project Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 30966555091543939a7f4e3ccf8aab0b Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestServerAdvancedOps-430464778-project Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64'} Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:25:02.774761 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. Aug 27 21:25:02.778562 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:25:02.779981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] Returning 404 to user: Instance 4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:25:02.781060 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3f07ff34-37f5-4b26-9152-138d37b42969 tempest-TestServerAdvancedOps-430464778 tempest-TestServerAdvancedOps-430464778-project] 10.222.0.40 "GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64" status: 404 len: 111 microversion: 2.1 time: 0.050712 Aug 27 21:25:02.781928 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3186/6271] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:02 2022] GET /compute/v2.1/servers/4f0acfb4-adaa-42e9-ac5c-a8a7a54cdb64 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:25:04.743820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-116d0291-dec8-4888-b919-3497c522face tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: .version_select at 0x7ff857d1b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-537529291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKilCboyLB3VLQyGKnKeWNkvCcAFGFkvlze1DTrdWP7TfIvaJwUCu+14HNzKl4fRRlfPmnmCW/kOu70wtcNKdkfQOfc+MuNozIffC4hTa5nZKb+oEIeNqQ87AMUxCdBZlQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:04.763496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:04.800405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-116d0291-dec8-4888-b919-3497c522face tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:25:04.807600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-116d0291-dec8-4888-b919-3497c522face tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:25:04.864568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-116d0291-dec8-4888-b919-3497c522face tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.393269 Aug 27 21:25:04.865407 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3086/6272] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:25:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:14.942897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1635641958", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "574f4dbe-bdcb-4449-9f87-cb6819f26756"}], "key_name": "tempest-TestNetworkAdvancedServerOps-537529291", "security_groups": [{"name": "tempest-secgroup-smoke-2071460653"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:14.965290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=39 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:14.966260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:15.124114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] validate_networks() for [('574f4dbe-bdcb-4449-9f87-cb6819f26756', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:25:15.720596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:25:15.720596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:25:15.720596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:25:15.720596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:25:15.720596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:25:15.731748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:15.732680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:15.733486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:15.734575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:15.735199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:15.735830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:15.759314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:25:15.766260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:25:15.782634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:25:15.785094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:25:15.846349 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6204c03c-eba2-4a3d-b0e8-1a65c9ff1cc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.908569 Aug 27 21:25:15.853816 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3187/6273] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:25:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:25:15.857982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:15.859603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:15.860744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:15.870411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-18c2ce85-c231-4738-bdf2-d57a8df659e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:15.871278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-18c2ce85-c231-4738-bdf2-d57a8df659e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:15.977983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-18c2ce85-c231-4738-bdf2-d57a8df659e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:15.991772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-18c2ce85-c231-4738-bdf2-d57a8df659e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1266 microversion: 2.1 time: 0.136415 Aug 27 21:25:15.992819 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3087/6274] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:15 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:25:17.019154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:17.020407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:17.035913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:17.036427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:17.036899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:17.037653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:17.038119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:17.038878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:17.141465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:17.150819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8390de62-cca9-47b8-bb78-64a693b90d57 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1262 microversion: 2.1 time: 0.138467 Aug 27 21:25:17.151847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3188/6275] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:17 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1262 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:18.171794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:18.172410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:18.184300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:18.184797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:18.191376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:18.192314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:18.192932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:18.193509 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:18.295129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:18.310358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-16e7ca4e-b56a-4337-a935-8111a063509a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1324 microversion: 2.1 time: 0.142456 Aug 27 21:25:18.326583 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3088/6276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:18 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:19.341207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:19.341645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:19.349444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:19.350730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:19.351699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:19.352631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:19.353285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:19.353934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:19.558092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:19.566397 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94fe28fe-7ee6-4c4c-9047-f37c126871e4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.235983 Aug 27 21:25:19.567303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3189/6277] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:19 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:19.651242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:19.661653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:19.662133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:19.662562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:19.674823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] Creating event network-changed:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch1-master-1 Aug 27 21:25:19.681749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5c79ecc2-a7c2-4a57-a894-1f0023e4ca66 req-3302a6e1-f7c1-428a-94aa-7f24e1447611 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335365 Aug 27 21:25:19.682727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3089/6278] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:20.589552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:20.590421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:20.597891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:20.598506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:20.598956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:20.599694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:20.600182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:20.600612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:20.742909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:20.751163 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cc6a332c-32e9-4edc-9233-2cbc6278b326 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.166287 Aug 27 21:25:20.751778 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3190/6279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:20 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:21.776062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:21.776813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:21.783992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:21.784516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:21.784951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:21.785727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:21.786251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:21.786675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:21.925259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:21.934251 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aab9c676-b002-4869-be43-3edf08fbcb9c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.164429 Aug 27 21:25:21.935092 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3090/6280] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:21 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:22.963383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:22.963992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:22.970961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:22.971474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:22.971919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:22.972617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:22.973073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:22.973504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:23.128587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:23.137376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4dff43ba-d7c4-441b-b9d2-c115f6ea7c34 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.183155 Aug 27 21:25:23.137955 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3191/6281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:22 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:24.158395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:24.159011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:24.166967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:24.167502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:24.167946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:24.168653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:24.169120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:24.169588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:24.320211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:24.328545 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa1fe9a4-7c99-4cdf-a560-b31863363ae8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.174118 Aug 27 21:25:24.329344 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3091/6282] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:24 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:25.350669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:25.351315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:25.359091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:25.359622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:25.360074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:25.360775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:25.361236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:25.361680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:25.518883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:25.530107 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d30a85e3-35c5-4f98-96ee-a51d811179f3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.183184 Aug 27 21:25:25.530878 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3192/6283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:25 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:25.770010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "name": "network-vif-plugged", "status": "completed", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:25.780988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:25.781510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:25.782402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:25.794901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] Creating event network-vif-plugged:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch1-master-1 Aug 27 21:25:25.800243 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-83792f6c-249b-425b-b077-b9f671a67e8a req-2722a574-9c90-456a-8e18-dc895fa956d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Aug 27 21:25:25.800868 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3092/6284] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:26.551275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:26.551930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:26.553863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:26.554650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:26.561873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:26.562384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:26.562823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:26.563596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:26.564044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:26.564475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:26.714983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:26.723275 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-175e53b3-cfcb-4fb0-81a8-4f9b509724f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1392 microversion: 2.1 time: 0.176073 Aug 27 21:25:26.724020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3193/6285] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:26 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:27.745349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:27.750660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:27.751430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:27.758167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:27.758665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:27.759114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:27.759961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:27.760430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:27.761033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:27.905438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:27.914211 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa9baaea-ea62-4499-80f4-3c9eaa1f47ce tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1564 microversion: 2.1 time: 0.169925 Aug 27 21:25:27.914797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3093/6286] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:27 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:27.935712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:27.936316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:27.943314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:27.943845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:27.944289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:27.944996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:27.945517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:27.945894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:28.086978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:28.095050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-42ae19dc-d83b-4a2f-869a-29b5dc092996 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1564 microversion: 2.1 time: 0.163519 Aug 27 21:25:28.095696 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3194/6287] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:27 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:30.280588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:30.281291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:30.291647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:30.292160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:30.292607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:30.293339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:30.293805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:30.294241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:30.494698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:30.504795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f4c43ec7-8071-4ec0-8260-2f35d80c3cca tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1564 microversion: 2.1 time: 0.228261 Aug 27 21:25:30.522348 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3094/6288] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:30 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:30.577284 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:30.588695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:30.589663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:30.590260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:30.604630 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] Creating event network-changed:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch1-master-1 Aug 27 21:25:30.610005 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3d06dd3e-63eb-419e-8d1f-724fdb7cdfe0 req-d1ffb706-6754-4428-acb2-2584f8b7d4b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309519 Aug 27 21:25:30.611475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3195/6289] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:34.468604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-27641179", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:34.523377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:25:34.735412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:25:34.735895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:25:34.736378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:25:34.736796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:25:34.737223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:25:34.747496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:34.747989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:34.748434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:34.749163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:34.749631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:34.750064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:34.767656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Getting quotas for project c8abb21b54024d278659683e08e04633. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:25:34.773736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Getting quotas for user 8c40d90fca40448bad028604c202d6a8 and project c8abb21b54024d278659683e08e04633. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:25:34.787192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:25:34.789590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:25:34.838937 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0d7fd98d-9fdf-4e42-b594-4aa558a82684 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.373738 Aug 27 21:25:34.839851 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3095/6290] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:25:34.852413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-351cb87f-6058-4f7d-a89e-0f390b124eb4 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:34.853147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-351cb87f-6058-4f7d-a89e-0f390b124eb4 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:34.912379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-351cb87f-6058-4f7d-a89e-0f390b124eb4 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:34.920170 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-351cb87f-6058-4f7d-a89e-0f390b124eb4 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1212 microversion: 2.1 time: 0.073120 Aug 27 21:25:34.920752 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3196/6291] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:34 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:35.942998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:35.944693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:35.952452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:35.952988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:35.954176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:35.955068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:35.955754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:35.956439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:36.035199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:36.046990 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ae12b97-0de9-472a-8aa8-b0f3ac7d70b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1264 microversion: 2.1 time: 0.109294 Aug 27 21:25:36.048053 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3096/6292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:35 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1264 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:37.069170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:37.070006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:37.082037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:37.082536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:37.082980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:37.084084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:37.084537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:37.084979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:37.148902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:37.157367 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4279e97-f2e3-436e-af7c-1310e0888a7d tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1270 microversion: 2.1 time: 0.092260 Aug 27 21:25:37.157976 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3197/6293] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:37 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:38.178389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:38.179022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:38.186378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:38.186869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:38.187306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:38.188027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:38.189142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:38.189577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:38.330647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:38.339089 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b9a4c21-e7be-4c00-9788-022186812875 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.164642 Aug 27 21:25:38.339678 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3097/6294] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:38 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:38.469864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c63f99-8004-48a1-998d-02ba0444c686", "tag": "0e112524-fbce-4c3c-a118-385468a8d351"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:38.480862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:38.481374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:38.481805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:38.493388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] Creating event network-changed:0e112524-fbce-4c3c-a118-385468a8d351 for instance 68c63f99-8004-48a1-998d-02ba0444c686 on nch2-master-1 Aug 27 21:25:38.498891 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1703fbe1-657d-4c16-bcb1-e2cdda383d46 req-e9935969-22ee-4596-8cd9-fa57467af33a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Aug 27 21:25:38.499214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3198/6295] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:25:39.360727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:39.361357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:39.370410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:39.370923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:39.371434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:39.372129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:39.372609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:39.373031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:39.511584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:39.520253 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24ec11d3-fa78-4d8b-b3e6-ee871cc17e10 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.163586 Aug 27 21:25:39.520827 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3098/6296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:39 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:40.544389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:40.545163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:40.557671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:40.558181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:40.558810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:40.559934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:40.560518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:40.561394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:40.750388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:40.763493 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-707f1ba3-36dd-4495-b847-2658c9b981b3 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.225788 Aug 27 21:25:40.764317 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3199/6297] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:40 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:41.794802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:41.795417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:41.803172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:41.803699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:41.804134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:41.804832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:41.805283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:41.805703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:41.946372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:41.954934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b043b7f8-5d23-4bb6-af80-4428d94684da tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.165743 Aug 27 21:25:41.955542 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3099/6298] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:41 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:42.979017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:42.979747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:42.990224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:42.990992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:42.991701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:42.993003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:42.993983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:42.994530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:43.141525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:43.153321 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ae60956-ff45-40c0-9094-415343de32fa tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.179906 Aug 27 21:25:43.153912 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3200/6299] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:42 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:44.174985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:44.175647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:44.182714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:44.183261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:44.183725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:44.184439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:44.184905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:44.185337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:44.329457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:44.337777 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4d67eef9-6b4e-46fb-b81e-90748290b1a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.166871 Aug 27 21:25:44.338362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3100/6300] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:44 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:44.424211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c63f99-8004-48a1-998d-02ba0444c686", "name": "network-vif-plugged", "status": "completed", "tag": "0e112524-fbce-4c3c-a118-385468a8d351"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:44.434289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:44.434774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:44.435209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:44.446307 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] Creating event network-vif-plugged:0e112524-fbce-4c3c-a118-385468a8d351 for instance 68c63f99-8004-48a1-998d-02ba0444c686 on nch2-master-1 Aug 27 21:25:44.451890 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fe714bfe-31ea-4bf7-828b-47f933506cb7 req-9ae551de-cd69-4063-9393-89daf1ca0fa5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188572 Aug 27 21:25:44.452718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3201/6301] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:45.359173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:45.359843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:45.361770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:45.362593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:45.370176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:45.370958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:45.371261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:45.371992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:45.372464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:45.372924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:45.514356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:45.526099 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7fcfd66e-7774-4a1f-a68a-3ca9e30a0d6a tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1312 microversion: 2.1 time: 0.170943 Aug 27 21:25:45.526916 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3101/6302] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:45 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:46.550337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:46.551257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:46.553888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:46.555885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:46.563234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:46.563749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:46.564187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:46.564883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:46.565339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:46.565767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:46.568996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=69 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:46.717250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:46.726187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e1fe8d88-a79e-4f81-917f-7b4c4c704543 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1462 microversion: 2.1 time: 0.181229 Aug 27 21:25:46.726784 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3202/6303] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:46 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1462 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:46.747684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac109c2-38c9-422c-8c60-64286b1ad8a4", "device": "/dev/sdb"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:46.750215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:46.753040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:46.758768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:46.759265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:46.759743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:46.760447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:46.760911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:46.761367 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:46.765151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=73 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:25:47.047663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "POST /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304221 Aug 27 21:25:47.052040 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3102/6304] 10.222.0.40 () {60 vars in 1323 bytes} [Sat Aug 27 21:25:46 2022] POST /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:54.729874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:54.730407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:54.738204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:54.738704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:54.739150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:54.739906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:54.740377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:54.740811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:54.826272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lazy-loading 'services' on Instance uuid 68c63f99-8004-48a1-998d-02ba0444c686 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:25:54.902113 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686/os-volume_attachments/aac109c2-38c9-422c-8c60-64286b1ad8a4" status: 202 len: 0 microversion: 2.1 time: 0.176547 Aug 27 21:25:54.902718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3203/6305] 10.222.0.40 () {58 vars in 1416 bytes} [Sat Aug 27 21:25:54 2022] DELETE /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686/os-volume_attachments/aac109c2-38c9-422c-8c60-64286b1ad8a4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:25:56.034752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:56.035305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:56.042109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:56.042607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:56.043049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:56.043795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:56.044256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:56.044686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:56.079019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:25:56.163078 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1c076c8a-5f0c-41dc-8c72-1bd93ac13e71 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 204 len: 0 microversion: 2.1 time: 0.133545 Aug 27 21:25:56.163982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3103/6306] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:25:56 2022] DELETE /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:25:56.173171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:56.173870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:56.181914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:56.182406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:56.182843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:56.183564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:56.184016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:56.184436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:56.327036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:56.336035 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8dd364ad-e15a-49a0-9357-d0197254a62c tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1468 microversion: 2.1 time: 0.167076 Aug 27 21:25:56.336623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3204/6307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:56 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1468 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:57.358537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:57.359261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:57.367897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:57.368391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:57.368836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:57.369538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:57.370001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:57.370455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:57.511588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:57.520484 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-449e4f10-b6ce-47b5-a421-20052aaa4bd8 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1468 microversion: 2.1 time: 0.166378 Aug 27 21:25:57.521064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3104/6308] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:57 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1468 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:58.545442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:58.546102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:58.555397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:58.556190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:58.556818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:58.557918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:58.558565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:58.559181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:58.589642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c63f99-8004-48a1-998d-02ba0444c686", "name": "network-vif-deleted", "tag": "0e112524-fbce-4c3c-a118-385468a8d351"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:25:58.602042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:58.602535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:58.602957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:58.615713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] Creating event network-vif-deleted:0e112524-fbce-4c3c-a118-385468a8d351 for instance 68c63f99-8004-48a1-998d-02ba0444c686 on nch2-master-1 Aug 27 21:25:58.625163 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6f378a74-153d-4478-bcfa-960871febb52 req-f3af7d61-2a87-4798-afc0-f66256911f34 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039068 Aug 27 21:25:58.630015 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3105/6309] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:25:58.696044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8abb21b54024d278659683e08e04633', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:25:58.705942 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-958ae82e-a8ed-4197-b98f-360fa50caedd tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 200 len: 1426 microversion: 2.1 time: 0.167142 Aug 27 21:25:58.706881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3205/6310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:58 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 1426 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:25:59.739370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:25:59.740087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] [instance: 68c63f99-8004-48a1-998d-02ba0444c686] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:25:59.746795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:59.747295 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:59.747766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:59.748498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:25:59.748956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:25:59.749389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:25:59.763579 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] HTTP exception thrown: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Request method failure captured: Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 HTTP/1.1 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCovMvSYjtpqKtu9gVEEWbecjDynA4dFakxApQ6roFzpjEjX3eUAFoIJlkIkIjaN2QZWxjKELWCJ5-Q1vjUlx6PNDfdChHuu2SIJgwLGgHlJsrRsILz63FCK5aV99lXe1eF14ImxHwphba09f21qflYYnF6eieVrXdZdXsYzNkNKPNxk Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: c8abb21b54024d278659683e08e04633 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-VolumesBackupsTest-865856394 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8abb21b54024d278659683e08e04633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8abb21b54024d278659683e08e04633"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8abb21b54024d278659683e08e04633", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8abb21b54024d278659683e08e04633"}]}] Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-VolumesBackupsTest-865856394 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: c8abb21b54024d278659683e08e04633 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-VolumesBackupsTest-865856394 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-VolumesBackupsTest-865856394-project Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 8c40d90fca40448bad028604c202d6a8 Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-VolumesBackupsTest-865856394-project Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '68c63f99-8004-48a1-998d-02ba0444c686'} Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:25:59.765271 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] Returning 404 to user: Instance 68c63f99-8004-48a1-998d-02ba0444c686 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47e18b17-13e6-427f-9c91-31449dad8673 tempest-VolumesBackupsTest-865856394 tempest-VolumesBackupsTest-865856394-project] 10.222.0.40 "GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686" status: 404 len: 111 microversion: 2.1 time: 0.038454 Aug 27 21:25:59.769411 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3106/6311] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:25:59 2022] GET /compute/v2.1/servers/68c63f99-8004-48a1-998d-02ba0444c686 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:26:01.864701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:01.864701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:01.871600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:01.872095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:01.872537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:01.873241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:01.873980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:01.874392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:01.944946 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bcc40825-fff7-4f63-832b-23420c95145e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action" status: 200 len: 24569 microversion: 2.1 time: 0.088071 Aug 27 21:26:01.945623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3206/6312] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:26:01 2022] POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action => generated 24569 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:26:32.394964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:32.395946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:32.399167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:26:32.400190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:26:32.407013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.407529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.407974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:32.408665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.409107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.409527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:32.651786 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c62f640f-8fd0-4f88-a27b-5e23f28c1c71 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1834 microversion: 2.1 time: 0.262995 Aug 27 21:26:32.652382 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3107/6313] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:32 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1834 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:32.675089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:32.675861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:32.678664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=9 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:26:32.679377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:26:32.686599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.687124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.687599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:32.688305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.688765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.689198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:32.839474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:32.847867 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-713d47b9-6bb1-4b2f-9678-89e43bf0097a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1683 microversion: 2.1 time: 0.177149 Aug 27 21:26:32.848446 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3207/6314] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:32 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:32.983569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:32.985867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:32.992478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.992980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.993426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:32.994135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:32.994595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:32.995026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:33.080530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c7539ec6-06e8-4508-8754-0c3368762418 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action" status: 200 len: 32643 microversion: 2.1 time: 0.101789 Aug 27 21:26:33.081625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3108/6315] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:26:32 2022] POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action => generated 32643 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:26:33.350034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:33.350630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:33.357826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:33.358318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:33.358759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:33.359488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:33.359945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:33.360374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:33.400722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '70297a277d7445dcb964c4161cc2e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572e29439ee4d8f98e240cf4a662949', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:33.401323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] flavor_id is None. Assuming migration. {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 21:26:33.401802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:26:33.646203 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4af9b15-516d-4dde-a9af-406bc29fdba2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action" status: 202 len: 0 microversion: 2.1 time: 0.300036 Aug 27 21:26:33.646794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3208/6316] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:26:33 2022] POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:26:33.656733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:33.657345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:33.666238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:33.666812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:33.667252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:33.668055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:33.668593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:33.669314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:33.811545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:33.819935 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4687f09-7566-4333-a9e4-3462e199b941 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1692 microversion: 2.1 time: 0.168501 Aug 27 21:26:33.820521 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3109/6317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:33 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:34.843901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:34.844523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:34.851646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:34.852141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:34.852581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:34.853276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:34.853731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:34.854260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:34.996074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:35.009489 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66365525-9b60-4ec5-9eeb-7f988bf81687 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1692 microversion: 2.1 time: 0.170925 Aug 27 21:26:35.010416 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3209/6318] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:34 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:36.035501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:36.036109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:36.043653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:36.044153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:36.044601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:36.045302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:36.045761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:36.046722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:36.192341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:36.200986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b068e854-af35-42fb-a448-9ea88990e1b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.170350 Aug 27 21:26:36.201543 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3110/6319] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:36 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:37.227540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:37.228400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:37.238407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:37.238894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:37.239355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:37.240057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:37.240512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:37.240955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:37.382325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:37.390709 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-87dc9fdf-9477-430b-9215-77598809fac8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.169980 Aug 27 21:26:37.391419 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3210/6320] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:37 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:38.412508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:38.413227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:38.422183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:38.422710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:38.424168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:38.424895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:38.425351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:38.425965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:38.565779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:38.573947 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73daae2c-e029-464d-9147-bfa522e5cab7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.165489 Aug 27 21:26:38.574509 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3111/6321] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:38 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:39.600676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:39.601296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:39.612357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:39.612959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:39.613558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:39.614632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:39.615293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:39.615759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:39.762902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:39.772919 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-61ecefc8-df77-4b42-a333-ae4b07b80f16 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.178832 Aug 27 21:26:39.773580 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3211/6322] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:39 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:40.797319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:40.799878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:40.813028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:40.813944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:40.814694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:40.815895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:40.816668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:40.817392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:40.993197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:41.004268 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aadcd865-fc34-4816-8f1f-9e0c23bca224 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.213622 Aug 27 21:26:41.005054 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3112/6323] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:40 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:42.028486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:42.029332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:42.039751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:42.039751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:42.040241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:42.041417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:42.042159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:42.043581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:42.192995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:42.205905 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37861ab7-bb01-42b7-9cdc-372896abfd22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.182467 Aug 27 21:26:42.206839 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3212/6324] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:42 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:26:43.239523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:43.240511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:43.252854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:43.253619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:43.254348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:43.255531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:43.256293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:43.256973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:43.402839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:43.414986 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9380688d-5d6e-4117-bb98-17b43b3e0562 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.181916 Aug 27 21:26:43.415833 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3113/6325] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:43 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:44.441328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:44.442055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:44.450753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:44.451260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:44.451743 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:44.452481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:44.452948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:44.453383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:44.598661 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:44.608040 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56fb9e08-75ea-4e8e-8bf7-2bbdaabb582f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.172597 Aug 27 21:26:44.608735 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3213/6326] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:44 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:45.630633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:45.631253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:45.639054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:45.639586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:45.640025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:45.640719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:45.641174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:45.641596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:45.788824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:45.801224 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d9cba34-789f-4f88-93c8-533f728aa83d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.174365 Aug 27 21:26:45.802033 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3114/6327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:45 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:46.827491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:46.828549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:46.840951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:46.841781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:46.842527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:46.843759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:46.845044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:46.845268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:46.995991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:47.007974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b81d7715-49ae-484c-908e-be45d5a2272b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1697 microversion: 2.1 time: 0.187146 Aug 27 21:26:47.008563 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3214/6328] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:46 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:48.029987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:48.030627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:48.037763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:48.038568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:48.039369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:48.040147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:48.040622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:48.041055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:48.185744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:48.193716 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-244357c1-cea8-4e07-974d-c031d6e381e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1696 microversion: 2.1 time: 0.168154 Aug 27 21:26:48.194285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3115/6329] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:48 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:48.357091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "name": "network-vif-unplugged", "status": "completed", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:48.366897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:48.367666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:48.368109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:48.381920 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Creating event network-vif-unplugged:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch2-master-1 Aug 27 21:26:48.387506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:26:48.398481 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-648728ea-dd67-49bb-87b5-720360e87345 req-44f419c9-d899-40c4-b200-c9ae3c9a0dd9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045909 Aug 27 21:26:48.399113 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3215/6330] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:26:49.217896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:49.218480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:49.226757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:49.227249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:49.227728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:49.228438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:49.228889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:49.229312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:49.382478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:49.391276 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6afdda8-9f97-4ab6-9590-faa5ed637134 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1696 microversion: 2.1 time: 0.177436 Aug 27 21:26:49.391907 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3116/6331] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:49 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:50.415168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:50.415858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:50.422902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:50.423542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:50.423904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:50.424603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:50.425049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:50.425467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:50.431973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:50.442429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:50.442920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:50.443377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:50.455615 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Creating event network-changed:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch2-master-1 Aug 27 21:26:50.461873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:26:50.474150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-aadf0789-b785-4e1d-a223-ff72d4b7647e req-9ebeae9a-80a7-4ceb-96d5-c65f22b01962 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046265 Aug 27 21:26:50.474748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3117/6332] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:26:50.579913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:50.588856 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-abb5435e-6656-435b-b72f-4a3f18163cbc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1694 microversion: 2.1 time: 0.179350 Aug 27 21:26:50.589479 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3216/6333] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:50 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:51.613989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:51.614805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:51.622708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:51.623203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:51.629439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:51.631144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:51.631832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:51.632320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:51.775115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:51.783609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-efed847c-c27d-45ab-bb3b-e5fcdebf26d9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1694 microversion: 2.1 time: 0.175282 Aug 27 21:26:51.784183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3118/6334] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:51 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:52.805154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:52.805747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:52.812886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:52.813417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:52.813865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:52.814571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:52.815031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:52.815508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:52.962963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:52.971004 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b5a3739-0dfc-44aa-b910-36ba1ac25e66 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1694 microversion: 2.1 time: 0.170092 Aug 27 21:26:52.971632 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3217/6335] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:52 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:53.996306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:53.996861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:54.004763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.005280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.005743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.006470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.006942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.007394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.142427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:54.150943 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3963374b-f4ac-455d-966a-f77948bbb34f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1691 microversion: 2.1 time: 0.158907 Aug 27 21:26:54.151561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3119/6336] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:53 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:54.174592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:54.175127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:54.184033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.184531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.184985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.185694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.186163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.186597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.248043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5cfd4731-a28c-4acc-829b-9b9b31e43dcc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action" status: 204 len: 0 microversion: 2.1 time: 0.079611 Aug 27 21:26:54.248662 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3218/6337] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:26:54 2022] POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:26:54.258486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:54.259365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:54.265941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.266589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.267448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.268468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.269012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.269602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.424791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:54.433525 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4aeaf5c5-daec-4851-87a8-a191ed049381 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1691 microversion: 2.1 time: 0.180392 Aug 27 21:26:54.435153 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3120/6338] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:54 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:26:54.511837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "name": "network-vif-plugged", "status": "completed", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:26:54.525649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:54.526221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:54.526825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:54.538733 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Creating event network-vif-plugged:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch2-master-1 Aug 27 21:26:54.544228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:26:54.557053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-2849bf44-9940-4aa4-82bd-20979b6af47d req-c68c2ff5-b61f-4379-a5b2-6fbee7224f2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049417 Aug 27 21:26:54.557984 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3219/6339] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:26:55.456990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:55.457607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:55.466223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:55.466692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:55.467126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:55.468012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:55.468462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:55.468887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:55.611604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:55.620794 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-526af197-a02e-4823-aac7-0b6117886e3d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1691 microversion: 2.1 time: 0.169575 Aug 27 21:26:55.621673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3121/6340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:55 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:26:56.647475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:26:56.648565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:26:56.655525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:56.656023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:56.656467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:56.657174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:26:56.657639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:26:56.658072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:26:56.807049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:26:56.815767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2db9eab3-9da9-4c78-b3d9-446a8136a2b7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1683 microversion: 2.1 time: 0.173910 Aug 27 21:26:56.816345 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3220/6341] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:26:56 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:27:25.089352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:27:25.092835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:25.097032 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 21:27:25.098355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=30 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:25.099029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=86 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:25.106233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:25.106721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:25.107590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:25.107869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:25.108321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:25.108740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:25.189298 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b19caf27-b3dc-4e51-ba06-3cd7cf6b5c53 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action" status: 200 len: 24572 microversion: 2.1 time: 0.106235 Aug 27 21:27:25.189950 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3122/6342] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:27:25 2022] POST /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1/action => generated 24572 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:27:48.278622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:48.279267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:48.281879 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:27:48.282032 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:27:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 (ip 10.222.0.40) !!! Aug 27 21:27:48.283463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=30 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:48.284257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:48.291936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:48.292442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:48.292888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:48.293596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:48.294089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:48.294538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:48.433520 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d57c263a-91d0-4467-9e34-82bcf901a5c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1834 microversion: 2.1 time: 0.158703 Aug 27 21:27:48.434131 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3221/6343] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:27:48 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1834 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:27:49.331063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:49.331705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:49.332633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:27:49.335221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:49.335916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:27:49.342382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:49.342877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:49.343446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:49.344086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:49.344548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:49.344980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:49.353539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:49.354030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:49.354437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:49.366506 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] Creating event network-changed:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch2-master-1 Aug 27 21:27:49.371901 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-6ac78309-266f-4f18-a39f-aaddc02bd6b2 req-ad0d6fb0-c7e0-479b-bbc5-68bb037efa58 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Aug 27 21:27:49.372813 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3222/6344] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:27:49.375674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:27:49.472518 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1970d93b-fa62-4c2f-813b-8509b8142360 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 204 len: 0 microversion: 2.1 time: 0.145582 Aug 27 21:27:49.473431 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3123/6345] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:27:49 2022] DELETE /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:27:49.482828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:49.483664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:49.490526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:49.491102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:49.491913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:49.492466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:49.492996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:49.493522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:49.635656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:27:49.644066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe2c0078-97c7-4bb7-8c9e-c36c468b6151 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1689 microversion: 2.1 time: 0.165702 Aug 27 21:27:49.644685 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3223/6346] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:27:49 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:27:50.666213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:50.666918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:50.676417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:50.676924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:50.677373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:50.678343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:50.678815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:50.679248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:50.830610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:27:50.838977 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c210767-3b7d-4c51-84b4-407f0632e7da tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1689 microversion: 2.1 time: 0.177212 Aug 27 21:27:50.839578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3124/6347] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:27:50 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:27:51.624005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed01dc2-a558-450a-ad7d-432d492b96d1", "name": "network-vif-deleted", "tag": "60090878-6dcf-4e7a-ade6-813ab4ff13e7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:27:51.639297 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:51.639873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:51.640308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:51.652191 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] Creating event network-vif-deleted:60090878-6dcf-4e7a-ade6-813ab4ff13e7 for instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 on nch2-master-1 Aug 27 21:27:51.657930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-cd611d6c-54ff-4d7e-9876-aa3fd5b90d6d req-8c1677e5-7f98-4733-8f76-2804ae4e5a7b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Aug 27 21:27:51.658500 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3224/6348] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:27:51.859769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:51.860381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:51.867273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:51.867803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:51.868256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:51.869007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:51.869476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:51.869976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:51.904459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:51.904930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:51.905401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:51.905861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lazy-loading 'fault' on Instance uuid 6ed01dc2-a558-450a-ad7d-432d492b96d1 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:27:51.949061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:27:51.957938 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3c3aaf2-1b05-41fd-bd3f-679e3bb9e311 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 200 len: 1356 microversion: 2.1 time: 0.101992 Aug 27 21:27:51.958775 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3125/6349] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:27:51 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:27:52.981918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:52.982574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: 6ed01dc2-a558-450a-ad7d-432d492b96d1] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:27:52.990053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:52.990573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:52.991044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:52.991825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:27:52.992311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:27:52.992766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:27:53.007644 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] HTTP exception thrown: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Request method failure captured: Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 HTTP/1.1 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCouvOB1SHAemlxck2rQiZGZyUZWGLrlLnhqW8zXXl2WCIjd39j3n3SCEosx02t-VilkSWmOFkKnIvSvVvprMg3sgLHdcWExfGt1B9HzUvqd4NpmfeuwLA1BMaw71uSoecXMrQZhHvbC-XPl4tDtjff4DKbxWqL-P8JzgzKC94fIeCnA Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc1df4dc4e6b44739c315f501d46c0a7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}] Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 3c72328b5b414eb2abf0545de180811a Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '6ed01dc2-a558-450a-ad7d-432d492b96d1'} Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:27:53.009301 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Returning 404 to user: Instance 6ed01dc2-a558-450a-ad7d-432d492b96d1 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4e99c7e-382a-4ce5-a6d7-ad6bd81c3891 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1" status: 404 len: 111 microversion: 2.1 time: 0.034399 Aug 27 21:27:53.013198 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3225/6350] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:27:52 2022] GET /compute/v2.1/servers/6ed01dc2-a558-450a-ad7d-432d492b96d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:27:56.487005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b276b8b-3f7e-4cc5-94af-9640690f4b63 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '.version_select at 0x7ff857cdf940>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:27:56.514511 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0b276b8b-3f7e-4cc5-94af-9640690f4b63 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537529291" status: 202 len: 0 microversion: 2.1 time: 0.031651 Aug 27 21:27:56.518491 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3126/6351] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 21:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537529291 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:27:56.545714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-280e8e14-fd70-4fde-8aa1-812c14a0ae81 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: .version_select at 0x7ff84de28a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1345423031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHl39FPH3lu2Vwoh8RwAONApsBCyVh14XTINvMkRi0hu15cWwn3AbWRKU/osOJ+0EZFN3S5AZXQHavFmL4JxEUXYUigSAaanSoxqXgQUmntsa/ucnbnskbfMwEg/poyoQ=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:27:56.562802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-280e8e14-fd70-4fde-8aa1-812c14a0ae81 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:27:56.569301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-280e8e14-fd70-4fde-8aa1-812c14a0ae81 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:27:56.599261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-280e8e14-fd70-4fde-8aa1-812c14a0ae81 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057676 Aug 27 21:27:56.599898 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3226/6352] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:27:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:28:02.695288 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1363642694", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "35d4b139-3e74-427c-bf28-26b4da8946c3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1345423031", "security_groups": [{"name": "tempest-secgroup-smoke-1175128192"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:28:02.715117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:02.816481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] validate_networks() for [('35d4b139-3e74-427c-bf28-26b4da8946c3', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:28:03.322314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:28:03.322748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:28:03.323225 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:28:03.323844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:28:03.324281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:28:03.334545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:03.335437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:03.335887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:03.336633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:03.337147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:03.337525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:03.359879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:28:03.366227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:28:03.381304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:28:03.383746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:28:03.435556 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [16c2f7b3-355e-42e1-a8ab-cabd26e9c7aa] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:28:04.446472 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [16c2f7b3-355e-42e1-a8ab-cabd26e9c7aa] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 58982. Aug 27 21:28:04.451380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3b95ba03-35f5-46de-a2c3-4dd6191e5b58 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.760560 Aug 27 21:28:04.458731 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3127/6353] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:28:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:28:04.462041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=18 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:04.466127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03f403be-76b1-497b-8b65-253bca8f78c6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:04.466721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03f403be-76b1-497b-8b65-253bca8f78c6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:04.542436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-03f403be-76b1-497b-8b65-253bca8f78c6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:04.550051 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03f403be-76b1-497b-8b65-253bca8f78c6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1267 microversion: 2.1 time: 0.090339 Aug 27 21:28:04.550657 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3227/6354] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:04 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:05.572799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:05.573568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:05.581259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:05.581866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:05.582339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:05.583086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:05.583572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:05.583999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:05.668890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:05.681772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47ad260b-7323-4685-b922-629493fee168 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1327 microversion: 2.1 time: 0.114357 Aug 27 21:28:05.692833 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3128/6355] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:05 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:06.705298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:06.705890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:06.714152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:06.714799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:06.715281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:06.716053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:06.716515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:06.716948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:06.857891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:06.867052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f1b34dcb-891d-4f15-86b0-a46bdbc8d87d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.165899 Aug 27 21:28:06.867679 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3228/6356] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:06 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:07.061613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:28:07.073566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:07.074387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:07.075022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:07.088455 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] Creating event network-changed:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:28:07.093535 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9099943f-d793-410a-8266-259c3d771248 req-e347e89d-cd43-4d3b-a2eb-58776a71b99e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035864 Aug 27 21:28:07.094134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3129/6357] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:28:07.890649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:07.891273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:07.902929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:07.903692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:07.904298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:07.905356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:07.905984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:07.906614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:08.050527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:08.058833 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-00a28f15-6fe1-41da-b0b7-607513027f8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.174681 Aug 27 21:28:08.059460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3229/6358] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:07 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:09.086126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:09.086929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:09.094456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:09.095005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:09.095552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:09.096338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:09.096857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:09.097338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:09.238384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:09.247381 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3bd359b9-a748-43d9-9f65-2767093806f6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.169411 Aug 27 21:28:09.247998 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3130/6359] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:09 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:10.269244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:10.269831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:10.277921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:10.278417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:10.278856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:10.279600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:10.280059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:10.280487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:10.419521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:10.428679 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b356822-d2dc-48f1-9400-28c64117dc2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.163455 Aug 27 21:28:10.429393 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3230/6360] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:10 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:11.455796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:11.456791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:11.465909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:11.466406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:11.466851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:11.467622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:11.468242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:11.468527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:11.629963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:11.638848 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f96f4629-320b-4e6f-afa1-22e88f30ad7d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.190248 Aug 27 21:28:11.639668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3131/6361] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:11 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:12.660265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:12.660974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:12.668420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:12.668925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:12.669364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:12.670058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:12.670524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:12.670937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:12.808857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:12.816875 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6470c4f7-7df4-4a6d-8650-2817779eaf14 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.160638 Aug 27 21:28:12.817475 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3231/6362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:12 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:13.839521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:13.840122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:13.843001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:13.843733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:13.850222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:13.850710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:13.851157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:13.851896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:13.852383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:13.852833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:13.993542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:14.001537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ff21d46-466d-42f9-8391-a37e6d1a156d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.166428 Aug 27 21:28:14.002120 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3132/6363] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:13 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:14.776309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-plugged", "status": "completed", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:28:14.782600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:14.789763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:14.790249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:14.790681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:14.805314 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] Creating event network-vif-plugged:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:28:14.810391 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7f2fcd9e-b393-4e98-9c77-5ae0f5fd66ef req-9f072afa-ae06-4c1e-9df5-33abbaac7175 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038154 Aug 27 21:28:14.811172 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3232/6364] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:28:15.022755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:15.023299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:15.030385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:15.030870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:15.031312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:15.032032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:15.032486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:15.032910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:15.174996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:15.183216 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11715ef1-21d2-4cd0-8b87-7a2ab43cadaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.164885 Aug 27 21:28:15.183867 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3133/6365] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:15 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:16.205201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:16.205997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:16.214360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:16.214853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:16.215290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:16.216030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:16.216485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:16.216911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:16.358485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:16.366595 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e5c07db2-002e-4e56-9ed0-60681756efa4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1393 microversion: 2.1 time: 0.165737 Aug 27 21:28:16.367214 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3233/6366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:16 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:17.399595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:17.400260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:17.408039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:17.408672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:17.409099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:17.409913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:17.410579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:17.411077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:17.555885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:17.564377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49308089-05c3-4551-a5fc-c3b51e80148c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1565 microversion: 2.1 time: 0.172389 Aug 27 21:28:17.564952 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3134/6367] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:17 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:17.584925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:17.585833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:17.593795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:17.594283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:17.594726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:17.595484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:17.595944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:17.596369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:17.749903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:17.759066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-37eefd05-575f-4ca8-b9c0-ab5a2adb4e17 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1565 microversion: 2.1 time: 0.177867 Aug 27 21:28:17.760137 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3234/6368] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:17 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:19.807616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:28:19.811277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:28:19.811929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:19.814789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:19.821574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:19.827247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:19.827774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:19.828251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:19.828971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:19.829585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:19.830034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:19.830252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:19.830725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:19.831427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:19.844742 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] Creating event network-changed:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:28:19.851639 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-190f690b-a227-4f9f-a7f7-42702f927083 req-6c2c5970-3e87-4679-a874-98b5fb958e2a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047567 Aug 27 21:28:19.853108 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3235/6369] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:28:19.975275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:28:19.983534 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec268549-ef47-4247-9161-faf67aae215d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1565 microversion: 2.1 time: 0.182051 Aug 27 21:28:19.993522 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3135/6370] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:28:19 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:28:53.337465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:53.338219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=40 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:28:53.339188 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:28:53.339380 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:28:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action (ip 10.222.0.40) !!! Aug 27 21:28:53.343951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:28:53.346257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:28:53.355738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:53.356202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:53.356640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:53.357337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:28:53.357792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:28:53.358224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:28:53.430371 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-882c68ef-72d5-411d-a61c-2086ffd63882 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action" status: 200 len: 24562 microversion: 2.1 time: 0.095116 Aug 27 21:28:53.431274 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3236/6371] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:28:53 2022] POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action => generated 24562 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:29:23.860845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:23.861547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=46 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:23.866907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:23.867573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:23.875560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:23.876058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:23.876503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:23.877209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:23.877666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:23.878221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.112141 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e2368ac-930f-4ae3-b3b3-685ceed326c2 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1835 microversion: 2.1 time: 0.253487 Aug 27 21:29:24.112725 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3136/6372] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:23 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1835 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:24.135017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:24.135761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:24.138487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:24.139158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:24.145641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.146131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.146576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.147275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.147763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.148202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.355565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:24.363886 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-34fa190a-045c-4195-83bc-a3fe3871d43e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1684 microversion: 2.1 time: 0.233201 Aug 27 21:29:24.364442 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3237/6373] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:24 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1684 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:24.473266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:24.475630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:24.482040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.482520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.482954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.483954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.484411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.484849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.558219 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f74949be-8a4e-4a2b-9310-60ff89fe5f59 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action" status: 200 len: 32633 microversion: 2.1 time: 0.089497 Aug 27 21:29:24.559153 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3137/6374] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:29:24 2022] POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action => generated 32633 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:29:24.782899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:24.783868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:24.794183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.794999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.795755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.796869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.797441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.797896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.826409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '70297a277d7445dcb964c4161cc2e3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7572e29439ee4d8f98e240cf4a662949', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:24.827025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] flavor_id is None. Assuming migration. {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 21:29:24.827502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:29:24.955704 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0cd89ec5-31cc-49b5-938e-6afaf1184a0a tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action" status: 202 len: 0 microversion: 2.1 time: 0.179631 Aug 27 21:29:24.956331 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3238/6375] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:29:24 2022] POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:29:24.965664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:24.966362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:24.973796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.974284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.974719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:24.975461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:24.975895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:24.976467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:25.116481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:25.124658 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c77abfa-9043-4487-babd-d679926f5411 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1693 microversion: 2.1 time: 0.163701 Aug 27 21:29:25.125381 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3138/6376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:24 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:26.152709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:26.153714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:26.161567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:26.162057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:26.162499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:26.163191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:26.163692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:26.164123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:26.339084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:26.347154 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0af1173-0c20-4209-a533-fc4c253a422e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1693 microversion: 2.1 time: 0.202314 Aug 27 21:29:26.347760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3239/6377] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:26 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1693 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:27.373172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:27.374240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:27.386904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:27.387789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:27.388524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:27.389679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:27.390439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:27.391580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:27.536195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:27.544203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8417da67-5b9d-4065-886c-14ce284b379f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1693 microversion: 2.1 time: 0.177704 Aug 27 21:29:27.544774 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3139/6378] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:27 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:28.566354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:28.566975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:28.574306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:28.574800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:28.575221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:28.575965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:28.576424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:28.576857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:28.725963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:28.734092 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9b7192f-ee80-40f9-9449-8c82e1e81e61 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1693 microversion: 2.1 time: 0.171841 Aug 27 21:29:28.734712 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3240/6379] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:28 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:29.758484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:29.759250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:29.769094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:29.769703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:29.770266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:29.771132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:29.771815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:29.772351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:29.919462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:29.927839 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05d24cd1-4525-406f-bc72-1ba6a7a9faaa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.174307 Aug 27 21:29:29.928420 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3140/6380] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:29 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:30.953908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:30.955405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:30.963461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:30.963959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:30.964411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:30.965149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:30.965614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:30.966044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:31.120091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:31.130565 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e1312f0-4aa9-4934-b040-9a8d247d234f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.183449 Aug 27 21:29:31.131151 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3241/6381] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:30 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:32.156584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:32.157566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:32.165697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:32.166189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:32.166629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:32.167329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:32.167818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:32.168246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:32.306362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:32.316837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2fb5c2a1-90e7-4984-98c8-f280ad3bcd10 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.166830 Aug 27 21:29:32.317439 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3141/6382] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:32 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:33.341186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:33.341867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:33.351485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:33.351985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:33.352437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:33.353149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:33.353612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:33.354048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:33.498366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:33.508102 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-40dbb52c-6e06-441d-8d2e-5ef777c4489c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.173175 Aug 27 21:29:33.508704 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3242/6383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:33 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:34.533405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:34.534418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:34.546341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:34.547149 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:34.547927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:34.549180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:34.549860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:34.550316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:34.691090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:34.699256 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6f7c295e-df3d-4769-a3cd-7781789b25f2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.172412 Aug 27 21:29:34.699913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3142/6384] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:34 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:35.722222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:35.722812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:35.730601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:35.731071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:35.731559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:35.732263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:35.732720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:35.733178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:35.886383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:35.894928 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c52b337-589c-45dd-bff9-9e9e72668b72 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.177311 Aug 27 21:29:35.895536 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3243/6385] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:35 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:36.920662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:36.921685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:36.930109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:36.930639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:36.931092 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:36.931840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:36.932304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:36.932742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:37.080244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:37.089767 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a58ca432-0749-46e5-938b-56a4843e65e8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.175712 Aug 27 21:29:37.090350 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3143/6386] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:36 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:38.116696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:38.117611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:38.129290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:38.129808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:38.130247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:38.130943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:38.131389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:38.131849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:38.274234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:38.287596 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cce1f8fa-4062-4d24-a8b6-9664bfb4a14b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.177803 Aug 27 21:29:38.288549 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3244/6387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:38 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:39.314742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:39.315328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:39.322995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:39.323525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:39.323974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:39.324683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:39.325145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:39.325582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:39.476130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:39.484776 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e842bdbc-23b1-43a8-aaa9-6d06a1a72eb6 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.174157 Aug 27 21:29:39.485354 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3144/6388] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:39 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:40.508007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:40.508606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:40.516465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:40.516959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:40.517392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:40.518129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:40.518595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:40.519024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:40.676942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:40.685473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfb80889-65d3-4561-946e-e116c80eb068 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.181589 Aug 27 21:29:40.686066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3245/6389] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:40 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:41.706914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:41.708176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:41.716638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:41.717106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:41.717716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:41.718564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:41.719086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:41.719595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:41.860400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:41.869284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f5859bee-d995-4092-ac96-f567ef1ac402 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.166364 Aug 27 21:29:41.869845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3145/6390] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:41 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:42.893298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:42.893735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:42.901294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:42.902108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:42.902514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:42.903431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:42.904141 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:42.904543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:43.072467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:43.084663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cd44f5f3-8bde-40b2-940d-6462d645f211 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.196436 Aug 27 21:29:43.085539 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3246/6391] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:42 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:44.110378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:44.111011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:44.120852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:44.121352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:44.121795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:44.122497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:44.122960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:44.123421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:44.263660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:44.272051 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5f4a4b9-dff9-4587-92bd-c2624ce464e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.167423 Aug 27 21:29:44.272672 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3146/6392] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:44 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:45.297202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:45.297895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:45.307781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:45.308448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:45.309053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:45.309991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:45.310614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:45.311360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:45.468429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:45.476797 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e973a86f-5380-42c3-9a31-18279f99337b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1698 microversion: 2.1 time: 0.185403 Aug 27 21:29:45.477421 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3247/6393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:45 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1698 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:46.498459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:46.499053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:46.507033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:46.507565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:46.508007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:46.508720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:46.509179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:46.509610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:46.533926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-unplugged", "status": "completed", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:46.553671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:46.554245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:46.554740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:46.569085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Creating event network-vif-unplugged:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch2-master-1 Aug 27 21:29:46.575752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:29:46.595724 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-37ebf5a4-5d92-4e03-a62e-7557b62889d2 req-5f368b69-4a0b-4c27-b6ae-c02c11a2b61e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068335 Aug 27 21:29:46.597290 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3248/6394] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:29:46.652585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:46.668707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-547ae8cd-f5da-4b2e-abd0-1809b2d4eac7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1697 microversion: 2.1 time: 0.174320 Aug 27 21:29:46.669674 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3147/6395] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:46 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:47.692059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:47.692763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:47.700098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:47.700588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:47.701031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:47.701722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:47.702181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:47.702615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:47.844751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:47.853123 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9be465e-971a-42c2-9cbf-5c0d2ed85d1e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1695 microversion: 2.1 time: 0.166672 Aug 27 21:29:47.853886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3249/6396] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:47 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:48.631909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:48.648366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:48.648997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:48.649640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:48.662607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Creating event network-changed:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch2-master-1 Aug 27 21:29:48.668556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:29:48.680388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5cce932b-7517-4fc6-b8ed-69d4a0757a4c req-5c698afd-2a65-4874-b399-983c1380f9a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054012 Aug 27 21:29:48.680982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3148/6397] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:29:48.876156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:48.876738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:48.883673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:48.884174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:48.884616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:48.885325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:48.885853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:48.886198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:49.029480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:49.037376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2994fc0-4fc6-4b16-b29a-89f7caad996a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1695 microversion: 2.1 time: 0.165504 Aug 27 21:29:49.037992 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3250/6398] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:48 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:50.061717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:50.062421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:50.069998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:50.070476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:50.070914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:50.071649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:50.072108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:50.072616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:50.215192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:50.223775 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bfd3c392-c31d-40a2-98a7-8c29dc2dc2e9 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1695 microversion: 2.1 time: 0.166775 Aug 27 21:29:50.224351 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3149/6399] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:50 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:51.245132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:51.246365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:51.253513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.254007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.254444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.255155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.255966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.256082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.411868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:51.420701 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-48efea61-9cbe-4c90-a979-10d0e8dec3e3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1692 microversion: 2.1 time: 0.179478 Aug 27 21:29:51.421311 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3251/6400] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:51 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:51.441668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:51.442206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:51.449861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.450346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.450788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.451517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.451981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.452407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.571179 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-062c8e15-92f4-4eee-9dc5-1c970ddaeca0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action" status: 202 len: 0 microversion: 2.1 time: 0.133141 Aug 27 21:29:51.571795 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3150/6401] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:29:51 2022] POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:29:51.580533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:51.581203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:51.588249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.588739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.589444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.590924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:51.591434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:51.591855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:51.596394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:51.737476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:51.746132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6b8a2b8d-eeb9-4d86-b429-ab0aa85ece32 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.169069 Aug 27 21:29:51.746761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3252/6402] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:51 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:52.772885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:52.773914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:52.786143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:52.786928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:52.787709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:52.788845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:52.789613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:52.790320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:52.807372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:52.937905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:52.946270 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3dab4bc-b8d6-4fdb-b84b-587fe9ad90cc tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.180849 Aug 27 21:29:52.946860 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3151/6403] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:52 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:53.335368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-plugged", "status": "completed", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:53.348227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:53.348976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:53.349448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:53.364768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Creating event network-vif-plugged:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch2-master-1 Aug 27 21:29:53.371081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:29:53.383122 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a8d2b54c-aaaa-426e-9bd8-da72bb6a44cf req-087b3e01-f1e6-4c96-9f1d-f1d2c067df1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051475 Aug 27 21:29:53.383800 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3253/6404] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:29:53.968475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:53.969104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:53.971915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=37 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:53.977493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:53.977993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:53.978428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:53.979151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:53.979663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:53.980096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:54.125119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:54.136886 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-781d3587-e5e3-46e9-9d13-8a2d74bc2dc1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.172429 Aug 27 21:29:54.137477 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3152/6405] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:53 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:55.160352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:55.162304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:55.164659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=37 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:29:55.171130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:55.171666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:55.172118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:55.172865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:55.173374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:55.173821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:55.316812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:55.325502 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0f8900e-2b28-4e45-bed5-72e46eed1e6b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.170897 Aug 27 21:29:55.326131 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3254/6406] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:55 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:55.408037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-unplugged", "status": "completed", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:55.419187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:55.419751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:55.420266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:55.432423 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Creating event network-vif-unplugged:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:29:55.438553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:29:55.449949 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-68431b69-e8ac-41bf-9e02-5bf6eb000b95 req-16141fc1-2d2b-4283-b35c-08eca3bcfbb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045664 Aug 27 21:29:55.450901 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3153/6407] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:29:56.348566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:56.349183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:56.356509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:56.357006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:56.357447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:56.358144 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:56.358582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:56.359030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:56.497178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:56.505412 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ed287c1c-326a-4118-b8cb-ec1f701a795c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.161215 Aug 27 21:29:56.505988 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3255/6408] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:56 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:57.466848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:29:57.477282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:57.477755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:57.478179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:57.490685 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Creating event network-changed:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:29:57.496790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:29:57.507670 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-49508692-5bd9-4d78-b92c-0136c0e61000 req-89cbb466-e31e-49bc-b699-3f1593fc47ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046347 Aug 27 21:29:57.508254 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3154/6409] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:29:57.529047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:57.529685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:57.536974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:57.537475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:57.538636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:57.539671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:57.540258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:57.540861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:57.686794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:57.696168 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bd4be5c9-4cb1-445a-b057-381532e06c22 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.170520 Aug 27 21:29:57.707682 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3256/6410] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:57 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:58.723739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:58.724546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:58.733242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:58.733740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:58.734181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:58.734889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:58.735368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:58.735876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:58.877577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:29:58.886714 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d9791e4f-30a1-48c4-b07b-8bc8a7285e8c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1691 microversion: 2.1 time: 0.170637 Aug 27 21:29:58.887554 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3155/6411] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:58 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:29:59.912448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:29:59.913458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:29:59.927229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:59.928079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:59.928853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:29:59.930002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:29:59.930747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:29:59.931600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:00.082056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:30:00.091142 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d466a490-08ea-4cba-80ef-d670fbe4c5b5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1684 microversion: 2.1 time: 0.185197 Aug 27 21:30:00.091934 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3257/6412] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:29:59 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:30:03.066301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-plugged", "status": "completed", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:30:03.077593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:03.078088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:03.078537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:03.091255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] Creating event network-vif-plugged:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:30:03.096452 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cbaf9a19-8b73-4711-98a1-6feb4405236a req-8d327a0a-97c2-4c6e-b66c-340e5d524846 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034244 Aug 27 21:30:03.097255 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3156/6413] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:30:32.358965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=7 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:32.359779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=32 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:32.422680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:30:32.425002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:32.431517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:32.432015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:32.432462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:32.433162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:32.433625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:32.434060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:32.505003 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4de3a1cb-4035-49a3-888c-c3d26b5d51a1 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action" status: 200 len: 63055 microversion: 2.1 time: 0.150928 Aug 27 21:30:32.505901 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3258/6414] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:30:32 2022] POST /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042/action => generated 63055 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:30:55.510069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=9 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:55.511003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=25 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:55.640516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:30:55.641227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:55.647996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:55.648493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:55.648962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:55.649665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:55.650115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:55.650563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:55.787693 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dfb73c3-cb02-46c7-8283-9fea469afb2c tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1835 microversion: 2.1 time: 0.280020 Aug 27 21:30:55.788285 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3157/6415] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:30:55 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1835 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:30:56.709881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:30:56.710433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:56.717689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:56.718368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:30:56.721643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:56.722427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:56.722867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:56.723942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:56.724566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:56.724994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:56.755256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:30:56.790470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:30:56.804243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:56.804735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:56.805175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:56.819328 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] Creating event network-changed:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:30:56.825391 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8988e59c-0dd3-4b1a-8bb3-8e16bbc4dd27 req-f1ac9ea1-a396-4930-85cc-c40f07683d22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117996 Aug 27 21:30:56.826360 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3158/6416] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:30:56.844375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-347849ad-6a73-4f49-84a2-862f297a6363 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 204 len: 0 microversion: 2.1 time: 0.138667 Aug 27 21:30:56.845042 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3259/6417] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:30:56 2022] DELETE /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:30:56.854883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:30:56.855622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:56.862719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:56.863216 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:56.864697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:56.865498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:56.866224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:56.866666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:57.004578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:30:57.012588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-832e2bd2-1410-49ad-9042-7ce884f55064 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1690 microversion: 2.1 time: 0.162036 Aug 27 21:30:57.013150 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3159/6418] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:30:56 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:30:58.038352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:30:58.039128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:58.050264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:58.050942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:58.051399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:58.052137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:58.052592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:58.053029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:58.211260 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:30:58.220254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f75f4758-7e3e-4a89-affa-66feb48ffa2a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1690 microversion: 2.1 time: 0.188874 Aug 27 21:30:58.221118 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3260/6419] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:30:58 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:30:59.156878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4e8a77-5305-4616-81b1-b3ee7c1f7042", "name": "network-vif-deleted", "tag": "c62be682-485a-4624-ab99-7430a5f3577b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:30:59.167004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:59.167634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:59.168171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:59.180855 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] Creating event network-vif-deleted:c62be682-485a-4624-ab99-7430a5f3577b for instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 on nch1-master-1 Aug 27 21:30:59.185766 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1e958e17-c1d5-4af2-87f9-abbade47baff req-6e307cfa-6e03-4075-ae5d-ad7eaaddcd26 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103527 Aug 27 21:30:59.186366 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3160/6420] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:30:59.242556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:30:59.243283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:30:59.250985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:59.251491 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:59.251956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:59.252633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:59.253329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:59.253914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:59.288394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:30:59.288918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:30:59.289354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:30:59.289810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lazy-loading 'fault' on Instance uuid ff4e8a77-5305-4616-81b1-b3ee7c1f7042 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:30:59.334884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:30:59.344142 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a4ff3dd-f5f7-4482-95c3-b0f4b1331457 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 200 len: 1357 microversion: 2.1 time: 0.105615 Aug 27 21:30:59.344739 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3261/6421] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:30:59 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:00.370811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:00.371535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: ff4e8a77-5305-4616-81b1-b3ee7c1f7042] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:00.377964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:00.378452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:00.378887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:00.379614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:00.380065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:00.380479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:00.397127 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] HTTP exception thrown: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Request method failure captured: Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 HTTP/1.1 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCouvOB1SHAemlxck2rQiZGZyUZWGLrlLnhqW8zXXl2WCIjd39j3n3SCEosx02t-VilkSWmOFkKnIvSvVvprMg3sgLHdcWExfGt1B9HzUvqd4NpmfeuwLA1BMaw71uSoecXMrQZhHvbC-XPl4tDtjff4DKbxWqL-P8JzgzKC94fIeCnA Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc1df4dc4e6b44739c315f501d46c0a7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}] Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3c72328b5b414eb2abf0545de180811a Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ff4e8a77-5305-4616-81b1-b3ee7c1f7042'} Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:31:00.398825 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Returning 404 to user: Instance ff4e8a77-5305-4616-81b1-b3ee7c1f7042 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-143849ce-1050-4a12-a40f-a2138cbbb4c8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042" status: 404 len: 111 microversion: 2.1 time: 0.034657 Aug 27 21:31:00.403717 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3161/6422] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:00 2022] GET /compute/v2.1/servers/ff4e8a77-5305-4616-81b1-b3ee7c1f7042 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:31:03.806197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7e66ec7d-bef0-49b3-aa2b-e28f278168bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '.version_select at 0x7ff857d9ec10>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:03.811515 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e66ec7d-bef0-49b3-aa2b-e28f278168bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:31:04.820023 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e66ec7d-bef0-49b3-aa2b-e28f278168bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 59936. Aug 27 21:31:04.843964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7e66ec7d-bef0-49b3-aa2b-e28f278168bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1345423031" status: 202 len: 0 microversion: 2.1 time: 1.041572 Aug 27 21:31:04.844595 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3262/6423] 10.222.0.40 () {58 vars in 1284 bytes} [Sat Aug 27 21:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1345423031 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:31:04.880830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1aef7ce8-b6fe-4d57-9dcc-ecbc002651fb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: .version_select at 0x7ff857cb14c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-324305040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBd0be9Cw+Lu/xAOs5TvlG2Ri3hYvREZ9a1i3/hKIhPAwrCTypMOVvDZIBlWnjxM0a/BIxGAgEiH3vFSy+v5BoCrj99FzKbYeNhMOyvK83Ai+GAUSD45UbPD03yhGBunQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:31:04.887296 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:31:04.887495 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Aug 27 21:31:04.889379 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:31:04.889542 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Aug 27 21:31:04.906629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1aef7ce8-b6fe-4d57-9dcc-ecbc002651fb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:31:04.912282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-1aef7ce8-b6fe-4d57-9dcc-ecbc002651fb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:31:04.946270 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1aef7ce8-b6fe-4d57-9dcc-ecbc002651fb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069101 Aug 27 21:31:04.947421 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3162/6424] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:31:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:31:10.770254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-621448769", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "569e2aee-07c2-4804-bcab-1824270abacf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-324305040", "security_groups": [{"name": "tempest-secgroup-smoke-1392146926"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:31:10.786479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:10.916276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] validate_networks() for [('569e2aee-07c2-4804-bcab-1824270abacf', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:31:11.470145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:31:11.470576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:31:11.471061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:31:11.471519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:31:11.471940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:31:11.485724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:11.486585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:11.487401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:11.488473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:11.489084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:11.489789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:11.510091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:31:11.516458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:31:11.529765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:31:11.532285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:31:11.580396 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2996aeca-c010-4b9f-825f-62839c5d781e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814585 Aug 27 21:31:11.586291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3263/6425] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:31:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:31:11.596172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b616d275-317a-496c-bbce-a1a9e093198f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:11.597236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b616d275-317a-496c-bbce-a1a9e093198f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:11.601332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=18 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:11.668528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b616d275-317a-496c-bbce-a1a9e093198f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:11.676310 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b616d275-317a-496c-bbce-a1a9e093198f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1265 microversion: 2.1 time: 0.087687 Aug 27 21:31:11.676883 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3163/6426] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:11 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:12.698655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-657d7e0b-6f64-46ef-b5c1-edb06545528e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:12.699240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-657d7e0b-6f64-46ef-b5c1-edb06545528e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:12.761531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-657d7e0b-6f64-46ef-b5c1-edb06545528e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:12.769212 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-657d7e0b-6f64-46ef-b5c1-edb06545528e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1265 microversion: 2.1 time: 0.075564 Aug 27 21:31:12.769798 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3264/6427] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:12 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:13.790534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4be457a-eddd-4b76-ad1f-028d1c4f0cf7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:13.791140 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4be457a-eddd-4b76-ad1f-028d1c4f0cf7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:13.851640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4be457a-eddd-4b76-ad1f-028d1c4f0cf7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:13.868492 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4be457a-eddd-4b76-ad1f-028d1c4f0cf7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1265 microversion: 2.1 time: 0.081906 Aug 27 21:31:13.869226 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3164/6428] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:13 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:14.895886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:14.895886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:14.905686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:14.906190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:14.906633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:14.908885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:14.909356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:14.910464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:14.980162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:14.989114 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fbb43a12-241f-40e6-9bd9-c9bf773ec6d8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1335 microversion: 2.1 time: 0.102650 Aug 27 21:31:14.989714 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3265/6429] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:14 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:16.011731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:16.012255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:16.019943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:16.020505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:16.021251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:16.021980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:16.022399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:16.022836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:16.161025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:16.168965 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1425d54c-1330-45bc-9327-2172864829aa tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.161351 Aug 27 21:31:16.169582 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3165/6430] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:16 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:16.290246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:31:16.303762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:16.304498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:16.305156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:16.325581 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] Creating event network-changed:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch1-master-1 Aug 27 21:31:16.331663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b77b8c99-18e8-4f60-af62-a99e5517ea57 req-e5e21b97-f2b0-4a3d-a6f0-79c1e529c843 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045253 Aug 27 21:31:16.332598 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3266/6431] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:31:17.191981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:17.192612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:17.200699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:17.201203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:17.201653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:17.202422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:17.202970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:17.203474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:17.345915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:17.353954 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bf463786-2d9f-4142-98e9-82816344b202 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.167214 Aug 27 21:31:17.354554 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3166/6432] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:17 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:18.377194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:18.378151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:18.384722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:18.385218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:18.385679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:18.386377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:18.386815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:18.387261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:18.536101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:18.544209 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4fda4c95-db1b-4971-bee3-ab9d26e8bc35 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.172634 Aug 27 21:31:18.544692 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3267/6433] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:18 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:19.565899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:19.566496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:19.573938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:19.574435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:19.574877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:19.575625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:19.576087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:19.576518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:19.713479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:19.721896 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-104233c0-7990-4227-8d1e-cff92a3c29a5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.160041 Aug 27 21:31:19.722451 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3167/6434] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:19 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:20.746666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:20.747749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:20.757114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:20.757614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:20.758078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:20.758793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:20.759246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:20.759719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:20.902000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:20.912475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-88253e08-9314-4a97-9201-eebe2783fa29 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.172555 Aug 27 21:31:20.913066 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3268/6435] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:20 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:21.935192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:21.935911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:21.945286 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:21.946041 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:21.946732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:21.947908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:21.948562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:21.949024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:22.101674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:22.109932 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-27b7e910-53f5-4ada-8046-3c2f5b4f136d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.179382 Aug 27 21:31:22.110535 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3168/6436] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:21 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:23.133787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:23.134578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:23.137077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:23.138719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:23.146480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:23.147123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:23.147699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:23.148572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:23.149213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:23.149779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:23.297075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:23.306499 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-48bda2f8-51ba-4ed4-abe4-80e08c18184e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.177734 Aug 27 21:31:23.314835 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3269/6437] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:23 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:23.475943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "name": "network-vif-plugged", "status": "completed", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:31:23.485837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:23.486326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:23.486759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:23.498680 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] Creating event network-vif-plugged:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch1-master-1 Aug 27 21:31:23.504346 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0b622230-98d2-48c6-8e5d-f31d06045050 req-077e48f6-7c06-46af-99b2-17bae6399145 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096129 Aug 27 21:31:23.504984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3169/6438] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:31:24.328080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:24.328696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:24.336699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:24.337193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:24.337997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:24.338697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:24.339152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:24.339608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:24.479805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:24.488334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fc8f32e0-7b11-4783-b125-4f00eb79384a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1391 microversion: 2.1 time: 0.164203 Aug 27 21:31:24.488909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3270/6439] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:24 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:25.507898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:25.512915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:25.513626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:25.520474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:25.520960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:25.521418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:25.522294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:25.522675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:25.523109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:25.685376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:25.697244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-89110b07-9aaa-4dc5-90d8-d956cfe8e087 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1564 microversion: 2.1 time: 0.190485 Aug 27 21:31:25.697838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3170/6440] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:25 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:25.721081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:25.721708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:25.730853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:25.731374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:25.731824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:25.732528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:25.732983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:25.733465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:25.884098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:25.892755 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-33a973cd-09c9-46b7-978b-3e279b548bc2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1564 microversion: 2.1 time: 0.177783 Aug 27 21:31:25.893373 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3271/6441] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:25 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:31:27.909849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:31:27.910476 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:31:27.914652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:31:27.915132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:27.918477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:27.918949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:27.919387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:27.920087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:27.920938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:27.921365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:27.932985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:31:27.938033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:31:27.938630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:31:27.939225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:31:27.957918 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] Creating event network-changed:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch1-master-1 Aug 27 21:31:27.964616 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ebba5653-4d19-4fc4-b490-2313094b19f1 req-e5435b7f-1d72-41d9-abcf-6da2b06b6637 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053829 Aug 27 21:31:27.965774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3272/6442] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:31:28.072116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:31:28.080717 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-435d6a54-3bab-4d7c-a34a-e6a8d4a336e2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1564 microversion: 2.1 time: 0.174967 Aug 27 21:31:28.083403 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3171/6443] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:31:27 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:01.439823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:01.442287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:01.444527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=42 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:01.450756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:01.451239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:01.451723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:01.452415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:01.452868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:01.453298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:01.527871 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-19227d80-b4b0-45f5-aea8-d0f4bf634e47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action" status: 200 len: 24564 microversion: 2.1 time: 0.092389 Aug 27 21:32:01.528883 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3273/6444] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:32:01 2022] POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action => generated 24564 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:32:22.446335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-aa6d496c-7e19-4801-a7b5-f5e1c25a4ad5 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] Action: 'create', calling method: .version_select at 0x7ff857c63430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1794510849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDI8TuCdx3/ZM/0vnfbym4h/29Okh4oA9ugaQ+4GogHfgemf9rJUM6M0rX+roBkW05eXSeG+Iz22ieJa79T9JlRgjatP+9iMIt1DNLzPDMAdpbjl+B3hZ3izoFjK1Tj4og=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:22.453043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:22.453719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=38 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:22.468597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-aa6d496c-7e19-4801-a7b5-f5e1c25a4ad5 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] Getting quotas for project 2760241a4dbe4d3282e5737c451a2e52. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:32:22.475077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-aa6d496c-7e19-4801-a7b5-f5e1c25a4ad5 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] Getting quotas for user 7e7c8950f3cb465e9447d1809d45c2b1 and project 2760241a4dbe4d3282e5737c451a2e52. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:32:22.503082 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-aa6d496c-7e19-4801-a7b5-f5e1c25a4ad5 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.061358 Aug 27 21:32:22.503749 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3172/6445] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:32:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:32:25.332494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0856fa6-88ee-416b-90b3-84b73c5fc6d9 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] Calling method '.version_select at 0x7ff84dd1c430>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:25.337670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:25.338827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:25.357069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0856fa6-88ee-416b-90b3-84b73c5fc6d9 tempest-TestVolumeBootPattern-1454545124 tempest-TestVolumeBootPattern-1454545124-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794510849" status: 202 len: 0 microversion: 2.1 time: 0.029381 Aug 27 21:32:25.357754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3274/6446] 10.222.0.40 () {58 vars in 1263 bytes} [Sat Aug 27 21:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794510849 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:32:31.968695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:31.969309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:31.976080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:31.976694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:31.977221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:31.978104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:31.978516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:31.979069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.120170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:32.128763 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa10d16a-7309-4179-a112-4520aa2cf004 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1682 microversion: 2.1 time: 0.165823 Aug 27 21:32:32.129418 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3173/6447] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:31 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:32.240274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:32.242813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:32.251977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.252581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.253097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.254047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.254582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.255158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.325375 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0ab4d61a-a788-40a7-a5a3-eca24b185b47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action" status: 200 len: 32636 microversion: 2.1 time: 0.089282 Aug 27 21:32:32.326335 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3275/6448] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:32:32 2022] POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action => generated 32636 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:32:32.516621 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:32.517953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:32.520224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:32.526655 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.527159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.527629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.528875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.530236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.530852 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.670872 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9944e42-25d9-4fd3-b402-1c5e954c6cbb tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1833 microversion: 2.1 time: 0.158176 Aug 27 21:32:32.671705 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3174/6449] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:32 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1833 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:32.702253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:32.704832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:32.712055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.712548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.713363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.714071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:32.714532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:32.714958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:32.742064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lazy-loading 'flavor' on Instance uuid eaffba79-307e-4af4-8243-c0cfe6132ed8 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:32:32.755596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Going to try to live migrate instance to another host {{(pid=140434) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 21:32:36.610819 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-17448825-f6f3-4baa-8710-f25d6307e075 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action" status: 202 len: 0 microversion: 2.1 time: 3.912614 Aug 27 21:32:36.612995 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3276/6450] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:32:32 2022] POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action => generated 0 bytes in 3916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:32:36.621046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:36.621675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:36.631563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:36.632070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:36.632644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:36.633401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:36.633886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:36.634321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:36.782805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:36.792099 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dcd03044-6625-499f-84ea-a288ba13ca21 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.175252 Aug 27 21:32:36.792680 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3175/6451] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:36 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:37.815909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:37.816499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:37.825604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:37.826119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:37.826540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:37.827289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:37.827810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:37.828248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:37.916433 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "name": "network-vif-unplugged", "status": "completed", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:37.928424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:37.929154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:37.929767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:37.942274 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] Creating event network-vif-unplugged:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch1-master-1 Aug 27 21:32:37.948467 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-54fd0f74-7961-48fc-a830-961b4d38c946 req-b4b7e2c1-9d95-4f90-960a-eac6f9d69d68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036829 Aug 27 21:32:37.949357 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3176/6452] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:32:37.973580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:37.982962 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-89df9e9e-b552-42d7-a5b0-93e81d57d65d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.171156 Aug 27 21:32:37.983579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3277/6453] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:37 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:39.009448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:39.010380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:39.019400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:39.020045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:39.020650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:39.021730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:39.022200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:39.022641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:39.501808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:39.510454 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-707446fe-6c06-4951-8f63-661a036d8f89 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.508017 Aug 27 21:32:39.511153 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3177/6454] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:39 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:39.966518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:39.978470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:39.979102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:39.979658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:39.990849 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] Creating event network-changed:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch1-master-1 Aug 27 21:32:39.996381 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d31ded97-2c62-437a-855a-0da595fbda81 req-b24c214a-169e-411a-8389-395eb3054974 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Aug 27 21:32:39.996977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3278/6455] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:32:40.532300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:40.533068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:40.541291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:40.541780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:40.542221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:40.542925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:40.543378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:40.543840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:40.681938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:40.690118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-763e33c6-83f3-4924-8466-a1b39fdd1c3c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.161861 Aug 27 21:32:40.690741 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3178/6456] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:40 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:41.714077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:41.714786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:41.722532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:41.723022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:41.723519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:41.724232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:41.724771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:41.725181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:41.867911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:41.876356 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f8644154-a0aa-4a55-8565-e68637dd125c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.167372 Aug 27 21:32:41.876925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3279/6457] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:41 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:42.898588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:42.899184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:42.908789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:42.909394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:42.909961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:42.910882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:42.911596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:42.912155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:43.057377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:43.065326 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bcfe29ec-6736-411c-b64e-b8a8aef39597 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.170984 Aug 27 21:32:43.065913 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3179/6458] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:42 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:44.091794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:44.092792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:44.103252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:44.103800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:44.104239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:44.104931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:44.105401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:44.105822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:44.246199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:44.254479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f07a553d-2b7b-494e-a941-57148e5afdb3 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.170302 Aug 27 21:32:44.255028 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3280/6459] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:44 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:45.277005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:45.277645 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:45.288762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:45.289276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:45.289786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:45.297175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:45.297175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:45.297175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:45.454646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:45.466143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3a3189a4-330a-4786-b23f-66f7b72fb24e tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.193848 Aug 27 21:32:45.466845 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3180/6460] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:45 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:46.490742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:46.491524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:46.501964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:46.502630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:46.503205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:46.504202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:46.504815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:46.505277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:46.655396 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:46.663591 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ee0cb5fd-e5e7-431c-861c-2d98db941799 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.178833 Aug 27 21:32:46.664219 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3281/6461] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:46 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:47.685399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:47.686122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:47.693387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:47.693876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:47.694534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:47.695428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:47.695878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:47.696310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:47.839984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:47.848238 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d366772b-52ce-425a-ae3b-464ec0ffadea tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1692 microversion: 2.1 time: 0.166751 Aug 27 21:32:47.849135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3181/6462] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:47 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:48.870158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:48.870839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:48.878988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:48.879714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:48.880154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:48.881123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:48.881672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:48.882105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.025819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:49.033964 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fda69462-301e-41df-a91c-747f6861f233 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1682 microversion: 2.1 time: 0.167804 Aug 27 21:32:49.034543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3282/6463] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:48 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:49.055370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:49.056087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:49.063599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.064091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.064535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.065244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.065709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.066145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.206277 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-72be5127-ee4b-439b-81ab-8adbd5be3287 tempest-TestNetworkAdvancedServerOps-950786392 tempest-TestNetworkAdvancedServerOps-950786392-project-admin] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1833 microversion: 2.1 time: 0.154753 Aug 27 21:32:49.206856 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3182/6464] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:49 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1833 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:49.238420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:49.239175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:49.246289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.246793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.247241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.247975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.248464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.248875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.385939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:49.394303 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-146e833d-acfb-464e-82ae-f5fcab56314d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1682 microversion: 2.1 time: 0.161780 Aug 27 21:32:49.394876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3283/6465] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:49 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:49.497156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:49.499501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:49.505972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.506464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.507157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.507899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:49.508357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:49.508782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:49.572343 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e14d6cbd-f390-42f5-bf36-b263515e7c73 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action" status: 200 len: 38613 microversion: 2.1 time: 0.079099 Aug 27 21:32:49.574048 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3183/6466] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:32:49 2022] POST /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8/action => generated 38613 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:32:50.570575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:50.571233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:50.572512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:50.580073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:50.580699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:50.581370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:50.582312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:50.583001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:50.583677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:50.591359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:50.591921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:50.592359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:50.614057 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] Creating event network-changed:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch2-master-1 Aug 27 21:32:50.616990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:32:50.620916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9cb34f46-f9e7-4215-b18b-37141ddcbc50 req-f498e12e-5671-4082-89e9-466ed9bb06e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053523 Aug 27 21:32:50.626651 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3184/6467] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:32:50.741516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c8de36ea-679a-4fe0-8e90-ea9c6eba2758 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 204 len: 0 microversion: 2.1 time: 0.176217 Aug 27 21:32:50.742291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3284/6468] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:32:50 2022] DELETE /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:32:50.752150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:50.753027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:50.760561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:50.761344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:50.761778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:50.762490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:50.762941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:50.763384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:50.906083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:50.914921 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66891483-d513-4b9c-99b3-4204b94b2cc4 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1688 microversion: 2.1 time: 0.167679 Aug 27 21:32:50.915754 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3185/6469] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:50 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:51.938615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:51.939474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:51.948269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:51.948805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:51.949313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:51.950039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:51.950499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:51.950928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:52.095767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:32:52.105135 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c436da28-d424-4040-bd52-1f0921b2b453 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 200 len: 1570 microversion: 2.1 time: 0.171223 Aug 27 21:32:52.105718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3285/6470] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:51 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:32:52.638137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaffba79-307e-4af4-8243-c0cfe6132ed8", "name": "network-vif-deleted", "tag": "0c7d968e-6893-469a-be8f-d0f98c9f056b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:52.643975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:52.650528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:52.651019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:52.651490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:52.654592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=69 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:52.664843 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] Creating event network-vif-deleted:0c7d968e-6893-469a-be8f-d0f98c9f056b for instance eaffba79-307e-4af4-8243-c0cfe6132ed8 on nch2-master-1 Aug 27 21:32:52.669994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5ca4df53-d55b-4f1d-addf-1e0cc6acf98e req-f1633eff-8e62-456f-a6b0-879b0c3bb0a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Aug 27 21:32:52.670611 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3186/6471] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:32:53.131783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:53.132545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: eaffba79-307e-4af4-8243-c0cfe6132ed8] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:32:53.140533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:53.140984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:53.141433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:53.142148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:32:53.142641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:32:53.144269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:32:53.157807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] HTTP exception thrown: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Request method failure captured: Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 HTTP/1.1 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCouvOB1SHAemlxck2rQiZGZyUZWGLrlLnhqW8zXXl2WCIjd39j3n3SCEosx02t-VilkSWmOFkKnIvSvVvprMg3sgLHdcWExfGt1B9HzUvqd4NpmfeuwLA1BMaw71uSoecXMrQZhHvbC-XPl4tDtjff4DKbxWqL-P8JzgzKC94fIeCnA Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc1df4dc4e6b44739c315f501d46c0a7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}] Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 3c72328b5b414eb2abf0545de180811a Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'eaffba79-307e-4af4-8243-c0cfe6132ed8'} Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:32:53.159543 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Returning 404 to user: Instance eaffba79-307e-4af4-8243-c0cfe6132ed8 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c9e6b8de-1859-4223-b14a-e73d68d56e2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8" status: 404 len: 111 microversion: 2.1 time: 0.036081 Aug 27 21:32:53.165504 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3286/6472] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:32:53 2022] GET /compute/v2.1/servers/eaffba79-307e-4af4-8243-c0cfe6132ed8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:32:56.282571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55261350-d78d-44a2-a982-6dbaed171cbe tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '.version_select at 0x7ff857d19700>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:32:56.305393 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55261350-d78d-44a2-a982-6dbaed171cbe tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-324305040" status: 202 len: 0 microversion: 2.1 time: 0.028089 Aug 27 21:32:56.309981 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3187/6473] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 21:32:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-324305040 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:32:56.343738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae2823b2-cd29-4312-9e78-8bc278e3c802 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: .version_select at 0x7ff84ee65160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-691506874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9tLSjIuo3ooRildl+YNBMPc26Arsw9L5vUHA+YrkYvdH9kbKEGxAiYpeCMaveAFlXHhlX1ZqqZmr0JC/7Nqc77E4kOS/EytZsQsIPBXGVrMyCufFyWLof7Bcpf52s+/g=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:32:56.353169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:32:56.369580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ae2823b2-cd29-4312-9e78-8bc278e3c802 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:32:56.376146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ae2823b2-cd29-4312-9e78-8bc278e3c802 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:32:56.409127 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae2823b2-cd29-4312-9e78-8bc278e3c802 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.070530 Aug 27 21:32:56.410049 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3287/6474] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:32:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:33:02.269005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-12731585", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "8941a93a-bb88-4ef6-889c-5fed0bafe23b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-691506874", "security_groups": [{"name": "tempest-secgroup-smoke-407954339"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:33:02.396689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] validate_networks() for [('8941a93a-bb88-4ef6-889c-5fed0bafe23b', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:33:02.670324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:02.905523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:33:02.906137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:33:02.906610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:33:02.907016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:33:02.907475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:33:02.918369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:02.918864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:02.919305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:02.920051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:02.920672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:02.921161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:02.946919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:33:02.953043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Getting quotas for user 3c72328b5b414eb2abf0545de180811a and project bc1df4dc4e6b44739c315f501d46c0a7. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:33:03.000100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:33:03.007439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:33:03.088995 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ea0f2c1-537a-424e-8d29-246a9f56d98b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823940 Aug 27 21:33:03.090732 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3188/6475] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:33:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:33:03.103185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-330516e4-470a-494a-9107-6344fe42c203 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:03.103822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-330516e4-470a-494a-9107-6344fe42c203 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:03.150945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:03.197190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-330516e4-470a-494a-9107-6344fe42c203 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:03.204879 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-330516e4-470a-494a-9107-6344fe42c203 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1264 microversion: 2.1 time: 0.107089 Aug 27 21:33:03.205802 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3288/6476] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:03 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1264 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:04.227648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:04.228207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:04.236035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:04.236524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:04.236966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:04.237662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:04.238109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:04.238533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:04.310762 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:04.335284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae02ea92-aba7-496b-a828-9defea47f98c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1316 microversion: 2.1 time: 0.112599 Aug 27 21:33:04.335993 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3189/6477] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:04 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:05.357646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:05.358266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:05.367443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:05.367874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:05.368320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:05.369434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:05.369899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:05.370331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:05.533558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:05.543112 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8b61070c-e066-4301-a281-5fbdb4889b19 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.189346 Aug 27 21:33:05.543822 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3289/6478] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:05 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:05.880545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:33:05.893284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:05.893775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:05.894224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:05.906371 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] Creating event network-changed:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:33:05.912128 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ec8dc0b2-2a4e-4862-b7bc-f38cc4798044 req-3401ecb1-1461-42f8-89cd-5be5aee5bddd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035877 Aug 27 21:33:05.913121 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3190/6479] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:33:06.566095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:06.566622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:06.573361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:06.573851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:06.574307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:06.574996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:06.575478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:06.575879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:06.711484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:06.720055 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-83eb4aea-8714-4f23-98bd-580f3c3aa226 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.158874 Aug 27 21:33:06.720632 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3290/6480] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:06 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:07.743637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:07.744338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:07.751730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:07.752212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:07.752648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:07.753463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:07.753916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:07.754322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:07.895979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:07.905117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-106d4d16-83c7-4d5f-98aa-398631b0f2c5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.167213 Aug 27 21:33:07.905694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3191/6481] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:07 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:08.926447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:08.927064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:08.935657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:08.936261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:08.936697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:08.937401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:08.937851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:08.938263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:09.079162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:09.087437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c6ead9b2-3814-4219-b647-61a3340c1d0d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.164947 Aug 27 21:33:09.088027 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3291/6482] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:08 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:10.113597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:10.114995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:10.123148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:10.123750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:10.124265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:10.125166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:10.125524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:10.125947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:10.266314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:10.274783 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f457c854-602c-4055-8988-0240cf75f947 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.167612 Aug 27 21:33:10.275381 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3192/6483] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:10 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:11.302245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:11.304198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:11.316301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:11.317313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:11.318233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:11.319651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:11.320666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:11.320666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:11.483071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:11.493157 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a7491b40-639e-460f-b3c3-2038d91d08b8 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.198841 Aug 27 21:33:11.493774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3292/6484] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:11 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:11.849466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "name": "network-vif-plugged", "status": "completed", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:33:11.861117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:11.861549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:11.861986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:11.873934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] Creating event network-vif-plugged:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:33:11.879173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d56505ce-161d-4329-89cf-8554216680f2 req-8f1728b9-b336-4989-b4e4-16035996313d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Aug 27 21:33:11.879812 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3193/6485] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:33:12.514003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:12.514590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:12.522649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:12.523246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:12.524087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:12.524791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:12.525263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:12.525698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:12.671402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:12.679712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55e80aab-ab2d-43f2-a822-65f55c0dfd0b tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1389 microversion: 2.1 time: 0.169638 Aug 27 21:33:12.680303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3293/6486] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:12 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:13.702802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:13.704091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:13.710759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:13.711966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:13.720473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:13.720982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:13.721393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:13.722105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:13.722558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:13.722992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:13.868633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:13.877019 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3456994b-ae7c-44fa-aed1-db3b4db41c76 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1561 microversion: 2.1 time: 0.177409 Aug 27 21:33:13.877603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3194/6487] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:13 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:13.897356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:13.897961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:13.900100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:13.906773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:13.907299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:13.907805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:13.908552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:13.908983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:13.909453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:14.050464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:14.058952 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-27a4fd2d-d14c-4e91-97be-fa4e8715b035 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1561 microversion: 2.1 time: 0.165545 Aug 27 21:33:14.059683 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3294/6488] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:13 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:15.782834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:33:15.783460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:15.787238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:33:15.790989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:15.791508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:15.791947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:15.792830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:15.793489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:15.793915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:15.811411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:15.812335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:15.813678 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:15.827807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] Creating event network-changed:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:33:15.833583 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-64b7c7d5-ed4b-4de0-8c1a-85a6c75c9008 req-26e14fdc-3bf7-4642-820c-2a5a3f385af7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050263 Aug 27 21:33:15.834472 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3295/6489] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:33:15.935373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:33:15.943983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c3534a3-ddea-440d-920a-bc98dcc7fb30 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1561 microversion: 2.1 time: 0.165177 Aug 27 21:33:15.944674 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3195/6490] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:33:15 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:33:49.303879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:33:49.306110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:33:49.308771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:49.309423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=38 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:33:49.316317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:49.316819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:49.317269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:49.317983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:33:49.318480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:33:49.318958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:33:49.388279 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9503a39f-eb10-49d5-8b70-d6171f322eb2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action" status: 200 len: 24566 microversion: 2.1 time: 0.091416 Aug 27 21:33:49.388982 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3296/6491] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:33:49 2022] POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action => generated 24566 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:34:19.839624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:34:19.840401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=36 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:34:19.844803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:34:19.847628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:19.854857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:19.855363 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:19.855832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:19.856571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:19.857030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:19.857490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:19.945364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:34:19.945810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:34:19.946280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:34:19.946693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:34:19.947111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:34:20.017393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:20.023890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:20.024396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:20.024843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:20.025564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:20.026029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:20.026467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:20.053772 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b6a67b7b-7f4f-4d0e-a7b6-6ae5a21d972c tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action" status: 202 len: 1136 microversion: 2.1 time: 0.216509 Aug 27 21:34:20.054442 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3196/6492] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:34:19 2022] POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action => generated 1136 bytes in 218 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 21:34:20.073209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:20.074636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:20.078087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:34:20.078735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:34:20.085314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:20.085808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:20.086251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:20.086956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:20.087438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:20.087867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:20.237624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:20.245636 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c50ec56-0343-4b2d-ba16-b405089e75bb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.177342 Aug 27 21:34:20.246243 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3297/6493] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:20 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:21.268444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:21.269046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:21.276290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:21.276784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:21.277234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:21.277930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:21.278423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:21.278874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:21.412881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:21.423724 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e603a7d-9be8-4fcb-916c-398e65923556 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.159855 Aug 27 21:34:21.424304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3197/6494] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:21 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:22.454385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:22.454992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:22.462545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:22.463040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:22.463554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:22.464629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:22.465087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:22.465513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:22.626403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:22.638101 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f027fbb8-00d0-43cb-ad0f-53c547b86c47 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.188210 Aug 27 21:34:22.638887 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3298/6495] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:22 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:23.660870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:23.661424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:23.669042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:23.669549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:23.669994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:23.670944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:23.671254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:23.671724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:23.876529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:23.884889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bda9c451-b80a-41a9-b2ac-a614b209b26d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.228225 Aug 27 21:34:23.885471 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3198/6496] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:23 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:24.906730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:24.907300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:24.914710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:24.915230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:24.915712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:24.916387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:24.916819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:24.917243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:25.133527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:25.145715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-212eea4c-6109-40ec-ada2-4d29e046bb4a tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.242728 Aug 27 21:34:25.146556 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3299/6497] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:24 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:26.172069 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:26.172619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:26.180950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:26.181449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:26.181918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:26.182665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:26.183164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:26.183666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:26.327478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:26.335807 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a64664ba-e4c7-424b-ab3c-44f802d2c605 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.169768 Aug 27 21:34:26.336396 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3199/6498] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:26 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:27.359290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:27.359976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:27.367439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:27.367940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:27.368391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:27.369094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:27.369558 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:27.369989 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:27.509193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:27.519264 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f23b34d3-8032-473f-9918-c44c8bfc81ba tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.164150 Aug 27 21:34:27.519895 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3300/6499] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:27 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:28.542394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:28.543145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:28.551176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:28.551706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:28.552147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:28.552850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:28.553304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:28.553729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:28.695904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:28.705862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3c2e3613-efbb-4b1e-a089-ca178018ed28 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.167409 Aug 27 21:34:28.706457 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3200/6500] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:28 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:29.728608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:29.729202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:29.736817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:29.737317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:29.737762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:29.738466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:29.738927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:29.739483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:29.888407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:29.897260 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3debcb42-7f54-42f8-8616-4ba20ad1ffa2 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.172731 Aug 27 21:34:29.897853 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3301/6501] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:29 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:30.924455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:30.925403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:30.937562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:30.938095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:30.938548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:30.939249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:30.939725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:30.940164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:31.076439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:31.088448 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-87e290a6-77a5-41ac-96b9-c1ce59b457e7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1689 microversion: 2.1 time: 0.170482 Aug 27 21:34:31.089613 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3201/6502] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:30 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:32.112463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:32.113023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:32.120829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:32.121325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:32.121776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:32.122495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:32.122965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:32.123397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:32.271926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:32.279978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0b1a25a1-1d7a-4d20-bcc4-cd901125b0f5 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1695 microversion: 2.1 time: 0.171822 Aug 27 21:34:32.280559 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3302/6503] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:32 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:33.310104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:33.310731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:33.318444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:33.318938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:33.319416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:33.320134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:33.320607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:33.321043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:33.459833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:33.472588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-42a9f0e6-10be-466d-9f36-dd24c1af6234 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1695 microversion: 2.1 time: 0.166266 Aug 27 21:34:33.473321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3202/6504] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:33 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:34.498596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:34.499332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:34.507020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:34.507548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:34.507985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:34.508690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:34.509143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:34.509553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:34.653862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:34.662187 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0bf10a99-864e-4565-b731-0cc86d7a974d tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1695 microversion: 2.1 time: 0.167562 Aug 27 21:34:34.662749 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3303/6505] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:34 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:35.688617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:35.690073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:35.701974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:35.702802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:35.703592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:35.704733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:35.705539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:35.706017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:35.846388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:35.855080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb05e572-83fa-48d1-9145-a34671330961 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1695 microversion: 2.1 time: 0.173120 Aug 27 21:34:35.855710 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3203/6506] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:35 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:36.194684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "name": "network-vif-unplugged", "status": "completed", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:34:36.206528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:36.207009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:36.207568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:36.221117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] Creating event network-vif-unplugged:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:34:36.227794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ff4e6df1-565c-4995-bca0-c9a6e15ecf7c req-f56c99f6-379a-484f-b0d0-ee9aad7eff32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037311 Aug 27 21:34:36.228376 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3304/6507] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:34:36.879886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:34:36.880486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:34:36.887843 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:36.888336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:36.888778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:36.889479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:36.889944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:36.890379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:37.031586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:34:37.040812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6446070-3485-4010-8df9-e74919e95cdb tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1680 microversion: 2.1 time: 0.167053 Aug 27 21:34:37.041398 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3204/6508] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:34:36 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:34:38.333081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "name": "network-vif-plugged", "status": "completed", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:34:38.344999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:34:38.345502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:34:38.346047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:34:38.357620 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] Creating event network-vif-plugged:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:34:38.362830 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-9c263eb3-db79-418b-b145-f9456c75b639 req-c9ad52f8-3123-45a1-8076-33170768360e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Aug 27 21:34:38.363777 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3305/6509] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:35:11.355754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:35:11.357980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:11.360510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=22 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:11.361179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:11.368730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:11.369576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:11.370371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:11.371636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:11.372492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:11.373270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:11.468182 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfabc079-cc73-4834-b225-8cb856cda534 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action" status: 200 len: 24566 microversion: 2.1 time: 0.116365 Aug 27 21:35:11.469240 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3205/6510] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:35:11 2022] POST /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16/action => generated 24566 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:35:42.905104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=18 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:42.906286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=46 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:42.908675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:35:42.911542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:42.912208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:42.914601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:42.915272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:35:42.920438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:42.921095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:42.921551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:42.921801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:42.922289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:42.922722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:42.923024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:42.923512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:42.923936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:42.935568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] Creating event network-changed:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:35:42.941905 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b2130ac2-41ae-4be8-bbfb-79c1cf3b3d8a req-f5a0c853-447a-4ad3-91ac-7b5b464173b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036544 Aug 27 21:35:42.941905 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3206/6511] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:35:42.955527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:35:43.047330 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1acd1579-0d8f-4ba6-b545-88dac163fb2f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 204 len: 0 microversion: 2.1 time: 0.144741 Aug 27 21:35:43.051699 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3306/6512] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:35:42 2022] DELETE /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:35:43.058510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:43.059297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:43.066028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:43.066528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:43.067189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:43.067934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:43.068551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:43.069145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:43.211192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:35:43.219701 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc7f2219-9075-427a-9fc5-54777a34bff0 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1686 microversion: 2.1 time: 0.166828 Aug 27 21:35:43.220273 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3207/6513] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:35:43 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:35:44.241401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:44.242113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:44.249839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:44.250341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:44.250785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:44.251527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:44.252551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:44.253019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:44.391506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:35:44.400808 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bb8e7812-d40f-4163-b3f9-fb63ce210f60 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1686 microversion: 2.1 time: 0.163745 Aug 27 21:35:44.401390 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3307/6514] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:35:44 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:35:45.199136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99dc284-935e-4016-a818-7bfa509b3c16", "name": "network-vif-deleted", "tag": "5414561b-ba47-42e6-ba79-173975bc1cde"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:35:45.211577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:45.212143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:45.212776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:45.226830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] Creating event network-vif-deleted:5414561b-ba47-42e6-ba79-173975bc1cde for instance b99dc284-935e-4016-a818-7bfa509b3c16 on nch1-master-1 Aug 27 21:35:45.233845 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d59d969b-a2ec-488b-8713-5c33701f9c1d req-8ee8ece4-3870-41ba-ad12-098170805efc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Aug 27 21:35:45.234781 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3208/6515] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:35:45.422500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:45.423121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:45.430255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:45.430818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:45.431278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:45.432324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:45.432780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:45.433208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:45.466599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:45.467091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:45.467564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:45.468015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lazy-loading 'fault' on Instance uuid b99dc284-935e-4016-a818-7bfa509b3c16 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:35:45.511419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c72328b5b414eb2abf0545de180811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1df4dc4e6b44739c315f501d46c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:35:45.519798 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ea641f32-f239-49ef-a8d6-0061f31c4fc7 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 200 len: 1354 microversion: 2.1 time: 0.101309 Aug 27 21:35:45.520367 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3308/6516] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:35:45 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 1354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:35:46.543583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:46.544280 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [instance: b99dc284-935e-4016-a818-7bfa509b3c16] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:35:46.553142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:46.553826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:46.554416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:46.555494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:35:46.556414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:35:46.556955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:35:46.576251 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] HTTP exception thrown: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Request method failure captured: Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 HTTP/1.1 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCouvOB1SHAemlxck2rQiZGZyUZWGLrlLnhqW8zXXl2WCIjd39j3n3SCEosx02t-VilkSWmOFkKnIvSvVvprMg3sgLHdcWExfGt1B9HzUvqd4NpmfeuwLA1BMaw71uSoecXMrQZhHvbC-XPl4tDtjff4DKbxWqL-P8JzgzKC94fIeCnA Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bc1df4dc4e6b44739c315f501d46c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bc1df4dc4e6b44739c315f501d46c0a7", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bc1df4dc4e6b44739c315f501d46c0a7"}]}] Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: bc1df4dc4e6b44739c315f501d46c0a7 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2014913488 Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 3c72328b5b414eb2abf0545de180811a Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2014913488-project Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b99dc284-935e-4016-a818-7bfa509b3c16'} Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:35:46.577851 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Returning 404 to user: Instance b99dc284-935e-4016-a818-7bfa509b3c16 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1dab3eaf-fdfe-4d89-abe3-e1808f3b6186 tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16" status: 404 len: 111 microversion: 2.1 time: 0.041063 Aug 27 21:35:46.582391 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3209/6517] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:35:46 2022] GET /compute/v2.1/servers/b99dc284-935e-4016-a818-7bfa509b3c16 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:35:50.471428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-43833c2b-0dff-4d8f-8816-17fd6da4841f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] Calling method '.version_select at 0x7ff84db9a700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:35:50.477076 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43833c2b-0dff-4d8f-8816-17fd6da4841f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:35:51.491275 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-43833c2b-0dff-4d8f-8816-17fd6da4841f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33224. Aug 27 21:35:51.515430 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-43833c2b-0dff-4d8f-8816-17fd6da4841f tempest-TestNetworkAdvancedServerOps-2014913488 tempest-TestNetworkAdvancedServerOps-2014913488-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-691506874" status: 202 len: 0 microversion: 2.1 time: 1.047803 Aug 27 21:35:51.516039 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3309/6518] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 21:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-691506874 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:43:25.577014 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 21:43:25.578037 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 21:43:25.578549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=8 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:25.579301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:25.580685 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 21:43:25.580941 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 27 21:43:25.582949 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:43:25.583099 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 27 21:43:25.584802 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:43:25.584940 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 27 21:43:25.762788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1977757511", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:26.024537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] validate_networks() for None {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:43:26.233065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:43:26.233637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:43:26.234309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:43:26.234946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:43:26.235599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:43:26.248860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:26.249343 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:26.249781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:26.250507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:26.250959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:26.251381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:26.269626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Getting quotas for project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:43:26.275379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Getting quotas for user 01f7f21a2cc9448ba348c5de3201f64d and project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:43:26.290056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:43:26.294051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:43:26.348170 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cd5e14e-7036-410e-8895-a6bef4a33fa7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773268 Aug 27 21:43:26.349097 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3210/6519] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:43:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:43:26.359834 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:43:26.360875 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:43:26.361501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:26.363144 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 21:43:26.363435 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c (ip 10.222.0.40) !!! Aug 27 21:43:26.364731 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 21:43:26.365064 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c (ip 10.222.0.40) !!! Aug 27 21:43:26.366078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:26.367033 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 21:43:26.367219 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c (ip 10.222.0.40) !!! Aug 27 21:43:26.372270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddd5f632-06cb-4b76-9368-11209d9a8944 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:26.372900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddd5f632-06cb-4b76-9368-11209d9a8944 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:26.552489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ddd5f632-06cb-4b76-9368-11209d9a8944 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:26.560205 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ddd5f632-06cb-4b76-9368-11209d9a8944 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1222 microversion: 2.1 time: 0.202311 Aug 27 21:43:26.560780 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3310/6520] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:26 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:27.584612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:27.585168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:27.594987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:27.595552 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:27.595995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:27.596695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:27.597155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:27.597572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:27.601561 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34482. Aug 27 21:43:27.602258 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34480. Aug 27 21:43:27.666717 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:27.675011 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-163e6ea6-04ab-4c70-b8ce-0b28888b8409 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1274 microversion: 2.1 time: 0.097377 Aug 27 21:43:27.675622 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3211/6521] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:27 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:28.697586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:28.698790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:28.710892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:28.711656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:28.712134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:28.712851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:28.713308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:28.714263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:28.726812 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34490. Aug 27 21:43:28.737295 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34492. Aug 27 21:43:28.870721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:28.882288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9fb1bde7-7e6a-43b2-bd2a-3b23208a4037 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.189147 Aug 27 21:43:28.882881 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3311/6522] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:28 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:29.470708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf3960f-235c-436e-9dd5-44216831b19c", "tag": "a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:29.480381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:29.480863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:29.481298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:29.492632 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] Creating event network-changed:a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2 for instance dbf3960f-235c-436e-9dd5-44216831b19c on nch1-master-1 Aug 27 21:43:29.499469 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c0085d14-445d-4658-b9f6-0995ec72c5b6 req-4220390c-00f4-4776-9f1e-91f1aaa17fc9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110437 Aug 27 21:43:29.500090 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3212/6523] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:29.904146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:29.905440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:29.911779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:29.912278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:29.912726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:29.913435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:29.913897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:29.914329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:30.050123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:30.058103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1d8342fd-0219-4e83-804e-6c2702f0c244 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.158490 Aug 27 21:43:30.058668 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3312/6524] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:29 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:31.082148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:31.082854 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:31.089793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:31.090653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:31.091099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:31.091845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:31.092314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:31.092747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:31.243821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:31.252721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61704ec4-5d59-4442-b21a-884ec17fa5e0 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.175802 Aug 27 21:43:31.253432 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3213/6525] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:31 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:32.275286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:32.275940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:32.283586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:32.284386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:32.284836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:32.285532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:32.285996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:32.286414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:32.423520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:32.431532 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1e9e4388-c670-4ccf-a0e8-322c8be11ad3 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.160196 Aug 27 21:43:32.432095 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3313/6526] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:32 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:33.453125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:33.453821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:33.461103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:33.461593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:33.462032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:33.462713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:33.463166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:33.463624 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:33.602848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:33.611461 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-11a45b69-18fb-4c67-a018-1ec847b82754 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.162364 Aug 27 21:43:33.611984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3214/6527] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:33 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:34.636577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:34.637372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:34.646555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:34.647078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:34.647572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:34.648274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:34.648733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:34.649162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:34.787635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:34.795929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-21cd1707-1b0c-4632-9a48-2650f3c4a0d6 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.165599 Aug 27 21:43:34.796597 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3314/6528] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:34 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:35.006150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3960f-235c-436e-9dd5-44216831b19c", "name": "network-vif-plugged", "status": "completed", "tag": "a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:35.015833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:35.016327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:35.016761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:35.027901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] Creating event network-vif-plugged:a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2 for instance dbf3960f-235c-436e-9dd5-44216831b19c on nch1-master-1 Aug 27 21:43:35.033860 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-758e65ef-581a-4f61-a068-e88c902c9343 req-54235e79-8f75-4ce0-a707-978b1e1d56ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102920 Aug 27 21:43:35.034658 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3215/6529] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:35.822619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:35.823860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:35.835502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:35.836339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:35.837074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:35.838231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:35.839001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:35.839772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:35.979844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:35.993407 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15db94da-e49b-4f38-bbe5-84e06fb99135 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1322 microversion: 2.1 time: 0.177160 Aug 27 21:43:35.994204 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3315/6530] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:35 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:37.015608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:37.016407 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:37.021226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:37.021926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:37.029137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.029632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.030074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.030779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.031241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.031700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.188254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:37.197408 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-81f9d916-dace-4e00-bb6d-109c9c7a07d5 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1472 microversion: 2.1 time: 0.183424 Aug 27 21:43:37.198186 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3216/6531] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:37 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:37.224522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:37.279878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad72bedf-84f7-4f3d-9a84-b20a1d1dcf9b tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '.version_select at 0x7ff84f5d4dc0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:37.351523 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad72bedf-84f7-4f3d-9a84-b20a1d1dcf9b tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/57296edd96c84292b9b3aecfd9b202e1" status: 200 len: 371 microversion: 2.1 time: 0.131754 Aug 27 21:43:37.352094 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3316/6532] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 21:43:37 2022] GET /compute/v2.1/os-quota-sets/57296edd96c84292b9b3aecfd9b202e1 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:37.364986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1ef8ecb-2e4c-4ff4-9883-137de825c086 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1138649289", "id": 861724760, "os-flavor-access:is_public": "True"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:37.385028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1ef8ecb-2e4c-4ff4-9883-137de825c086 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.024725 Aug 27 21:43:37.385643 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3217/6533] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:43:37 2022] POST /compute/v2.1/flavors => generated 435 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:37.397568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "861724760"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:37.399855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:37.406142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.406625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.407056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.407839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.408292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.408713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.560536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c5db131c8884498eae089d49d51c7998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57296edd96c84292b9b3aecfd9b202e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:37.567723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1138649289 {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:43:37.574832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.575317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.576468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.576468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.576939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.577384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.600753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Getting quotas for project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:43:37.606512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Getting quotas for user 01f7f21a2cc9448ba348c5de3201f64d and project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:43:37.620557 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] ram quota exceeded for 57296edd96c84292b9b3aecfd9b202e1, tried to resize instance. Aug 27 21:43:37.621104 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Request method failure captured: Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action HTTP/1.1 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 38 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCo_94FQbTTh316EfeqEYmICdNqH3i9u5rDDVKOvw2hmVZ-RF8bdAby3JdNIIIxOOvSHNXOhJ0pLnqg0umCljnLcbtN0ndRB8dorLYfRWvdzEKeaQPNdyRH9J6itwlW6NFsyeaFc8iBmS-w1rLPCbYz1kxR4t9qxVewqUA8WLCm3lfjE Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 57296edd96c84292b9b3aecfd9b202e1 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,admin,member Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,admin,member Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57296edd96c84292b9b3aecfd9b202e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/57296edd96c84292b9b3aecfd9b202e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_57296edd96c84292b9b3aecfd9b202e1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57296edd96c84292b9b3aecfd9b202e1"}]}] Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 57296edd96c84292b9b3aecfd9b202e1 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersAdminNegativeTestJSON-720763043-project-admin Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: c5db131c8884498eae089d49d51c7998 Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720763043-project-admin Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: {"resize": {"flavorRef": "861724760"}} Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'dbf3960f-235c-436e-9dd5-44216831b19c', 'body': {'resize': {'flavorRef': '861724760'}}} Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:37.623314 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-672620d2-3f8f-4ba6-b0b0-b6a371ee100a tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action" status: 403 len: 118 microversion: 2.1 time: 0.231132 Aug 27 21:43:37.628023 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3317/6534] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:43:37 2022] POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action => generated 118 bytes in 232 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:43:37.635555 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cf801aa-5c27-4da5-a902-ba2d93612efd tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:37.658323 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cf801aa-5c27-4da5-a902-ba2d93612efd tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/861724760" status: 202 len: 0 microversion: 2.1 time: 0.027739 Aug 27 21:43:37.658910 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3218/6535] 10.222.0.40 () {58 vars in 1158 bytes} [Sat Aug 27 21:43:37 2022] DELETE /compute/v2.1/flavors/861724760 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:43:37.667268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4666bb66-58ef-4c9b-b954-8b144ba1345d tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:37.691745 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4666bb66-58ef-4c9b-b954-8b144ba1345d tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028240 Aug 27 21:43:37.692318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3318/6536] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:43:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:37.713018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55320913-bd0e-491f-908a-af9e1236b312 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '.version_select at 0x7ff84e0edaf0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:37.791675 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55320913-bd0e-491f-908a-af9e1236b312 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "GET /compute/v2.1/os-quota-sets/57296edd96c84292b9b3aecfd9b202e1" status: 200 len: 371 microversion: 2.1 time: 0.082314 Aug 27 21:43:37.792257 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3219/6537] 10.222.0.40 () {58 vars in 1242 bytes} [Sat Aug 27 21:43:37 2022] GET /compute/v2.1/os-quota-sets/57296edd96c84292b9b3aecfd9b202e1 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:37.804180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7180ab59-e3b6-412c-ac6b-584835db81ca tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1037948704", "id": 1512403253, "os-flavor-access:is_public": "True"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:37.823318 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7180ab59-e3b6-412c-ac6b-584835db81ca tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022965 Aug 27 21:43:37.823914 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3319/6538] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:43:37 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:37.835897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1512403253"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:37.838278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:37.845027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.845524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.845971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.846681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:37.847147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:37.847615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:37.985707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c5db131c8884498eae089d49d51c7998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57296edd96c84292b9b3aecfd9b202e1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:37.993296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1037948704 {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:43:38.000415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.000905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.001790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.002187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.002649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.003086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.025359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Getting quotas for project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:43:38.030685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Getting quotas for user 01f7f21a2cc9448ba348c5de3201f64d and project 157d479c436e42b593d410e1745e170e. Resources: {'ram', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:43:38.043600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.compute.api [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] cores quota exceeded for 57296edd96c84292b9b3aecfd9b202e1, tried to resize instance. Aug 27 21:43:38.044150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Request method failure captured: Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action HTTP/1.1 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 39 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCo_94FQbTTh316EfeqEYmICdNqH3i9u5rDDVKOvw2hmVZ-RF8bdAby3JdNIIIxOOvSHNXOhJ0pLnqg0umCljnLcbtN0ndRB8dorLYfRWvdzEKeaQPNdyRH9J6itwlW6NFsyeaFc8iBmS-w1rLPCbYz1kxR4t9qxVewqUA8WLCm3lfjE Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 57296edd96c84292b9b3aecfd9b202e1 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,admin,member Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,admin,member Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57296edd96c84292b9b3aecfd9b202e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/57296edd96c84292b9b3aecfd9b202e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_57296edd96c84292b9b3aecfd9b202e1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/57296edd96c84292b9b3aecfd9b202e1"}]}] Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 57296edd96c84292b9b3aecfd9b202e1 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-720763043 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-720763043-project-admin Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: c5db131c8884498eae089d49d51c7998 Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-720763043-project-admin Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: {"resize": {"flavorRef": "1512403253"}} Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'dbf3960f-235c-436e-9dd5-44216831b19c', 'body': {'resize': {'flavorRef': '1512403253'}}} Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:38.046209 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a6c81245-d9a2-4055-a9ac-b16186544af4 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action" status: 403 len: 113 microversion: 2.1 time: 0.215811 Aug 27 21:43:38.050826 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3220/6539] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:43:37 2022] POST /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c/action => generated 113 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:43:38.057040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f644aa2-75f2-4001-a48d-41c752c46011 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:38.076452 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f644aa2-75f2-4001-a48d-41c752c46011 tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "DELETE /compute/v2.1/flavors/1512403253" status: 202 len: 0 microversion: 2.1 time: 0.023180 Aug 27 21:43:38.077238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3320/6540] 10.222.0.40 () {58 vars in 1161 bytes} [Sat Aug 27 21:43:38 2022] DELETE /compute/v2.1/flavors/1512403253 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:43:38.085432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1376cb7-1cdb-40fc-8b4d-1b1b77cae8bf tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:38.112662 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1376cb7-1cdb-40fc-8b4d-1b1b77cae8bf tempest-ServersAdminNegativeTestJSON-720763043 tempest-ServersAdminNegativeTestJSON-720763043-project-admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030925 Aug 27 21:43:38.113321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3221/6541] 10.222.0.40 () {58 vars in 1146 bytes} [Sat Aug 27 21:43:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:38.133321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:38.133838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:38.140325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.140817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.141262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.141938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.142416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.142846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.168407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:43:38.260971 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4bd1e5e2-13ea-432d-bb56-1138aa3c2c2d tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 204 len: 0 microversion: 2.1 time: 0.131269 Aug 27 21:43:38.262371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3321/6542] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:43:38 2022] DELETE /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:43:38.272980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:38.273875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:38.283443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.283874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.284318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.285025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:38.285501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:38.285949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:38.420184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:38.429018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bd6825fa-4eb8-4fdd-ab77-b7cbffcd59f7 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1478 microversion: 2.1 time: 0.161889 Aug 27 21:43:38.429610 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3222/6543] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:38 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:39.461245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:39.462041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:39.472930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:39.473429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:39.473874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:39.474586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:39.475053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:39.475516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:39.623926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:39.632664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a447bdca-ef62-45d4-8c50-20396c113ca4 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1478 microversion: 2.1 time: 0.179023 Aug 27 21:43:39.633244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3322/6544] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:39 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1478 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:40.310066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3960f-235c-436e-9dd5-44216831b19c", "name": "network-vif-deleted", "tag": "a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:40.322241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:40.322745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:40.323161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:40.335984 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] Creating event network-vif-deleted:a5fcfb63-d6c3-43cc-8aaa-8fd6aa5169e2 for instance dbf3960f-235c-436e-9dd5-44216831b19c on nch1-master-1 Aug 27 21:43:40.341524 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e4314688-0260-43a4-b2f6-535ce02ee1b9 req-0014bd36-6379-40a1-b3ba-58701cee0569 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040876 Aug 27 21:43:40.342145 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3223/6545] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:43:40.654329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:40.654880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:40.662672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:40.663250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:40.663759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:40.664447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:40.664897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:40.665324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:40.699619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:40.700124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:40.700563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:40.701013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lazy-loading 'fault' on Instance uuid dbf3960f-235c-436e-9dd5-44216831b19c {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:43:40.747631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f7f21a2cc9448ba348c5de3201f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157d479c436e42b593d410e1745e170e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:40.756117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d23d797-ea45-45c4-b63e-53fa8ff8c959 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 200 len: 1312 microversion: 2.1 time: 0.105905 Aug 27 21:43:40.756850 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3323/6546] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:40 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:41.783112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:41.784593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] [instance: dbf3960f-235c-436e-9dd5-44216831b19c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:41.792661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:41.793191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:41.793636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:41.794382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:41.794804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:41.795234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:41.810855 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] HTTP exception thrown: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Request method failure captured: Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c HTTP/1.1 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCo_8blsqw7Q4VOilXHP7n3nUTGydvn57f4IUZFCnA6Wy7RbeO37Jcd3djzb8qeRiAqpbs88Mee1I12Du_-ej1udRIqMvkG9QlAhK-C9ax2rjemYTK0l42HIUIPlSLXx3tj-oIhFc9XS6nGNTVurzBpSrDe2CWiNPe7DXYxR3oTZ62NQ Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 157d479c436e42b593d410e1745e170e Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546456928 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/157d479c436e42b593d410e1745e170e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/157d479c436e42b593d410e1745e170e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_157d479c436e42b593d410e1745e170e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/157d479c436e42b593d410e1745e170e"}]}] Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546456928 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 157d479c436e42b593d410e1745e170e Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546456928 Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersAdminNegativeTestJSON-1546456928-project Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 01f7f21a2cc9448ba348c5de3201f64d Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546456928-project Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'dbf3960f-235c-436e-9dd5-44216831b19c'} Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:41.813170 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] Returning 404 to user: Instance dbf3960f-235c-436e-9dd5-44216831b19c could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:43:41.818627 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8574c41a-f829-429e-b902-ba168f534156 tempest-ServersAdminNegativeTestJSON-1546456928 tempest-ServersAdminNegativeTestJSON-1546456928-project] 10.222.0.40 "GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c" status: 404 len: 111 microversion: 2.1 time: 0.037555 Aug 27 21:43:41.819300 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3224/6547] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:41 2022] GET /compute/v2.1/servers/dbf3960f-235c-436e-9dd5-44216831b19c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:43:48.205685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:48.207061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:48.333985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1468997897", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "759b61aa-340b-4564-8ee5-3f96ae6f802f"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:48.394719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] validate_networks() for [('759b61aa-340b-4564-8ee5-3f96ae6f802f', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:43:48.812516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:43:48.812972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:43:48.813470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:43:48.813885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:43:48.814306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:43:48.824909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:48.825420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:48.825856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:48.826593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:48.827051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:48.827513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:48.847646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Getting quotas for project 38f8ecbb22904fcc8fff4cd28b2405cc. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:43:48.854794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Getting quotas for user 04af4532ad2947e78dfc26c432c711f2 and project 38f8ecbb22904fcc8fff4cd28b2405cc. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:43:48.869129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:43:48.871550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:43:48.922372 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84bf219b-d1e4-4457-88ad-1108d8d273ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722309 Aug 27 21:43:48.923670 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3324/6548] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:43:48.937427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-39ec5287-3076-4629-bf54-70543b3bbc2f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:48.938691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-39ec5287-3076-4629-bf54-70543b3bbc2f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:48.947261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:48.948145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:49.016772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-39ec5287-3076-4629-bf54-70543b3bbc2f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:49.024584 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-39ec5287-3076-4629-bf54-70543b3bbc2f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1215 microversion: 2.1 time: 0.093840 Aug 27 21:43:49.025306 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3225/6549] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:48 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:50.046457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:50.047017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:50.055378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:50.055892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:50.056338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:50.057058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:50.057514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:50.057944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:50.130640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:50.139882 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-694c154a-5eb7-486f-bada-df010adffc0f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1267 microversion: 2.1 time: 0.097453 Aug 27 21:43:50.140528 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3325/6550] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:50 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:51.163707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:51.165005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:51.182919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:51.183905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:51.184531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:51.196050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:51.196963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:51.197685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:51.395321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:51.406697 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f7eef5fe-27a7-434d-a2f8-53abfff04ab8 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.247963 Aug 27 21:43:51.408599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3226/6551] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:51 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:51.817722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:51.830157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:51.831056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:51.831686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:51.843642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] Creating event network-changed:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch1-master-1 Aug 27 21:43:51.849011 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-363e3129-8430-44be-a264-7f8a6a1dac59 req-968c549c-c7fa-4032-b539-41f7c43b61e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035928 Aug 27 21:43:51.850144 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3326/6552] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:52.429421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:52.430058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:52.437543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:52.438038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:52.438488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:52.439202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:52.439693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:52.440253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:52.582340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:52.591132 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f5ee066f-9fcb-47d0-a028-ca2b9d0c55f4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.166025 Aug 27 21:43:52.591757 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3227/6553] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:52 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:53.616125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:53.616788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:53.625210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:53.625755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:53.626247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:53.627023 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:53.627560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:53.628954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:53.775761 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:53.784354 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ddb2d703-e163-4677-bdb3-ed074f12156d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.174001 Aug 27 21:43:53.784963 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3327/6554] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:53 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:54.810076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:54.810739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:54.817758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:54.818237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:54.818680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:54.819423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:54.819885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:54.820314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:54.990428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:54.998968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d0b72c8e-dca7-4efe-977d-f49d5cdaef94 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.196175 Aug 27 21:43:54.999869 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3228/6555] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:54 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:56.029740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:56.030751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:56.039717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:56.040213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:56.040660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:56.041364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:56.041822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:56.042252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:56.182958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:56.193597 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7cf43c36-6eed-4714-a62a-b244d8fda992 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.170578 Aug 27 21:43:56.194183 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3328/6556] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:56 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:57.030518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "name": "network-vif-plugged", "status": "completed", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:57.036285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:57.043277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:57.043789 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:57.044245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:57.049337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=72 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:57.058025 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] Creating event network-vif-plugged:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch1-master-1 Aug 27 21:43:57.063414 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0ac4ea2c-6983-4990-8127-0dd9f06efd9b req-ee58b264-cf90-4382-8404-52a525b4853a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036607 Aug 27 21:43:57.064213 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3229/6557] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:43:57.214711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:57.215600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:57.218497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:57.224014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:57.224551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:57.224996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:57.225709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:57.226171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:57.226593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:57.231603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:57.376971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:57.386508 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97eed15e-87f3-45f8-9af7-57b5f073e73b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.175875 Aug 27 21:43:57.387089 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3329/6558] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:57 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:58.409828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:58.410561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:58.417416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:58.417913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:58.418364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:58.419068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:58.419589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:58.420023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:58.561685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:58.572368 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-518a26d1-91d8-41fc-b356-23770a5501c6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1315 microversion: 2.1 time: 0.167980 Aug 27 21:43:58.572877 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3230/6559] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:58 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:59.594785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:59.596056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:59.599329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:59.600036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:59.604881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.605372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.605816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:59.606522 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.606977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.607420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:59.746919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:59.755056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-13755a3c-2c59-477e-881a-69abd6655f0b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1502 microversion: 2.1 time: 0.164512 Aug 27 21:43:59.755760 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3330/6560] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:59 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:43:59.776237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:43:59.778639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:59.780809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:43:59.787393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.787962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.788458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:59.789220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.789731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.790215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:59.822917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:43:59.829388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:43:59.836276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:43:59.836625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:43:59.837094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:43:59.837498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:43:59.837906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:43:59.906501 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12b3d226-7b63-44d6-8707-afa17e6cc7b5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "POST /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e/action" status: 202 len: 0 microversion: 2.1 time: 0.133863 Aug 27 21:43:59.907172 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3231/6561] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:43:59 2022] POST /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:43:59.915505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:43:59.916121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:43:59.922640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.923305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.924098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:43:59.924962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:43:59.926067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:43:59.926497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:00.070090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:00.078222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-943fcb93-b42e-4432-973d-f84fe7724805 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1511 microversion: 2.1 time: 0.166831 Aug 27 21:44:00.079589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3331/6562] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:43:59 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:44:01.102252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:01.102892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:01.109787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:01.110277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:01.110745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:01.111571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:01.112068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:01.112523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:01.256301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:01.264501 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32ea3bb9-3701-42c2-b891-358bc1b942f6 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1511 microversion: 2.1 time: 0.167701 Aug 27 21:44:01.265075 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3232/6563] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:01 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:02.286458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:02.287159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:02.294397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:02.294889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:02.295332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:02.296055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:02.296511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:02.296938 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:02.447199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:02.455263 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f944a2dd-3736-437e-bc45-0cf207ec6f26 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1511 microversion: 2.1 time: 0.172837 Aug 27 21:44:02.455846 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3332/6564] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:02 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:03.479781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:03.480349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:03.487873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:03.488364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:03.488811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:03.489510 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:03.489972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:03.490401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:03.627308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:03.635530 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b7d2b451-e20a-4834-97ba-c6292597ba72 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.161358 Aug 27 21:44:03.636095 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3233/6565] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:03 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:04.662651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:04.663246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:04.671894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:04.672682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:04.673157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:04.673896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:04.674361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:04.674809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:04.815609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:04.825631 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6d840fdf-78ac-4b80-a2a1-841888bdb658 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.167304 Aug 27 21:44:04.826200 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3333/6566] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:04 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:05.846795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:05.847419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:05.855177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:05.855622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:05.856064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:05.856761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:05.857215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:05.857637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:05.999648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:06.007655 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ff4bf1d2-240d-48d1-85b0-927ffba352c5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.164906 Aug 27 21:44:06.008362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3234/6567] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:05 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:07.034188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:07.035055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:07.044539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:07.045029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:07.045517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:07.046183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:07.046636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:07.047086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:07.200034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:07.209572 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e2cf3c07-33e0-4983-bf7b-ff79e75ffb4b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.182129 Aug 27 21:44:07.210640 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3334/6568] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:07 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:08.237739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:08.238482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:08.246432 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:08.246916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:08.247380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:08.248064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:08.248514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:08.248937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:08.388329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:08.396285 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2e8a4ad3-22b4-4254-98c5-9a3433b7c5ea tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.163224 Aug 27 21:44:08.396865 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3235/6569] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:08 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:09.422839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:09.423620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:09.434890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:09.435747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:09.436375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:09.437487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:09.438196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:09.438879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:09.585594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:09.594370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-92d0e055-6854-4991-89ea-0cb1c953bdb5 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.178651 Aug 27 21:44:09.594960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3335/6570] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:09 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:10.621435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:10.622009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:10.629833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:10.630348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:10.630781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:10.631529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:10.631973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:10.632394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:10.773108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:10.784799 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb8ea718-5110-4bd1-b750-9903e69cf3fb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.168122 Aug 27 21:44:10.785682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3236/6571] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:10 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:11.808749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:11.809355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:11.816689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:11.817171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:11.817613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:11.818307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:11.818758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:11.819180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:11.963196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:11.972386 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3896b32c-1cd6-4bec-9c04-5f6ffe47cfc9 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.167768 Aug 27 21:44:11.972966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3336/6572] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:11 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:12.995809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:12.996499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:13.005574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:13.006175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:13.006716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:13.007732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:13.008297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:13.008865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:13.152183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:13.162223 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d39dc057-2772-49ae-acec-422aebe60a2c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.171570 Aug 27 21:44:13.162833 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3237/6573] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:12 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:14.186677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:14.187279 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:14.194749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:14.195237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:14.195717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:14.196402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:14.196859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:14.197275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:14.332362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:14.341766 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-45b417ea-0d2a-4bb0-83ee-c46e0e895101 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.160336 Aug 27 21:44:14.342358 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3337/6574] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:14 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:15.367282 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:15.368334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:15.380314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:15.381102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:15.381827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:15.382976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:15.383778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:15.384489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:15.526358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:15.536968 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7d8bc239-ce1d-4c18-b705-c4a86686272c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.176359 Aug 27 21:44:15.537544 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3238/6575] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:15 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:16.561458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:16.562742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:16.569590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:16.570017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:16.570457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:16.571158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:16.571657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:16.572094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:16.712039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:16.720613 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dba5a628-b961-4249-afde-732fe7a09807 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.165714 Aug 27 21:44:16.721176 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3338/6576] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:16 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:17.744477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:17.745263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:17.753850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:17.754350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:17.754794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:17.755538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:17.756003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:17.756436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:17.891754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:17.900259 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4a75b250-ca1b-4992-9ca1-c7233a368f31 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.161281 Aug 27 21:44:17.900840 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3239/6577] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:17 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:18.925504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:18.926225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:18.934833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:18.935451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:18.935970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:18.936778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:18.937547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:18.938475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:19.087400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:19.100848 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bc453f46-0dc6-4ed5-8f33-2bec08cb5605 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.181211 Aug 27 21:44:19.101722 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3339/6578] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:18 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:20.126212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:20.126862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:20.133974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:20.134464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:20.134905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:20.135634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:20.136096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:20.136529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:20.269586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:20.278057 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8b4800f0-def1-4c19-8567-9f62dd8d253d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.158900 Aug 27 21:44:20.278635 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3240/6579] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:20 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:21.302487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:21.303110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:21.309776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:21.310274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:21.310822 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:21.311554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:21.312020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:21.312431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:21.462947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:21.473437 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f03c7d92-6db7-4570-8c06-89c4364ac981 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.176213 Aug 27 21:44:21.473999 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3340/6580] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:21 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:22.499167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:22.500409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:22.508546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:22.509035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:22.509480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:22.510190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:22.510618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:22.511071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:22.646701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:22.659168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8759142c-0964-44db-af4f-2d200d64d69e tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.166315 Aug 27 21:44:22.660222 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3241/6581] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:22 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:23.689724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:23.691191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:23.703219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:23.704026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:23.704494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:23.705198 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:23.705665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:23.706099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:23.851016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:23.859331 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e661469-5823-49ba-91aa-e78abd46b7a1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.176305 Aug 27 21:44:23.860347 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3341/6582] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:23 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:24.884056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:24.884965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:24.894605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:24.895099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:24.895586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:24.896296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:24.896763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:24.897202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:25.041490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:25.049803 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d10b334f-93f6-4aa4-bb09-dca169b4dd25 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.171694 Aug 27 21:44:25.050405 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3242/6583] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:24 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:26.075029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:26.075827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:26.087193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:26.088010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:26.088648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:26.089764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:26.090695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:26.091392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:26.242366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:26.253933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7074e019-6d8e-49a8-8ba6-023d30645819 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.185476 Aug 27 21:44:26.254528 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3342/6584] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:26 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:27.278334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:27.279201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:27.289450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:27.290162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:27.290835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:27.291918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:27.292573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:27.293229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:27.297078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:27.440781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:27.449338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e6be487d-d3ee-44df-a0bd-9b31a7c92ffe tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.176662 Aug 27 21:44:27.449917 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3243/6585] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:27 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:28.473904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:28.474483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:28.477298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=28 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:28.482751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:28.483247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:28.483717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:28.484416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:28.484884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:28.485315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:28.488579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=84 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:28.624345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:28.632646 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3496d8b3-63ae-4375-bd6f-6691eec38ff1 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1516 microversion: 2.1 time: 0.163741 Aug 27 21:44:28.633276 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3343/6586] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:28 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:29.655546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:29.656197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:29.659115 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=34 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:29.664845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:29.665336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:29.665777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:29.666477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:29.666936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:29.667462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:29.806513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:29.815739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f0060fe8-cf25-47e2-a07f-87d9f622a09b tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1515 microversion: 2.1 time: 0.164947 Aug 27 21:44:29.816630 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3244/6587] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:29 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:30.034388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "name": "network-vif-unplugged", "status": "completed", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:30.044845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:30.045404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:30.046130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:30.058818 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Creating event network-vif-unplugged:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch2-master-1 Aug 27 21:44:30.065563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] Instance 7cd707b7-b6d6-4628-a687-85905cfd155e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:44:30.077109 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-464b8888-7527-4f55-8e5a-5e4aa784e5dc req-9a5b53f0-53eb-469b-a148-fe4bd4c9257f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046811 Aug 27 21:44:30.077749 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3344/6588] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:44:30.837751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:30.838705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:30.847568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:30.848181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:30.848656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:30.849399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:30.849860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:30.850270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:30.994210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:31.003187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b9edc49e-dad9-4752-88f2-5e06fbbd3b6a tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1515 microversion: 2.1 time: 0.169451 Aug 27 21:44:31.003841 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3245/6589] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:30 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:32.032361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:32.033348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:32.040449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:32.040947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:32.041385 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:32.042091 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:32.042587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:32.043019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:32.093099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:32.104740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:32.105310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:32.105831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:32.118887 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Creating event network-changed:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch2-master-1 Aug 27 21:44:32.125032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] Instance 7cd707b7-b6d6-4628-a687-85905cfd155e is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:44:32.137510 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cac548bf-34f6-4eb7-b0a7-746df250f06b req-5febe0aa-7837-4842-bd85-62baded3244d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048515 Aug 27 21:44:32.138259 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3246/6590] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:44:32.190776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:32.199186 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-227858fa-65af-4e4e-8fd2-0134d0cf292c tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1513 microversion: 2.1 time: 0.175740 Aug 27 21:44:32.199827 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3345/6591] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:32 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:33.229063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:33.230226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:33.239211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:33.239737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:33.240185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:33.240884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:33.241344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:33.241783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:33.381662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:33.393629 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4707176c-38ee-4fa7-ac6c-b0427ee473bb tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1513 microversion: 2.1 time: 0.173556 Aug 27 21:44:33.394226 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3247/6592] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:33 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:34.414346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:34.414967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:34.422174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:34.422671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:34.423118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:34.424129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:34.424625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:34.425085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:34.565841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:34.573879 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e43fa26e-447c-4b4b-a984-200d106e4321 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1510 microversion: 2.1 time: 0.163540 Aug 27 21:44:34.574464 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3346/6593] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:34 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:34.595044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:34.595581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:34.602844 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:34.603326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:34.603791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:34.604485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:34.604955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:34.605370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:34.634234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:44:34.694554 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.compute.api [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 21:44:36.319765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f42d5b4-fb3a-4d44-93f5-bf9f149e90ae tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 204 len: 0 microversion: 2.1 time: 1.728172 Aug 27 21:44:36.320309 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3248/6594] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:44:34 2022] DELETE /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 0 bytes in 1730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:44:36.328508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:36.329109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:36.336689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:36.337170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:36.337601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:36.338291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:36.338740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:36.339158 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:36.481485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:36.489705 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db4e498d-0edd-4965-ba21-05abc7016a3f tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1502 microversion: 2.1 time: 0.165154 Aug 27 21:44:36.490318 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3347/6595] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:36 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:37.387199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "name": "network-vif-plugged", "status": "completed", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:37.400203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:37.400690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:37.401126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:37.413028 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] Creating event network-vif-plugged:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch2-master-1 Aug 27 21:44:37.418112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-5979689e-295a-4bfe-9453-fa1d4d603bdc req-667ec8c7-ca52-43c0-80ac-b92ee12cb097 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Aug 27 21:44:37.418767 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3249/6596] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:44:37.515870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:37.516779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:37.524903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:37.525397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:37.525842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:37.526555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:37.527009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:37.527479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:37.663388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af4532ad2947e78dfc26c432c711f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38f8ecbb22904fcc8fff4cd28b2405cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:37.671875 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae36bc99-9bfd-4257-b08a-0ea2fa3da04d tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 200 len: 1502 microversion: 2.1 time: 0.162897 Aug 27 21:44:37.672457 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3348/6597] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:37 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:38.436818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd707b7-b6d6-4628-a687-85905cfd155e", "name": "network-vif-deleted", "tag": "51b13178-fced-4606-a84f-5e0d43205d5b"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:38.452577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.453116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.453559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.476923 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] Creating event network-vif-deleted:51b13178-fced-4606-a84f-5e0d43205d5b for instance 7cd707b7-b6d6-4628-a687-85905cfd155e on nch2-master-1 Aug 27 21:44:38.483354 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1c874065-2349-461e-86f8-c6d538c79711 req-942b4707-5c5a-4933-8668-d61781a0420d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050677 Aug 27 21:44:38.484050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3250/6598] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:44:38.693313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:38.694151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:38.701289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.701777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.702211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.702904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.703364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.703799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.719411 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] HTTP exception thrown: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Request method failure captured: Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e HTTP/1.1 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpAUMHQiSh3Dc-Rc7o5x4iyCZBFAWNPTmlPGxzIfmQ_sZXji8bIMhi_uNG3odXaZvIrYtsHnn-bvg2vP4cpFn-eEViV_IbOR7CBkkA1CL0_2RB-SojuM3oUvLMompSBXWbar_96LPCwY9I5pnQ0T3oOKHBj2Y0ILgMTONBmlOibX4Mo Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38f8ecbb22904fcc8fff4cd28b2405cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}] Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 04af4532ad2947e78dfc26c432c711f2 Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7cd707b7-b6d6-4628-a687-85905cfd155e'} Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.721107 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Returning 404 to user: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73e87651-6712-45fe-acaf-5e3ccca4f757 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 404 len: 111 microversion: 2.1 time: 0.033860 Aug 27 21:44:38.726173 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3349/6599] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:38 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:44:38.750008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:38.750008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:38.756858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.757357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.757799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.758511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.758995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.759455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.773528 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] HTTP exception thrown: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Request method failure captured: Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e HTTP/1.1 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpAUMHQiSh3Dc-Rc7o5x4iyCZBFAWNPTmlPGxzIfmQ_sZXji8bIMhi_uNG3odXaZvIrYtsHnn-bvg2vP4cpFn-eEViV_IbOR7CBkkA1CL0_2RB-SojuM3oUvLMompSBXWbar_96LPCwY9I5pnQ0T3oOKHBj2Y0ILgMTONBmlOibX4Mo Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38f8ecbb22904fcc8fff4cd28b2405cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}] Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 04af4532ad2947e78dfc26c432c711f2 Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7cd707b7-b6d6-4628-a687-85905cfd155e'} Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:44:38.775220 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Returning 404 to user: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32884a06-4c7f-4efa-906f-4f904a6e5424 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 404 len: 111 microversion: 2.1 time: 0.035049 Aug 27 21:44:38.779588 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3251/6600] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:44:38 2022] DELETE /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:44:38.789527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:38.789527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] [instance: 7cd707b7-b6d6-4628-a687-85905cfd155e] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:38.792931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.793430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.795466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.795466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:38.795466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:38.795466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:38.811062 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] HTTP exception thrown: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Request method failure captured: Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e HTTP/1.1 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpAUMHQiSh3Dc-Rc7o5x4iyCZBFAWNPTmlPGxzIfmQ_sZXji8bIMhi_uNG3odXaZvIrYtsHnn-bvg2vP4cpFn-eEViV_IbOR7CBkkA1CL0_2RB-SojuM3oUvLMompSBXWbar_96LPCwY9I5pnQ0T3oOKHBj2Y0ILgMTONBmlOibX4Mo Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/38f8ecbb22904fcc8fff4cd28b2405cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_38f8ecbb22904fcc8fff4cd28b2405cc", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/38f8ecbb22904fcc8fff4cd28b2405cc"}]}] Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 38f8ecbb22904fcc8fff4cd28b2405cc Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-DeleteServersTestJSON-1736008739 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 04af4532ad2947e78dfc26c432c711f2 Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-DeleteServersTestJSON-1736008739-project Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7cd707b7-b6d6-4628-a687-85905cfd155e'} Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:44:38.812565 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] Returning 404 to user: Instance 7cd707b7-b6d6-4628-a687-85905cfd155e could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-312de53e-d75f-498d-99dc-6edc6afbccc4 tempest-DeleteServersTestJSON-1736008739 tempest-DeleteServersTestJSON-1736008739-project] 10.222.0.40 "GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e" status: 404 len: 111 microversion: 2.1 time: 0.032598 Aug 27 21:44:38.820116 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3350/6601] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:38 2022] GET /compute/v2.1/servers/7cd707b7-b6d6-4628-a687-85905cfd155e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:44:47.466084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-408984851", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "6a1ff45d-e0d6-4468-9463-6e50e5197554"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:47.521429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] validate_networks() for [('6a1ff45d-e0d6-4468-9463-6e50e5197554', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:44:47.935893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:44:47.936494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:44:47.937006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:44:47.937415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:44:47.937825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:44:47.947856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:47.948361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:47.948796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:47.949557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:47.950043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:47.950497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:47.968243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:44:47.973568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for user 9cd54b61587c4e3396a9fc079904ebda and project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:44:47.985876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:44:47.988307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:44:48.037310 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b34181c9-df41-45da-97f9-bf50f9467d4c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706588 Aug 27 21:44:48.037982 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3252/6602] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:44:48.051114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14a64b40-edbb-45ac-bb90-984817e78782 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:48.051984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14a64b40-edbb-45ac-bb90-984817e78782 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:48.112169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-14a64b40-edbb-45ac-bb90-984817e78782 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:48.120443 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14a64b40-edbb-45ac-bb90-984817e78782 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1217 microversion: 2.1 time: 0.074444 Aug 27 21:44:48.121035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3351/6603] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:48 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:49.142032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:49.142805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:49.150198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:49.150687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:49.151123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:49.151853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:49.152329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:49.152779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:49.227798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:49.237628 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-95a4724a-fb7b-44f1-acd1-6d9c4f9d2103 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1269 microversion: 2.1 time: 0.100433 Aug 27 21:44:49.238448 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3253/6604] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:49 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:50.259702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:50.260697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:50.263575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=37 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:50.272436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:50.273270 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:50.273895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:50.274625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:50.275166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:50.275640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:50.343195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:50.353013 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-79eebe5b-8810-4478-b9ea-2c3965d08d10 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1275 microversion: 2.1 time: 0.097496 Aug 27 21:44:50.355390 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3352/6605] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:50 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:51.160988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:51.185395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:51.186350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:51.186840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:51.217296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] Creating event network-changed:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch2-master-1 Aug 27 21:44:51.224626 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4cda39ef-5b1b-4c22-bc50-391aa69522c0 req-ddc50f42-8ea6-4071-8da9-5e2df999c579 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074650 Aug 27 21:44:51.225506 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3254/6606] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:44:51.375630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:51.376387 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:51.384561 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:51.385324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:51.385993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:51.386968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:51.388546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:51.389287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:51.541513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:51.549987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84c01b58-d466-4787-acb5-c00bc3b1901e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.179017 Aug 27 21:44:51.550554 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3353/6607] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:51 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:52.574101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:52.574722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:52.582409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:52.582903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:52.583362 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:52.584082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:52.584546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:52.584965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:52.724953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:52.736099 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80b09858-f38b-4242-b4a2-f9de80efc3d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.166349 Aug 27 21:44:52.736706 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3255/6608] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:52 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:53.757707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:53.758349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:53.766000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:53.766474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:53.766928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:53.767673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:53.768126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:53.768771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:53.911323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:53.919893 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-216c0e2b-51f9-41ea-94d4-c3af7a71a6d0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.166121 Aug 27 21:44:53.920491 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3354/6609] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:53 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:54.944190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:54.945194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:54.956251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:54.956990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:54.957615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:54.958725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:54.959486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:54.960181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:55.098183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:55.106995 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7194236-6750-4210-a19f-3dbc494d867a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.169512 Aug 27 21:44:55.107595 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3256/6610] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:54 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:56.129771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:56.129771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:56.138770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:56.139185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:56.139770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:56.140472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:56.140928 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:56.141348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:56.306864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:56.316693 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c7aa36be-d7af-4aee-9213-1cea4fefc5ac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.191429 Aug 27 21:44:56.317464 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3355/6611] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:56 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:57.343251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:57.343880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:57.350964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:57.351586 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:57.351999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:57.352713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:57.353229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:57.353581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:57.356404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:57.499827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:57.503973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "name": "network-vif-plugged", "status": "completed", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:44:57.509598 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e20d5f9e-5ac0-4a02-ab01-a73bc4e448d9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.170550 Aug 27 21:44:57.510298 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3257/6612] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:57 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:57.516504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:57.517081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:57.517433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:57.532562 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] Creating event network-vif-plugged:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch2-master-1 Aug 27 21:44:57.537534 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f63f89a6-e94e-43a6-8097-3e2f8899b3f8 req-7a1486cc-5708-45ec-a9cd-f43ffcb4d159 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037511 Aug 27 21:44:57.538143 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3356/6613] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:44:58.530439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:58.531061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:58.533145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:58.533807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:58.540148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:58.540632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:58.541074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:58.541770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:58.542222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:58.542639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:58.687278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:58.695511 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4ce09cc0-9f6a-415c-8381-f32c93ba7676 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1317 microversion: 2.1 time: 0.168984 Aug 27 21:44:58.696082 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3258/6614] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:58 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:59.717887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:59.726426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:59.727674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:59.729496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=30 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:59.735410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:59.735905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:59.736347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:59.737068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:59.737529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:59.737953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:59.877390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:44:59.885600 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7c5e1d5d-f8f2-4045-b6f0-93e88368159c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1507 microversion: 2.1 time: 0.170055 Aug 27 21:44:59.886263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3357/6615] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:59 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:44:59.908760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:44:59.909389 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:44:59.913446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:44:59.919377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:59.919865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:59.920307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:44:59.921014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:44:59.921474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:44:59.921909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.064005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:00.074215 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0a4c112a-2fbc-4146-bb74-b8b0369444fa tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1507 microversion: 2.1 time: 0.171775 Aug 27 21:45:00.074821 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3259/6616] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:44:59 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:00.098740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:00.101196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:00.107941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.108442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.108893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.109620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.110082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.110515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.178012 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93663321-ce4b-4c83-ad23-e40a11aa3407 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "PUT /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1079 microversion: 2.1 time: 0.083194 Aug 27 21:45:00.178667 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3358/6617] 10.222.0.40 () {60 vars in 1256 bytes} [Sat Aug 27 21:45:00 2022] PUT /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:00.196816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:00.197440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:00.205907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.206422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.206865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.208133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.208837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.209291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.366100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:00.378221 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0c22c3b7-38cf-4b71-9911-db434f3444db tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1505 microversion: 2.1 time: 0.185388 Aug 27 21:45:00.379097 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3260/6618] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:00 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:00.403086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:00.404045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:00.413182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.413882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.414328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.415055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.415549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.415986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.555476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:00.563529 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-36aca9e8-7458-49ac-8a87-81af850c4447 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1505 microversion: 2.1 time: 0.167055 Aug 27 21:45:00.564100 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3359/6619] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:00 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:00.584061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:00.586498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:00.593798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.594294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.594725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.595468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.595927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.596351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.627371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:00.633861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:45:00.640604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:45:00.641052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:45:00.641520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:45:00.641898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:45:00.642324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:45:00.712571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0898c28-1cfd-4b32-87a5-84e4fe2bd4b8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b/action" status: 202 len: 0 microversion: 2.1 time: 0.132453 Aug 27 21:45:00.713302 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3261/6620] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:45:00 2022] POST /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:45:00.722020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:00.722631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:00.730663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.731224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.731751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.732524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:00.732955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:00.733415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:00.872712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:00.881006 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-96eadfb5-d0ca-4808-9180-77a0b40a49c6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1516 microversion: 2.1 time: 0.162854 Aug 27 21:45:00.883210 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3360/6621] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:00 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:45:01.908083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:01.908992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:01.918565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:01.919052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:01.919435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:01.920164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:01.920619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:01.921085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:02.078118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:02.086580 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec43e6d7-f504-4e9e-a696-a17d6a1a7fc5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1516 microversion: 2.1 time: 0.185175 Aug 27 21:45:02.087183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3262/6622] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:01 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:03.112565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:03.113322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:03.122799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:03.123351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:03.123852 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:03.124548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:03.125032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:03.125456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:03.272608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:03.281300 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aac1d1fa-4c3f-4519-ac51-4528ec46a75d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.175609 Aug 27 21:45:03.281907 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3361/6623] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:03 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:04.308561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:04.309605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:04.321953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:04.322160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:04.322609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:04.323328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:04.323827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:04.324259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:04.469627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:04.482265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21dc7ec7-8bd9-4dc0-9502-f724c3fa4a52 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.180935 Aug 27 21:45:04.483129 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3263/6624] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:04 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:05.511124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:05.512230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:05.524689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:05.525299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:05.525777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:05.526492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:05.526953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:05.527423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:05.674490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:05.682619 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9bd66c06-7d4a-441b-ab68-205b7c68227e tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.178234 Aug 27 21:45:05.683192 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3362/6625] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:05 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:06.704871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:06.705485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:06.714961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:06.716051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:06.716528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:06.717580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:06.718056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:06.718486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:06.860702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:06.869352 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6bd1f1d-cdfa-4df7-8282-11b8e983a271 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.168478 Aug 27 21:45:06.869926 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3264/6626] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:06 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:07.894564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:07.895576 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:07.908329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:07.909129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:07.909849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:07.911037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:07.911842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:07.912546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:08.076321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:08.084629 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-82090af3-ffc7-432e-9840-ef50e57fd9bd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.196748 Aug 27 21:45:08.085217 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3363/6627] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:07 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:09.106939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:09.107548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:09.115088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:09.115615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:09.116500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:09.116760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:09.117214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:09.117711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:09.256705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:09.265146 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cd49df6a-2507-49ee-b9fa-dc1545930e7f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.162758 Aug 27 21:45:09.265726 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3265/6628] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:09 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:10.286658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:10.287397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:10.295497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:10.296038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:10.296543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:10.297283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:10.297853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:10.298287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:10.438551 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:10.447020 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1842ff70-5282-4f79-99ce-8140f82f7d3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.164533 Aug 27 21:45:10.447643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3364/6629] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:10 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:11.474283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:11.475086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:11.487290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:11.488178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:11.488881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:11.490006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:11.490817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:11.491661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:11.632356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:11.640818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-83bc6f95-537c-4e15-b453-f0c44a280f3c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.173631 Aug 27 21:45:11.641376 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3266/6630] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:11 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:12.664782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:12.665468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:12.675240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:12.675934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:12.676530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:12.677462 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:12.678078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:12.678654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:12.814931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:12.823441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4008c17d-a930-410d-9f3b-138ad2445f2a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.164250 Aug 27 21:45:12.824289 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3365/6631] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:12 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:13.848622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:13.849563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:13.859298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:13.859821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:13.860256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:13.860951 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:13.861400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:13.861855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:14.002866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:14.011029 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cfe936b-1021-41e4-a12a-b92d42c5acb4 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.168476 Aug 27 21:45:14.011676 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3267/6632] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:13 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:15.034649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:15.035223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:15.043212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:15.043768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:15.044240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:15.044980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:15.045468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:15.045923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:15.195063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:15.203474 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8cb859b9-35fb-45eb-96c2-6da08f4c80c5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.173563 Aug 27 21:45:15.204104 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3366/6633] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:15 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:16.236765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:16.237790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:16.249495 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:16.250322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:16.251067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:16.252287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:16.252986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:16.253538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:16.404246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:16.413209 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5772647-e9db-4b87-bf2d-9313d7e5ca6a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.183223 Aug 27 21:45:16.413787 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3268/6634] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:16 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:17.434809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:17.435441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:17.443056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:17.443589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:17.444071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:17.444772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:17.445238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:17.445728 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:17.582220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:17.590935 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0104af38-6e7e-4bb2-aa8b-c294013fd491 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.159796 Aug 27 21:45:17.591594 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3367/6635] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:17 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:18.618331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:18.619243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:18.629977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:18.630466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:18.630908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:18.631650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:18.632114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:18.632543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:18.788138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:18.796744 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-47a72409-f1f6-4b9e-8336-ce260543063d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.185414 Aug 27 21:45:18.797328 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3269/6636] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:18 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:19.821639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:19.822246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:19.831718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:19.832268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:19.832799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:19.833642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:19.834127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:19.834560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:19.854888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:19.974829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:19.982930 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0c2bf7e-3762-4cc1-808b-42e5668f45d2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.167934 Aug 27 21:45:19.983557 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3368/6637] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:19 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:21.004329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:21.005458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:21.013049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:21.013536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:21.014010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:21.014708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:21.015165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:21.015633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:21.156073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:21.169765 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b67e76f1-865d-4681-9cfd-e9f119c969e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.169198 Aug 27 21:45:21.170603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3270/6638] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:20 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:22.194477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:22.195099 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:22.202645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:22.203137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:22.203664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:22.204369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:22.204828 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:22.205261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:22.342857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:22.351254 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-204da559-0a31-45ef-9508-641a93d08161 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.161074 Aug 27 21:45:22.351856 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3369/6639] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:22 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:23.376946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:23.378032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:23.389929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:23.390731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:23.391505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:23.392696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:23.393408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:23.394110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:23.540921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:23.549373 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34e1bc1d-6924-41bc-b118-640815ebf3ed tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.179174 Aug 27 21:45:23.549953 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3271/6640] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:23 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:24.572618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:24.573195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:24.580908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:24.581391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:24.581843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:24.582537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:24.582972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:24.583463 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:24.726315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:24.734974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56b0bb08-496d-4802-92c0-80458ccc78cf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.166576 Aug 27 21:45:24.735794 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3370/6641] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:24 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:25.760804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:25.761859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:25.773341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:25.773828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:25.774266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:25.774965 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:25.775434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:25.775879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:25.790926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:25.911417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:25.920614 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-efe76e65-0bd7-4ef5-8f54-f3e3a04a7296 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.166486 Aug 27 21:45:25.921188 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3272/6642] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:25 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:26.947201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:26.948283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:26.961071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:26.961755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:26.962290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:26.962991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:26.963459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:26.963883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:27.098905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:27.111090 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-44c9e1d9-d3bb-4468-804e-2bafd9114b8b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.170982 Aug 27 21:45:27.111915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3371/6643] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:26 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:28.136259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:28.136900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:28.144146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:28.144656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:28.145113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:28.145839 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:28.146315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:28.146755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:28.293372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:28.301575 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1a95a97d-cf40-4549-97c4-9b123b80d327 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.170119 Aug 27 21:45:28.302146 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3273/6644] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:28 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:29.326134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:29.327180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:29.337635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:29.338123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:29.338560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:29.339262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:29.339749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:29.340513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:29.486045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:29.494499 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be6bb2a7-814e-4f55-8902-b84c68e17eac tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1521 microversion: 2.1 time: 0.174799 Aug 27 21:45:29.495110 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3372/6645] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:29 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:30.302622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "name": "network-vif-unplugged", "status": "completed", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:30.309993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=34 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:30.316434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:30.316918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:30.317350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:30.330617 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Creating event network-vif-unplugged:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch1-master-1 Aug 27 21:45:30.336139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:45:30.348898 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-244dfe61-2ac2-4818-b5fe-2e71bb0f0c70 req-69cc4a21-6708-43b9-8a50-613ff78ee4ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050009 Aug 27 21:45:30.349512 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3274/6646] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:30.517402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:30.517973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:30.520975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=32 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:30.526926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:30.527450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:30.527894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:30.528606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:30.529063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:30.529492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:30.675380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:30.683970 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4374dc5f-dfa6-4895-b4e9-9ccccfc738ff tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1520 microversion: 2.1 time: 0.170944 Aug 27 21:45:30.685216 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3373/6647] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:30 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:31.709703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:31.710686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:31.719449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:31.719947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:31.720394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:31.721090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:31.721548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:31.721980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:31.865607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:31.877420 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a2f5021d-6b8c-4d74-9f9e-4b3350cddcdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1518 microversion: 2.1 time: 0.174186 Aug 27 21:45:31.878170 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3275/6648] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:31 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:32.373860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:32.384633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:32.385114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:32.385548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:32.397610 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Creating event network-changed:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch1-master-1 Aug 27 21:45:32.403727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:45:32.414985 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f91aea3e-8f43-460a-a799-8f7dc6cdc7f4 req-fbfa4a40-41f3-4155-82af-70dc769f7622 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044861 Aug 27 21:45:32.415649 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3374/6649] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:32.898930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:32.899756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:32.907128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:32.907656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:32.908105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:32.908816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:32.909277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:32.909715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:33.383691 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:33.394225 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0739fabc-515e-42d5-bc17-53a4b37af725 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1518 microversion: 2.1 time: 0.499068 Aug 27 21:45:33.395027 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3276/6650] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:32 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1518 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:34.424454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:34.425164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:34.432452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.432982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.433437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.434155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.434804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.435226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.575685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:34.583800 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a5c42a2b-a97e-4489-9528-2c24085ae5f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1515 microversion: 2.1 time: 0.165143 Aug 27 21:45:34.584619 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3375/6651] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:34 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:34.605051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:34.605673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:34.612909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.613419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.613850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.614559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.615019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.615487 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.675071 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-166c58d5-5c29-4d42-904d-5b4d3119c9f8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b/action" status: 204 len: 0 microversion: 2.1 time: 0.074054 Aug 27 21:45:34.675838 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3277/6652] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:45:34 2022] POST /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:45:34.684252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:34.684871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:34.691179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.691718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.692230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.693147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:34.693648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:34.694217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:34.829935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:34.838671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2591a9a-16a5-4692-aa18-3050caf261b9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1515 microversion: 2.1 time: 0.158194 Aug 27 21:45:34.839389 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3376/6653] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:34 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:35.871369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:35.872086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:35.878861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:35.879374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:35.879831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:35.880537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:35.880996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:35.881453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:36.027744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:36.038517 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4008f3d-c8fb-408e-852a-5df1dc01ae1f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1515 microversion: 2.1 time: 0.179957 Aug 27 21:45:36.039568 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3278/6654] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:35 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:37.064130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:37.065188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:37.075566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:37.076058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:37.076495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:37.077193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:37.077645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:37.078069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:37.239286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:37.247607 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1cd091e8-5092-471e-a005-f9e69b3d5810 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1507 microversion: 2.1 time: 0.190181 Aug 27 21:45:37.248177 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3377/6655] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:37 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:37.268195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:37.268784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:37.276729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:37.277221 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:37.277669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:37.278390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:37.278848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:37.279279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:37.412630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:37.423994 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4550f155-6057-4c91-a557-64c70ad320ba tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1507 microversion: 2.1 time: 0.159377 Aug 27 21:45:37.424770 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3279/6656] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:37 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:45:37.450302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f13ebfbd-7e23-49ce-ab98-b2d3e9eb2bbe tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'create', calling method: .version_select at 0x7ff84dd1c040>, body: {"keypair": {"name": "tempest-keypair-1641238386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ19Jt6oil8xs5lMuwm6e5q7L8q12OQnHTZD8qJCTT4HnDW3YSVL4ZySeI1yk/73B4N25E0cu5CZdVXDHHGXHzVefKVG5ERWWPZh/Iucqqi1ysZaIoIUaks7N2wJBAZmA=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:37.468294 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f13ebfbd-7e23-49ce-ab98-b2d3e9eb2bbe tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:45:37.473793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f13ebfbd-7e23-49ce-ab98-b2d3e9eb2bbe tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for user 9cd54b61587c4e3396a9fc079904ebda and project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:45:37.505570 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f13ebfbd-7e23-49ce-ab98-b2d3e9eb2bbe tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059195 Aug 27 21:45:37.506226 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3378/6657] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:45:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:37.636902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "name": "network-vif-plugged", "status": "completed", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:37.647778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:37.648513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:37.648960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:37.660826 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] Creating event network-vif-plugged:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch1-master-1 Aug 27 21:45:37.666310 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b6e42949-b131-498e-8c64-814897c5ce86 req-03deea59-bd9d-4494-936a-9f2e4820d96e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Aug 27 21:45:37.667171 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3280/6658] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:38.784507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:38.785221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:38.792774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:38.793323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:38.793773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:38.794497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:38.794962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:38.795386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:38.934702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:38.946787 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2760a3e5-8b4f-4655-b6ca-c745e37b061f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 200 len: 1507 microversion: 2.1 time: 0.166980 Aug 27 21:45:38.947599 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3379/6659] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:38 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:38.974712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:38.975269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:38.983604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:38.984252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:38.984811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:38.985797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:38.986263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:38.986824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:39.014913 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:45:39.097377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0236bf2e-9ba3-47eb-9599-fe985c316c30 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 204 len: 0 microversion: 2.1 time: 0.127675 Aug 27 21:45:39.097995 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3281/6660] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:45:38 2022] DELETE /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:45:39.152987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2021445871", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "6a1ff45d-e0d6-4468-9463-6e50e5197554"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:39.207730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] validate_networks() for [('6a1ff45d-e0d6-4468-9463-6e50e5197554', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:45:39.618415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:45:39.619358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:45:39.619850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:45:39.620266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:45:39.620683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:45:39.630610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:39.631092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:39.631567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:39.632307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:39.632770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:39.633201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:39.651888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:45:39.657178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Getting quotas for user 9cd54b61587c4e3396a9fc079904ebda and project 8d5a1938d9ac4396988bc73d6944b34d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:45:39.670628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:45:39.673033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:45:39.721633 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f30f9571-34a3-4773-8194-d880d1240e8a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572573 Aug 27 21:45:39.722296 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3380/6661] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:45:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:45:39.734163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e9bc27b-e6ab-449c-8511-0254774d3588 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:39.734886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e9bc27b-e6ab-449c-8511-0254774d3588 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:39.790562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e9bc27b-e6ab-449c-8511-0254774d3588 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:39.801244 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e9bc27b-e6ab-449c-8511-0254774d3588 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1218 microversion: 2.1 time: 0.071648 Aug 27 21:45:39.801871 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3282/6662] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:39 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:40.823549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:40.824733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:40.834975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:40.835526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:40.835972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:40.836683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:40.837173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:40.837610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:41.233839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:41.243426 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-042a38be-afde-4b43-9b16-565edd8cdcf8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1270 microversion: 2.1 time: 0.424753 Aug 27 21:45:41.255676 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3381/6663] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:40 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1270 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:42.023891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59409554-e3da-4025-b5a9-4e39c07d4a5b", "name": "network-vif-deleted", "tag": "04743f62-82cf-4190-84c0-d8576f01ee09"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:42.048809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:42.049304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:42.049746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:42.071830 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] Creating event network-vif-deleted:04743f62-82cf-4190-84c0-d8576f01ee09 for instance 59409554-e3da-4025-b5a9-4e39c07d4a5b on nch1-master-1 Aug 27 21:45:42.077660 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-047f986f-4b87-448b-9f42-3f9a399f2b97 req-bfcf0375-b38d-40b4-8e4e-d53a15523218 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058161 Aug 27 21:45:42.078250 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3283/6664] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:42.266212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:42.267579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:42.275672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:42.276170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:42.276632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:42.277451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:42.278211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:42.278662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:42.453692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:42.463853 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0392aecc-d3a2-4c13-81aa-55ffe01b4a53 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.201633 Aug 27 21:45:42.475424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3382/6665] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:42 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:43.489853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:43.490545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:43.497200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:43.497692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:43.498130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:43.498824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:43.499245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:43.499703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:43.635563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:43.643721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c3697306-e62b-4644-b599-b15076303e95 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.159130 Aug 27 21:45:43.644308 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3284/6666] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:43 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:44.096173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:44.107102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:44.107629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:44.108067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:44.119708 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] Creating event network-changed:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch1-master-1 Aug 27 21:45:44.124855 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-4f43e856-2b12-4063-b94d-0766d8102fec req-d9268185-b59a-44db-afae-b93878cee54b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Aug 27 21:45:44.125482 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3383/6667] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:44.668744 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:44.669749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:44.681638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:44.682458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:44.683170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:44.684464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:44.685248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:44.685981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:44.835255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:44.844258 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b58824ad-e5ff-46df-ab45-58c32e8809fb tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.182378 Aug 27 21:45:44.844846 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3285/6668] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:44 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:45.866332 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:45.867289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:45.875358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:45.875866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:45.876316 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:45.877020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:45.877480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:45.877910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:46.015775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:46.023867 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6119aa19-6df1-4fe7-9147-462f6c007ce2 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.162076 Aug 27 21:45:46.024505 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3384/6669] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:45 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:47.045512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:47.046084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:47.053629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:47.054126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:47.054575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:47.055380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:47.055897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:47.056408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:47.194849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:47.206314 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c07d6f1f-976d-4d20-bf9e-97b48d211cf6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.164778 Aug 27 21:45:47.207089 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3286/6670] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:47 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:47.682919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "name": "network-vif-plugged", "status": "completed", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:47.693886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:47.694383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:47.694795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:47.706807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] Creating event network-vif-plugged:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch1-master-1 Aug 27 21:45:47.711953 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-202acd7c-3766-4562-8714-8c3601b30b36 req-a948d560-345e-4522-86a0-8fecc2ca9ed9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Aug 27 21:45:47.712625 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3385/6671] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:45:48.234505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:48.235103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:48.242667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:48.243158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:48.243644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:48.244353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:48.244823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:48.245260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:48.394330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:48.402555 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-da51d039-1df3-45b4-96fa-5d3a66f98b78 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1318 microversion: 2.1 time: 0.173852 Aug 27 21:45:48.403130 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3287/6672] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:48 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:49.425115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:49.425750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:49.432632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.433124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.433570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.434269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.434731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.435162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.581040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:49.589334 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f22aa10b-06c7-4ff0-a1ea-1ed959efac5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1507 microversion: 2.1 time: 0.170012 Aug 27 21:45:49.589915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3386/6673] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:49 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:49.610718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:49.611331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:49.618707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.619197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.619669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.620333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.620787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.621231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.760648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:49.764281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:49.770472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e5b2e0a-813a-4ce8-a1fe-18853ddfd0ee tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1507 microversion: 2.1 time: 0.163810 Aug 27 21:45:49.771052 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3288/6674] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:49 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:49.792197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:45:49.794532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:49.796739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:49.797562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=10 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:49.804303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.804805 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.805256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.805965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:49.806428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:49.806857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:49.873121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=93 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:49.888801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:49.895202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Old instance type m1.heat2, new instance type m1.heat {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:45:49.901954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:45:49.902375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:45:49.902853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:45:49.903264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:45:49.903742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:45:50.020683 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d82025d6-fd6c-42e9-a785-961a47e2e466 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516/action" status: 202 len: 0 microversion: 2.1 time: 0.232799 Aug 27 21:45:50.021220 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3387/6675] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:45:49 2022] POST /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:45:50.030128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:50.030772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:50.032668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:45:50.039268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:50.039817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:50.040266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:50.040959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:50.041412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:50.041835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:50.182251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:50.190720 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e3f2a4e5-bc8b-4731-a200-335877c61361 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1514 microversion: 2.1 time: 0.164927 Aug 27 21:45:50.191289 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3289/6676] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:50 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:51.216756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:51.217749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:51.231868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:51.232688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:51.233432 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:51.234912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:51.236114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:51.236230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:51.382715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:51.391784 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6010ed15-04d9-48d9-9970-83d843748cb9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1514 microversion: 2.1 time: 0.181389 Aug 27 21:45:51.392379 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3388/6677] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:51 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:52.413700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:52.414311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:52.421821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:52.422315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:52.422736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:52.423514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:52.423964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:52.424396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:52.564909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:52.573011 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8e5cee54-9452-44b4-8552-4075c74b0c9d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.163249 Aug 27 21:45:52.573508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3290/6678] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:52 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:53.599102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:53.599954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:53.611051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:53.611590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:53.612042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:53.612747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:53.613210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:53.613640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:53.760200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:53.768821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-019d4073-848b-472c-97de-318079bf4e08 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.176997 Aug 27 21:45:53.769436 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3389/6679] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:53 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:54.794547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:54.795550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:54.805030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:54.805722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:54.806376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:54.807287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:54.807772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:54.808265 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:54.956743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:54.970075 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f1fcb15-ee89-4234-8862-fbaf3071797f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.183312 Aug 27 21:45:54.970796 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3291/6680] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:54 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:55.999225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:56.000032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:56.007800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:56.009229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:56.009229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:56.009466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:56.009895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:56.010331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:56.184430 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:56.194407 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-51120474-9616-4149-a75f-06f8119facab tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.201335 Aug 27 21:45:56.195047 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3390/6681] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:55 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:57.217963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:57.218737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:57.227484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:57.228065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:57.228595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:57.229426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:57.229969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:57.230477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:57.370716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:57.379373 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9f30ad36-fb68-4e38-9546-281bdd5fad47 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.166478 Aug 27 21:45:57.379957 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3292/6682] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:57 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:58.408950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:58.409979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:58.421907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:58.422731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:58.423524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:58.424562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:58.425029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:58.425467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:58.560513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:58.568909 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2e59393-42bb-43b0-a1f9-e05ad6900f69 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.166691 Aug 27 21:45:58.569506 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3391/6683] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:58 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:45:59.591053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:45:59.591718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:45:59.598477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:59.599001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:59.599486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:59.600175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:45:59.600663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:45:59.601126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:45:59.743223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:45:59.751718 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a203936b-e156-43e2-9c87-bd96909c3695 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.165233 Aug 27 21:45:59.752298 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3293/6684] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:45:59 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:00.776601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:00.777521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:00.781173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:00.789742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:00.790502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:00.791190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:00.792327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:00.793037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:00.793705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:00.942328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:00.950974 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-91c09be1-0fc3-4da3-9128-d5969e4ee3e5 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.180724 Aug 27 21:46:00.951621 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3392/6685] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:00 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:01.985134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:01.986201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:01.990224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:01.996635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:01.997278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:01.997731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:01.998447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:01.998909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:01.999366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:02.138426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:02.146956 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2c99c496-e206-41c4-82c2-8f68bbbb18d7 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.168431 Aug 27 21:46:02.147963 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3294/6686] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:01 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:03.176964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:03.177929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:03.191490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:03.192410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:03.193032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:03.193990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:03.194513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:03.195062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:03.336034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:03.344409 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db976dd6-e98d-445e-bbd7-e46edec9feb6 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.174219 Aug 27 21:46:03.344990 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3393/6687] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:03 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:04.366812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:04.367403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:04.374899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:04.375391 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:04.375857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:04.376584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:04.377014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:04.377443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:04.524721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:04.533112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a07fe4c-9a55-4da3-a47b-095b6f634cdd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.170640 Aug 27 21:46:04.533698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3295/6688] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:04 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:05.554653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:05.555412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:05.564634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:05.565128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:05.565602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:05.566315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:05.566777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:05.567232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:05.705278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:05.714101 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8811676b-3fc2-4005-ac32-e6da68b3cdbc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.163690 Aug 27 21:46:05.714660 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3394/6689] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:05 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:06.739888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:06.740862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:06.753124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:06.753928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:06.754658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:06.755845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:06.756598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:06.757420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:06.905274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:06.916168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ee7ccfcd-e347-4389-99f5-4696213afa09 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.182884 Aug 27 21:46:06.916723 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3296/6690] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:06 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:07.941533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:07.942583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:07.955295 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:07.956175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:07.956912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:07.958071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:07.958820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:07.959602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:08.098379 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:08.106880 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66433a3b-c1f2-4c84-8317-e9477147cedc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.172133 Aug 27 21:46:08.107490 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3395/6691] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:07 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:09.132906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:09.133532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:09.140972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:09.141468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:09.141915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:09.142618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:09.143082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:09.143557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:09.278153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:09.286503 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9706ba09-1e3c-488a-a7f7-b568a93aa20d tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.160421 Aug 27 21:46:09.287086 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3297/6692] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:09 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:10.316418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:10.316868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:10.324611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:10.325108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:10.325570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:10.326282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:10.326712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:10.327138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:10.471571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:10.480071 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-04bff95a-cdf5-4af3-86bb-8e4a96734f83 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.174258 Aug 27 21:46:10.493921 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3396/6693] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:10 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:11.506213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:11.507370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:11.515102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:11.515616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:11.516048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:11.516787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:11.517226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:11.517685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:11.669472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:11.677824 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-65e57c94-ac7d-4273-bad4-615f4d17127b tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.178491 Aug 27 21:46:11.678408 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3298/6694] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:11 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:12.703911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:12.704934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:12.717750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:12.718559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:12.719583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:12.720776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:12.721575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:12.722275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:12.859549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:12.867655 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7390be31-cf55-4c6a-850c-84d461642992 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.170474 Aug 27 21:46:12.868370 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3397/6695] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:12 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:13.894355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:13.895564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:13.903803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:13.904289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:13.904721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:13.905414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:13.905897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:13.906320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:14.042564 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:14.050663 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-af85ba43-28c7-4f57-8b25-9f552d91dfe3 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.162997 Aug 27 21:46:14.051242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3299/6696] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:13 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:15.075282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:15.076002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:15.085034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:15.085588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:15.086174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:15.087052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:15.087674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:15.088218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:15.228888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:15.236989 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-440ba9e3-bb7e-44ca-b58d-df990acbd1f9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.167246 Aug 27 21:46:15.237614 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3398/6697] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:15 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:16.263590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:16.264821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:16.275748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:16.276237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:16.276671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:16.277368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:16.277817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:16.278211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:16.419791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:16.428118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b142b3d7-9e3d-4d29-9bfe-7a4795506a5f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.172138 Aug 27 21:46:16.428702 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3300/6698] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:16 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:17.456927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:17.457959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:17.470047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:17.470855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:17.471622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:17.472785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:17.473540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:17.474247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:17.616293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:17.628671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f3dec572-f8e5-4ea7-9e3d-94c03f30220a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.178145 Aug 27 21:46:17.629374 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3399/6699] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:17 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:18.665738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:18.666533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:18.674234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:18.674738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:18.675185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:18.675930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:18.676393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:18.676826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:18.813431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:18.821612 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1230a98c-5f61-4739-b30a-a3945ae54814 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1519 microversion: 2.1 time: 0.162549 Aug 27 21:46:18.822274 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3301/6700] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:18 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:19.468669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "name": "network-vif-unplugged", "status": "completed", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:19.480615 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:19.481177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:19.481946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:19.497834 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Creating event network-vif-unplugged:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch2-master-1 Aug 27 21:46:19.503575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:46:19.515674 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ab59969b-f249-4d4a-ba81-7927d76489af req-69454a8f-8bd6-485e-b5c3-2f7b70165a68 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051134 Aug 27 21:46:19.516303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3400/6701] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:19.846757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:19.848093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:19.860883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:19.861774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:19.862587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:19.863899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:19.864746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:19.865528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:20.040429 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:20.043222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=83 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:20.050119 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f794ef6c-e561-41d0-86fd-633885d0421a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1518 microversion: 2.1 time: 0.210735 Aug 27 21:46:20.050717 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3302/6702] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:19 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:21.076770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:21.077595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:21.087578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:21.088454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:21.089089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:21.090003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:21.090980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:21.091630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:21.095146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:21.241503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:21.250299 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ce7279cc-7829-4f99-a794-53566717878c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1516 microversion: 2.1 time: 0.180443 Aug 27 21:46:21.250914 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3401/6703] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:21 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:21.544876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:21.559242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:21.559761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:21.560203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:21.572911 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Creating event network-changed:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch2-master-1 Aug 27 21:46:21.578558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:46:21.589600 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-42eee25a-a870-4556-9dbd-cbbfbd4a04d3 req-fca10b8a-b533-41c3-8b7d-c89f7ed8af63 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051203 Aug 27 21:46:21.590561 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3303/6704] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:22.276947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:22.277560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:22.285202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:22.285704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:22.286150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:22.286857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:22.287377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:22.287836 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:22.434484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:22.445010 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0275527e-5333-4971-99d7-d58be8f31bdc tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1516 microversion: 2.1 time: 0.174693 Aug 27 21:46:22.445616 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3402/6705] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:22 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:23.468724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:23.469719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:23.476253 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.476741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.477191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.477899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.478360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.478799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.613278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:23.621650 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cbfc7146-f4ba-4e37-9bca-8b960817fecf tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1513 microversion: 2.1 time: 0.158772 Aug 27 21:46:23.622242 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3304/6706] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:23 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:23.645057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:23.645598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:23.653540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.654036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.654517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.655825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.656319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.656757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.720685 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-03286088-0442-483b-a48c-b72dc1207f7c tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "POST /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516/action" status: 204 len: 0 microversion: 2.1 time: 0.079400 Aug 27 21:46:23.721288 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3403/6707] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:46:23 2022] POST /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:46:23.729695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:23.730333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:23.736725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.737220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.738039 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.738978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:23.739439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:23.740106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:23.890519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:23.898515 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b1e93465-29c1-4273-bbc6-bf9e1fdf2f91 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1513 microversion: 2.1 time: 0.172914 Aug 27 21:46:23.899123 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3305/6708] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:23 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:46:24.923529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:24.924148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:24.930795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:24.931311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:24.931782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:24.932484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:24.933066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:24.933785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:25.074398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:25.083480 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-59830652-391e-48ab-9ce6-029339212d2f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1513 microversion: 2.1 time: 0.165362 Aug 27 21:46:25.084364 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3404/6709] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:24 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:26.102376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "name": "network-vif-plugged", "status": "completed", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:26.107771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.108557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.115194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.115864 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.116422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.117971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.119019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.119716 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.122224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.122762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.123373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.128599 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] Creating event network-vif-plugged:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch2-master-1 Aug 27 21:46:26.133827 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-faf4e2b2-4699-4251-9409-0fcdd55c01cd req-89556c22-a961-4551-a872-651a6c8b7749 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035353 Aug 27 21:46:26.134449 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3306/6710] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:26.259073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:26.268224 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-775a1bb0-13a2-4ea5-96b1-ee0ba3be7f0a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1505 microversion: 2.1 time: 0.166075 Aug 27 21:46:26.268803 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3405/6711] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:26 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:26.297926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.298625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.305208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.305722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.306159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.306847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.307271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.307738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.455804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:26.470077 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c4d98680-d37c-4579-a729-1aeef58dd977 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1505 microversion: 2.1 time: 0.176571 Aug 27 21:46:26.470657 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3307/6712] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:26 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:26.494280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.495285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.501969 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.502471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.502907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.503645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.504109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.504541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.644630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:26.653103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-098ce452-86d8-46fb-aa6e-5fada4081d46 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1505 microversion: 2.1 time: 0.165540 Aug 27 21:46:26.653790 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3406/6713] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:26 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:26.678971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.679706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.687967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.688508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.688953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.689657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.690128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.690560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.718354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:46:26.798540 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b5632deb-2ba1-4824-8793-5bb8f99e1382 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 204 len: 0 microversion: 2.1 time: 0.125820 Aug 27 21:46:26.799247 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3308/6714] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:46:26 2022] DELETE /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:46:26.823797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.823797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.828818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.829322 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.829770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.830457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.830952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.831369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.860663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:46:26.914198 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.compute.api [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Instance is already in deleting state, ignoring this request Aug 27 21:46:26.915043 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1fe536da-49f0-46fe-8bf8-306006fdcfe9 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 204 len: 0 microversion: 2.1 time: 0.099980 Aug 27 21:46:26.915661 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3407/6715] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:46:26 2022] DELETE /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:46:26.926449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:26.927176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:26.933820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.934426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.934869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:26.935639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:26.936098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:26.936522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:27.081721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:27.091129 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-19da0324-1900-4a95-b3aa-3e34f77abfb8 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1511 microversion: 2.1 time: 0.169097 Aug 27 21:46:27.091794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3309/6716] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:26 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:28.114466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:28.115298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:28.125151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:28.125641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:28.126075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:28.126776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:28.127231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:28.127689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:28.273911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd54b61587c4e3396a9fc079904ebda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5a1938d9ac4396988bc73d6944b34d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:28.283544 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ebec4e57-2d54-421b-b0f0-a8d5da67bb4f tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 200 len: 1511 microversion: 2.1 time: 0.174906 Aug 27 21:46:28.284161 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3408/6717] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:28 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:28.858661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e81ec5e-2b4b-4344-b08f-49124e762516", "name": "network-vif-deleted", "tag": "7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:28.872972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:28.873818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:28.874471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:28.893879 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] Creating event network-vif-deleted:7f83b1e0-c2e5-44f2-b1ef-3ef7f8cbfb60 for instance 0e81ec5e-2b4b-4344-b08f-49124e762516 on nch2-master-1 Aug 27 21:46:28.899053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c810e04a-a9b9-4467-8d0a-bf23a80c62cf req-48d9400d-b20b-486b-b3f8-36f5978b4dad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044071 Aug 27 21:46:28.900689 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3310/6718] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:29.310986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:29.313250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 0e81ec5e-2b4b-4344-b08f-49124e762516] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:29.324122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:29.324634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:29.325080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:29.325802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:29.326261 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:29.326689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:29.344173 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] HTTP exception thrown: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Request method failure captured: Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 HTTP/1.1 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpBPxstScA-QCZal1IZl_S5pZWUn_Ez6IoOSpvL3CC6_Ic0871j3Kw4qZHOVgflC48e_aj6CT85LqUsWmD6CmlBgoN2lf3Dz2PS7oPkZ-FSiAxvwNbiTPsLrdRkUtu1RXeSke5_aQZVRYY0i1NS6NARTYZ4BwlDabReBAt_rFrbZEWE Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8d5a1938d9ac4396988bc73d6944b34d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}] Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9cd54b61587c4e3396a9fc079904ebda Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '0e81ec5e-2b4b-4344-b08f-49124e762516'} Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:29.345882 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Returning 404 to user: Instance 0e81ec5e-2b4b-4344-b08f-49124e762516 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb54bf73-a1c4-4fd2-9ab6-09a587d98228 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516" status: 404 len: 111 microversion: 2.1 time: 0.044829 Aug 27 21:46:29.350238 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3409/6719] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:29 2022] GET /compute/v2.1/servers/0e81ec5e-2b4b-4344-b08f-49124e762516 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:46:29.357245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-518c0062-47b8-4a81-94b1-dec4b99b49c0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '.version_select at 0x7ff84df0f430>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:29.361632 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-518c0062-47b8-4a81-94b1-dec4b99b49c0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 21:46:30.370740 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-518c0062-47b8-4a81-94b1-dec4b99b49c0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 35146. Aug 27 21:46:30.394532 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-518c0062-47b8-4a81-94b1-dec4b99b49c0 tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641238386" status: 202 len: 0 microversion: 2.1 time: 1.041788 Aug 27 21:46:30.395141 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3311/6720] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:46:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641238386 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:46:31.038644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:31.039171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:31.042123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=36 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:31.048262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:31.048715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:31.049154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:31.049851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:31.050298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:31.050726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:31.065791 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] HTTP exception thrown: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Request method failure captured: Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: request: DELETE /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b HTTP/1.1 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpBPxstScA-QCZal1IZl_S5pZWUn_Ez6IoOSpvL3CC6_Ic0871j3Kw4qZHOVgflC48e_aj6CT85LqUsWmD6CmlBgoN2lf3Dz2PS7oPkZ-FSiAxvwNbiTPsLrdRkUtu1RXeSke5_aQZVRYY0i1NS6NARTYZ4BwlDabReBAt_rFrbZEWE Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8d5a1938d9ac4396988bc73d6944b34d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}] Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 9cd54b61587c4e3396a9fc079904ebda Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '59409554-e3da-4025-b5a9-4e39c07d4a5b'} Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:46:31.067469 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Returning 404 to user: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6c9be628-bdd5-4042-a0cb-2ae51fd6e5dd tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "DELETE /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 404 len: 111 microversion: 2.1 time: 0.034399 Aug 27 21:46:31.071977 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3410/6721] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:46:31 2022] DELETE /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:46:31.079368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:31.080101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] [instance: 59409554-e3da-4025-b5a9-4e39c07d4a5b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:31.086517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:31.087014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:31.087490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:31.088194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:31.088657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:31.089091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:31.103478 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] HTTP exception thrown: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Request method failure captured: Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b HTTP/1.1 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpBPxstScA-QCZal1IZl_S5pZWUn_Ez6IoOSpvL3CC6_Ic0871j3Kw4qZHOVgflC48e_aj6CT85LqUsWmD6CmlBgoN2lf3Dz2PS7oPkZ-FSiAxvwNbiTPsLrdRkUtu1RXeSke5_aQZVRYY0i1NS6NARTYZ4BwlDabReBAt_rFrbZEWE Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8d5a1938d9ac4396988bc73d6944b34d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8d5a1938d9ac4396988bc73d6944b34d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8d5a1938d9ac4396988bc73d6944b34d"}]}] Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 8d5a1938d9ac4396988bc73d6944b34d Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-355920186 Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 9cd54b61587c4e3396a9fc079904ebda Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerDiskConfigTestJSON-355920186-project Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '59409554-e3da-4025-b5a9-4e39c07d4a5b'} Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:46:31.105111 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] Returning 404 to user: Instance 59409554-e3da-4025-b5a9-4e39c07d4a5b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f4337ec-df3f-4edf-98db-737d06d3485a tempest-ServerDiskConfigTestJSON-355920186 tempest-ServerDiskConfigTestJSON-355920186-project] 10.222.0.40 "GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b" status: 404 len: 111 microversion: 2.1 time: 0.032865 Aug 27 21:46:31.109583 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3312/6722] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:31 2022] GET /compute/v2.1/servers/59409554-e3da-4025-b5a9-4e39c07d4a5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:46:40.237104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-95d0541f-e818-48cc-9728-f61f7b6c56d2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'create', calling method: .version_select at 0x7ff84db564c0>, body: {"keypair": {"name": "tempest-keypair-1196508420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVUGmwA/A6GJ7JlpzOK/MBJCVYSyAYNQStrMnBRCf8YGpCu9EweipVx7gJmu/BRIW/zuV9u2cUu168Dag82/WN9NjHgY4QjbYD9dwwTd3XCO8CxxJQZbDgGzIQGLGM/nw=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:40.254224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-95d0541f-e818-48cc-9728-f61f7b6c56d2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:46:40.259733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-95d0541f-e818-48cc-9728-f61f7b6c56d2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:46:40.286427 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-95d0541f-e818-48cc-9728-f61f7b6c56d2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173913 Aug 27 21:46:40.287024 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3411/6723] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:46:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:41.614357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1016201133", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e275c09-e955-4381-9537-fe0388add10e"}], "security_groups": [{"name": "tempest-securitygroup--2125195220"}], "key_name": "tempest-keypair-1196508420", "user_data": "}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:41.625673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:41.626346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:41.735901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] validate_networks() for [('2e275c09-e955-4381-9537-fe0388add10e', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:46:42.114420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:46:42.115031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:46:42.115546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:46:42.116070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:46:42.116483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:46:42.131247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:42.131771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:42.132207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:42.132944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:42.133379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:42.133906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:42.151939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:46:42.157697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:46:42.170752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:46:42.173304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:46:42.222784 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-25eadf4a-8c8c-4dbf-99b7-b006fd271f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.612820 Aug 27 21:46:42.223625 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3313/6724] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:46:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:46:42.231670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:42.237982 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-486312d9-08f6-453f-9f1b-0f32165ae5ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:42.238723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-486312d9-08f6-453f-9f1b-0f32165ae5ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:42.328121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-486312d9-08f6-453f-9f1b-0f32165ae5ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:42.336026 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-486312d9-08f6-453f-9f1b-0f32165ae5ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1239 microversion: 2.1 time: 0.105078 Aug 27 21:46:42.337703 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3412/6725] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:42 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:43.361595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:43.362413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:43.371888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:43.372857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:43.373543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:43.374930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:43.375672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:43.376312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:43.463214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:43.472236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b4b47f56-c4c9-4f81-85af-847875cbb0dc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1299 microversion: 2.1 time: 0.116645 Aug 27 21:46:43.472711 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3314/6726] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:43 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:44.493058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:44.493659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:44.502303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:44.502801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:44.503240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:44.503968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:44.504449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:44.504967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:44.652178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:44.661428 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-488468f9-71b0-4281-b96d-7da3f09b3488 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.172347 Aug 27 21:46:44.662043 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3413/6727] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:44 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:44.809726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:44.824606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:44.825188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:44.825725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:44.837778 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] Creating event network-changed:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch2-master-1 Aug 27 21:46:44.844311 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a8b55b9b-70e4-46a8-8b35-fd676f9a6e20 req-03a6381e-21e9-4108-be4c-77380166bc3d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037796 Aug 27 21:46:44.845467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3315/6728] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:45.682772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:45.683433 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:45.691039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:45.691578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:45.692031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:45.692748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:45.693215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:45.693655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:45.843256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:45.852038 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-876f35c6-b9bd-43fd-a255-9d8a7c6a34b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.173356 Aug 27 21:46:45.852874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3414/6729] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:45 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:46.879810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:46.880524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:46.887727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:46.888247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:46.888662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:46.889715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:46.890193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:46.890652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:47.031042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:47.039372 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c8515fb7-f05b-4661-b5c7-b9b3029cb597 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.165670 Aug 27 21:46:47.039956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3316/6730] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:46 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:48.061820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:48.062496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:48.071090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:48.071673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:48.072172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:48.072951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:48.073467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:48.073948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:48.213162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:48.221978 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1f70dbc7-c2f6-4d90-a71a-af26d9224cf6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.164594 Aug 27 21:46:48.222787 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3415/6731] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:48 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:49.248114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:49.249157 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:49.262328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:49.263402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:49.264171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:49.265459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:49.265933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:49.266368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:49.412848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:49.420846 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-59de6d0d-fb6c-4303-8a5f-7075b5d77155 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.180119 Aug 27 21:46:49.421428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3317/6732] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:49 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:50.228351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "name": "network-vif-plugged", "status": "completed", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:50.240351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:50.240850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:50.241348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:50.253549 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] Creating event network-vif-plugged:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch2-master-1 Aug 27 21:46:50.259327 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-69ba6675-2690-4400-96fc-78b9254571f7 req-1b8e5fd9-db33-4d1e-95e0-6f4e5f5e80ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035025 Aug 27 21:46:50.259987 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3416/6733] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:50.442306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:50.442914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:50.450694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:50.451195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:50.451741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:50.452575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:50.453043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:50.453478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:50.588205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:50.597340 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ea4726c-01af-4fde-ab42-799009b8d9d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.159083 Aug 27 21:46:50.597971 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3318/6734] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:50 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:51.619237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:51.619973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:51.627872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:51.628361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:51.628797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:51.629496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:51.629953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:51.630392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:51.791103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:51.799892 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cdd1d7ab-82bd-4688-8b9e-3267aca63e7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1365 microversion: 2.1 time: 0.184979 Aug 27 21:46:51.800486 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3417/6735] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:51 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:52.821946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:52.822563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:52.825500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:52.826192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:52.832613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:52.833101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:52.833546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:52.834281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:52.834741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:52.835167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:52.972206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:46:52.984428 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e1b7ac66-5c98-4624-9fb0-8cb17d56555a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1552 microversion: 2.1 time: 0.166144 Aug 27 21:46:52.985007 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3319/6736] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:46:52 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:46:53.005069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:46:53.005624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:46:53.007609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:46:53.014351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:53.014925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:53.015605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:53.016363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:53.016833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:53.017257 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:53.099955 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a77dbfcc-62dc-4d1c-944d-ee06cd7c2f91 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098797 Aug 27 21:46:53.100572 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3418/6737] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:46:52 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:46:54.510213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:46:54.520748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:46:54.521284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:46:54.521931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:46:54.533828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] Creating event network-changed:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch2-master-1 Aug 27 21:46:54.538785 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d3ceaa4b-5aa4-4583-a15b-2d29e0a4c8ab req-0d459bde-4b61-4a2a-83de-d16b0e30924f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103432 Aug 27 21:46:54.539431 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3320/6738] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:47:59.103477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:47:59.104369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=30 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:47:59.109214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:47:59.109902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:47:59.117815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.118337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.118803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.119590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.120078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.120535 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.434157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:47:59.448803 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81836563-d316-4d8a-97c1-19636e619b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.346826 Aug 27 21:47:59.449564 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3419/6739] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:47:59 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:47:59.471016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:47:59.471865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=36 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:47:59.476600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:47:59.477338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:47:59.485473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.485972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.486409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.487437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.487904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.488337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.765223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:47:59.773560 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-36097831-45eb-4380-9438-c8b1f05ea33c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.305489 Aug 27 21:47:59.774146 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3321/6740] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:47:59 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:47:59.793902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:47:59.794515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:47:59.801256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.801746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.802183 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.802878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.803331 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.803795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.947621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:47:59.960386 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f4faec49-d32f-4459-be76-9958ab9f660f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.170026 Aug 27 21:47:59.961100 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3420/6741] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:47:59 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:47:59.985684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:47:59.988336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:47:59.994639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.995133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.995607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:47:59.996311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:47:59.996773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:47:59.997211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:00.026135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:00.032242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:48:00.039057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:48:00.039502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:48:00.040005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:48:00.040409 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:48:00.040822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:48:00.120318 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed889a97-5088-43b7-be87-018985d945de tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/action" status: 202 len: 0 microversion: 2.1 time: 0.138505 Aug 27 21:48:00.120999 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3322/6742] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:47:59 2022] POST /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:48:00.129500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:00.130104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:00.137372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:00.137862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:00.138530 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:00.139238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:00.139709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:00.140324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:00.278054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:00.288239 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a68bf97-629e-4df0-bb51-d48bce006f68 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1680 microversion: 2.1 time: 0.162782 Aug 27 21:48:00.300813 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3421/6743] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:00 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:01.311431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:01.312168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:01.319726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:01.320228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:01.320664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:01.321378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:01.321831 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:01.322269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:01.471294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:01.479607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e0d86b8-a185-41a7-b608-9366681f18c1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1680 microversion: 2.1 time: 0.173116 Aug 27 21:48:01.480193 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3323/6744] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:01 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:02.505588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:02.506682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:02.518431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:02.519267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:02.520206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:02.520898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:02.521361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:02.521801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:02.675177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:02.683621 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a49b393-79ad-4f52-b99a-21fe88cdbefa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.184745 Aug 27 21:48:02.684244 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3422/6745] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:02 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:03.715491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:03.716618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:03.726928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:03.727446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:03.727894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:03.728606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:03.729068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:03.729498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:03.873719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:03.885931 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0de50708-577b-4421-8fa9-7644022841ca tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.177936 Aug 27 21:48:03.887159 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3324/6746] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:03 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:04.912347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:04.912965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:04.920789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:04.921278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:04.921720 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:04.922896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:04.922896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:04.923247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:05.064451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:05.073175 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9a55bc65-5880-4298-9f5e-58835becbbdf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.167110 Aug 27 21:48:05.073766 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3423/6747] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:04 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:06.097539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:06.098223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:06.109062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:06.109739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:06.110328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:06.111272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:06.111900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:06.112468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:06.256086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:06.268630 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3232e1e5-07fb-405a-ae9b-e8da4fb30499 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.176993 Aug 27 21:48:06.269317 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3325/6748] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:06 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:07.291861 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:07.292460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:07.299866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:07.300339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:07.300785 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:07.301482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:07.301981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:07.302418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:07.440804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:07.449598 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de6b7f93-0ad7-476d-939c-07f1ffad794f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.161901 Aug 27 21:48:07.450181 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3424/6749] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:07 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:08.476248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:08.477272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:08.489291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:08.490247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:08.490728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:08.491450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:08.491909 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:08.492339 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:08.631927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:08.640117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ff1d8763-6f6e-437f-9d62-f234b8432cab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.170673 Aug 27 21:48:08.640699 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3326/6750] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:08 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:09.665532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:09.666207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:09.675373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:09.675997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:09.676542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:09.677404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:09.678191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:09.678715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:09.840560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:09.848692 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b4c2c966-8550-4a30-bcd1-bcdc68a25690 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.189343 Aug 27 21:48:09.849290 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3425/6751] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:09 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:10.870611 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:10.871185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:10.878737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:10.879260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:10.879724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:10.880427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:10.880994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:10.881421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:11.017375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:11.025828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-587f962d-a01a-4bc6-966d-2b8b2e51c95a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.159302 Aug 27 21:48:11.026440 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3327/6752] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:10 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:12.052251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:12.053429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:12.062366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:12.062855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:12.063299 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:12.064021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:12.064468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:12.064899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:12.225782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:12.239384 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe8a3030-dbb0-41bd-a30e-1dc724ce5683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.193656 Aug 27 21:48:12.240287 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3426/6753] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:12 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:13.265785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:13.266870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:13.278616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:13.279448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:13.280215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:13.281437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:13.282272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:13.283029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:13.418793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:13.431229 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1cdb7be5-48f9-4964-ab03-c4c4bad724e3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.171751 Aug 27 21:48:13.432194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3328/6754] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:13 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:14.453698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:14.455549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:14.464355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:14.464905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:14.465851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:14.466775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:14.467452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:14.468137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:14.684701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:14.692793 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5367180-7c64-4d74-8e73-5fc42cb3a35b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1685 microversion: 2.1 time: 0.243210 Aug 27 21:48:14.694248 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3427/6755] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:14 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1685 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:15.325838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "name": "network-vif-unplugged", "status": "completed", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:15.335693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:15.336195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:15.336618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:15.349673 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Creating event network-vif-unplugged:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch1-master-1 Aug 27 21:48:15.355461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:48:15.366689 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c6eb9957-0db5-4a1b-9a58-50e7eb2ff422 req-15430b84-fea0-4e7d-b7da-ae0fb1b37a20 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102979 Aug 27 21:48:15.367282 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3329/6756] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:48:15.717016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:15.717591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:15.725003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:15.725988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:15.726645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:15.727367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:15.727851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:15.728266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:15.871084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:15.880052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e438d69c-8e74-4c40-ad63-bc3f908f1836 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1684 microversion: 2.1 time: 0.167755 Aug 27 21:48:15.880683 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3428/6757] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:15 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:16.903774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:16.904503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:16.911133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:16.911696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:16.912180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:16.912866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:16.913328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:16.913755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:17.055652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:17.067415 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34ce53e7-abaf-483f-9041-f10edb7f10fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1682 microversion: 2.1 time: 0.168676 Aug 27 21:48:17.068460 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3330/6758] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:16 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:17.410990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:17.421755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:17.422245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:17.422664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:17.435286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Creating event network-changed:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch1-master-1 Aug 27 21:48:17.441061 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:48:17.453145 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a728d2ea-dff5-4109-854c-c5475cc453f3 req-0c307585-5947-425e-8318-9c45949dc728 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045971 Aug 27 21:48:17.453733 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3429/6759] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:48:18.090865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:18.091508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:18.098751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:18.099774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:18.100062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:18.100797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:18.101259 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:18.101702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:18.250651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:18.263413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2808be12-f5d6-4462-86cf-4b9458d56227 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1682 microversion: 2.1 time: 0.176777 Aug 27 21:48:18.264256 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3331/6760] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:18 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:19.290823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:19.291578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:19.299164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.299706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.300156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.300869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.301333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.301766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.441152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:19.449496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ae06b279-7380-4f41-a8a6-96d2f6cb9b2d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1679 microversion: 2.1 time: 0.165416 Aug 27 21:48:19.450088 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3430/6761] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:19 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:19.470819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:19.471396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:19.478568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.479057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.479543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.480250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.480721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.481151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.546934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ae66e493-3a85-4869-91ef-0b3c656946f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/action" status: 204 len: 0 microversion: 2.1 time: 0.079799 Aug 27 21:48:19.547610 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3332/6762] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:48:19 2022] POST /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:48:19.556064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:19.556722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:19.563983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.564485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.565074 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.565827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:19.566291 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:19.566745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:19.823508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:19.834075 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6a04dc2e-1e8e-4a6f-b0d5-446b3e67cff7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1679 microversion: 2.1 time: 0.281630 Aug 27 21:48:19.834876 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3431/6763] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:19 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1679 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:20.861879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:20.862494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:20.871575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:20.872263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:20.872711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:20.873483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:20.873929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:20.874516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:21.039556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:21.047599 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21d95392-b878-4876-a8f7-c880b42e9114 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1679 microversion: 2.1 time: 0.190215 Aug 27 21:48:21.061861 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3333/6764] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:20 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:21.062175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "name": "network-vif-plugged", "status": "completed", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:21.069515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:21.070002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:21.070440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:21.085246 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] Creating event network-vif-plugged:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch1-master-1 Aug 27 21:48:21.090730 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b99609e6-8998-4fc9-bced-36dae30969ff req-88fe9080-bf6a-49a4-9fbc-7b35bb88a7ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087912 Aug 27 21:48:21.091403 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3432/6765] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:48:22.072067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:22.072652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:22.080184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.080682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.081129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.081894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.082361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.082791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.226747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:22.235081 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a1a77ae9-2281-442f-9e8f-0880e12f8180 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.167642 Aug 27 21:48:22.235709 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3334/6766] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:22 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:22.257941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:22.258774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:22.265380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.265872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.266308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.267009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.267541 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.267954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.422958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:22.435060 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8e68f458-1215-40d5-8750-0a17f46b6f32 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.182300 Aug 27 21:48:22.435923 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3433/6767] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:22 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:22.458369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:22.458966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:22.466119 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.466603 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.467050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.467787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.468254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.468689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.484015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:22.609123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:22.617901 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ecd68881-a551-40ec-9129-a7a0d7582493 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1671 microversion: 2.1 time: 0.163379 Aug 27 21:48:22.618444 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3335/6768] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:22 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:22.638524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:22.639034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:22.645457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.645953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.646482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.647282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.647793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.648224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.674107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:48:22.725972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:22.757371 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-14a97984-e360-4737-ba7c-93d4bdee866e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 204 len: 0 microversion: 2.1 time: 0.122352 Aug 27 21:48:22.758057 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3434/6769] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:48:22 2022] DELETE /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:48:22.767190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:22.767989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:22.774508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.775003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.775512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.776218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:22.776677 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:22.777106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:22.920537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:22.928768 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c110150e-a085-4a6a-a222-074b1805ee45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1677 microversion: 2.1 time: 0.165582 Aug 27 21:48:22.929349 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3336/6770] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:22 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:23.951202 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:23.951953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:23.960178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:23.960713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:23.961159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:23.961839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:23.962333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:23.962753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:24.108958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:24.117286 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-533a7b8f-8120-407b-8077-df9c807015cf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1677 microversion: 2.1 time: 0.170559 Aug 27 21:48:24.117882 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3435/6771] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:23 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:25.072473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c24a41-117d-473c-9e87-c00be5ba9ddc", "name": "network-vif-deleted", "tag": "200d49fc-66ac-40cd-90af-46349ba00dc4"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:25.089196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:25.089826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:25.090815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:25.108380 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] Creating event network-vif-deleted:200d49fc-66ac-40cd-90af-46349ba00dc4 for instance b8c24a41-117d-473c-9e87-c00be5ba9ddc on nch1-master-1 Aug 27 21:48:25.113727 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-dfb7979a-23f4-4f37-b8d3-51b86e89d9c1 req-c959c72d-c26c-4bb2-8feb-53631390681c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046440 Aug 27 21:48:25.114342 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3337/6772] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:48:25.139062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:25.139767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:25.151223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:25.152133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:25.152808 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:25.153765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:25.154465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:25.155060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:25.195153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:25.195773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:25.196219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:25.196717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lazy-loading 'fault' on Instance uuid b8c24a41-117d-473c-9e87-c00be5ba9ddc {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:48:25.241442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:25.250908 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-717e1aa1-edb2-4561-a151-74d8f49209b2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 200 len: 1329 microversion: 2.1 time: 0.116040 Aug 27 21:48:25.251534 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3436/6773] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:25 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 1329 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:26.273426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:26.274210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:26.281568 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:26.282078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:26.282497 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:26.283184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:26.283743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:26.284168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:26.298195 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc HTTP/1.1 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b8c24a41-117d-473c-9e87-c00be5ba9ddc'} Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:48:26.299812 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:48:26.304546 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0b5e9184-8498-4aaa-9581-6281fb6c15a9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 404 len: 111 microversion: 2.1 time: 0.032367 Aug 27 21:48:26.305384 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3338/6774] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:26 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:48:26.312878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:26.313506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:26.321333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:26.321832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:26.322273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:26.323018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:26.323519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:26.323947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:26.338080 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc HTTP/1.1 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b8c24a41-117d-473c-9e87-c00be5ba9ddc'} Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:48:26.339830 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8a991e27-98e2-4d9e-a107-71ac02107a36 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 404 len: 111 microversion: 2.1 time: 0.032717 Aug 27 21:48:26.344924 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3437/6775] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:26 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:48:26.392767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-248075023", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "2e275c09-e955-4381-9537-fe0388add10e"}], "security_groups": [{"name": "tempest-securitygroup--2125195220"}], "key_name": "tempest-keypair-1196508420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:26.500602 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] validate_networks() for [('2e275c09-e955-4381-9537-fe0388add10e', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:48:26.993303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:48:26.993724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:48:26.994247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:48:26.994605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:48:26.995010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:48:27.007880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:27.008373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:27.008807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:27.009527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:27.009981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:27.010400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:27.030758 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:48:27.036162 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:48:27.049528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:48:27.051934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:48:27.101828 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e2e355ae-b622-4e65-920e-5d45b777b78a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713703 Aug 27 21:48:27.102467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3339/6776] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:48:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:48:27.113721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-be41db8a-e626-487d-828b-4cfc1c3e415d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:27.114340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-be41db8a-e626-487d-828b-4cfc1c3e415d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:27.172681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-be41db8a-e626-487d-828b-4cfc1c3e415d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:27.185299 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-be41db8a-e626-487d-828b-4cfc1c3e415d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1238 microversion: 2.1 time: 0.075443 Aug 27 21:48:27.185974 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3438/6777] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:27 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:48:28.209023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:28.209648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:28.218450 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:28.218920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:28.219378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:28.220116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:28.220574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:28.221002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:28.288480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:28.298400 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-debff08d-abc2-4475-8bbe-4b86a3989c34 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1298 microversion: 2.1 time: 0.095642 Aug 27 21:48:28.299296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3340/6778] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:28 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:29.322156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:29.322929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:29.325905 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:48:29.326061 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 (ip 10.222.0.40) !!! Aug 27 21:48:29.327975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:29.334650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:29.335168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:29.335632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:29.336360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:29.336815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:29.337240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:29.477102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:29.485528 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8172a9c9-a0b3-4f59-a056-fc64c9b66570 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.167873 Aug 27 21:48:29.486122 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3439/6779] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:29 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:29.622131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:29.629953 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:29.637582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:29.638065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:29.638496 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:29.653018 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] Creating event network-changed:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch1-master-1 Aug 27 21:48:29.658055 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b131c0cd-d035-48ff-9300-95be9bd07a8f req-b881d847-a895-4b69-a254-a9028171e813 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040827 Aug 27 21:48:29.659107 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3341/6780] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:48:30.512420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:30.513482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:30.525073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:30.525574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:30.526019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:30.526732 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:30.527195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:30.527677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:30.679442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:30.688405 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a134d0ac-235c-4081-97da-5a5f27ee9986 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.183314 Aug 27 21:48:30.689001 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3440/6781] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:30 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:31.718279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:31.719479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:31.729263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:31.729754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:31.730197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:31.730892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:31.731380 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:31.731813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:31.870075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:31.878610 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86b86e41-30a6-43b4-9e14-2794cd09f71a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.170231 Aug 27 21:48:31.879214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3342/6782] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:31 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:32.901019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:32.901721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:32.909645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:32.910227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:32.910649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:32.912250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:32.912250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:32.912577 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:33.050547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:33.060029 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5d00d735-adcd-464d-963c-f41009b7bd5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.163027 Aug 27 21:48:33.060838 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3441/6783] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:32 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:34.088693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:34.089328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:34.097526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:34.098048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:34.098524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:34.099267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:34.099788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:34.100246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:34.239591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:34.248197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ef268fe2-ff7f-412c-9d36-51a8ed0b358d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.165246 Aug 27 21:48:34.248748 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3343/6784] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:34 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:34.968363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "name": "network-vif-plugged", "status": "completed", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:34.980068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:34.980625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:34.981151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:34.993319 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] Creating event network-vif-plugged:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch1-master-1 Aug 27 21:48:34.999117 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-1a210146-536e-4017-93a9-7fe20e8913bb req-bff6849f-5c49-4b6b-bb71-f19f8b4b337e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035043 Aug 27 21:48:34.999962 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3442/6785] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:48:35.283533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:35.284561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:35.294203 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:35.294701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:35.295147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:35.295897 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:35.296359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:35.296800 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:35.444174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:35.453405 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-370ee966-dc8b-4f1f-a26a-cd9e6706cc7f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.177203 Aug 27 21:48:35.453996 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3344/6786] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:35 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:36.477348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:36.478060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:36.484778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:36.485329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:36.485775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:36.486574 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:36.487171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:36.487666 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:36.628072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:36.636862 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1805e4ae-8149-4541-9d6b-5b407afc531c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1364 microversion: 2.1 time: 0.164916 Aug 27 21:48:36.637453 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3443/6787] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:36 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:37.662738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:37.663738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:37.668704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:37.669812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:37.680500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:37.681133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:37.681630 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:37.682325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:37.682785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:37.683224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:37.827084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:48:37.835435 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a8859518-5c1c-4a5f-adb2-d4e9411b25a2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1552 microversion: 2.1 time: 0.179275 Aug 27 21:48:37.836002 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3345/6788] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:48:37 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:48:37.857913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:48:37.858308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:48:37.860424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:48:37.866932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:37.867536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:37.868014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:37.869250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:37.869250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:37.869722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:37.961444 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0171bda7-b655-496a-ae7c-8f083fe26490 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107425 Aug 27 21:48:37.962319 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3444/6789] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:48:37 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:48:39.387992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:48:39.399299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:48:39.400344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:48:39.400542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:48:39.412134 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] Creating event network-changed:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch1-master-1 Aug 27 21:48:39.418156 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-901bf60f-997a-41a6-87fb-3e27bbc7db01 req-fa6589b0-43bd-470f-9f01-9cb23387fbd9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086845 Aug 27 21:48:39.418896 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3346/6790] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:49:51.716665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=11 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:49:51.717817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=46 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:49:51.722766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:49:51.732894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:51.733391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:51.733842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:51.758381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 21:49:51.803019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9846dc6-0d07-4998-8dcb-286baf4913fc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action" status: 202 len: 0 microversion: 2.1 time: 0.090659 Aug 27 21:49:51.803712 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3445/6791] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:49:51 2022] POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:49:51.811516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=11 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:49:51.812485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=49 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:49:51.817257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:51.817973 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:51.829083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:51.829580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:51.830030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:51.830741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:51.831201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:51.831659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:51.986649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:51.994927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed2183c9-721d-46e4-a0ea-154fa2aad0e7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.186391 Aug 27 21:49:51.995552 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3347/6792] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:51 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:53.022237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:53.023032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:53.031999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:53.032496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:53.032940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:53.033619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:53.034101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:53.034532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:53.185280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:53.194064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf3442c8-38cd-4f5a-8b27-7f447e137dbf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.179920 Aug 27 21:49:53.194627 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3446/6793] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:53 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:54.221394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:54.222468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:54.234061 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:54.235313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:54.235862 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:54.236531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:54.236987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:54.237415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:54.380580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:54.392702 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8797c48f-0a4c-4d22-95cc-2b259747b93f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.179357 Aug 27 21:49:54.393318 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3348/6794] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:54 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:55.416771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:55.418087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:55.430510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:55.431090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:55.431681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:55.432539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:55.433056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:55.433567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:55.586470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:55.598065 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-bf0e7f81-6778-4f7d-8b9f-3fecd2d8ad46 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.187024 Aug 27 21:49:55.598674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3447/6795] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:55 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:56.619817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:56.620427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:56.628776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:56.629314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:56.629803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:56.630562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:56.631065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:56.631598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:56.774759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:56.783131 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8403e342-ee71-4a9d-92d2-b8e82e0ddb24 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.167908 Aug 27 21:49:56.783727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3349/6796] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:56 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:57.808598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:57.809199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:57.817627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:57.818129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:57.818573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:57.819282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:57.819763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:57.820221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:57.960895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:57.974261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a564fab4-1205-4a1e-99c8-c365b94c4c8a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.171993 Aug 27 21:49:57.975121 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3448/6797] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:57 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:49:59.001047 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:49:59.001684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:49:59.008517 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:59.009004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:59.009447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:59.010142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:49:59.010599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:49:59.011031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:49:59.152388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:49:59.161976 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80e422f6-1929-4034-941a-01b4074a411c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.165687 Aug 27 21:49:59.162597 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3350/6798] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:49:58 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:00.188247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:00.189507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:00.199968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:00.200799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:00.201546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:00.202762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:00.203552 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:00.204366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:00.359934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:00.369481 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-729fd3fe-f96d-4d49-a3f5-f09134cf77b3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.188375 Aug 27 21:50:00.370058 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3449/6799] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:00 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:01.393674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:01.394532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:01.402955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:01.403494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:01.403938 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:01.404636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:01.405096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:01.405530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:01.585065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:01.594187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c9670436-7d22-46c2-8bb7-cfe30425e623 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.205440 Aug 27 21:50:01.594802 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3351/6800] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:01 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:02.622315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:02.622921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:02.630609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.631103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.631580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:02.632286 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.632741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.633170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:02.770578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:02.778806 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8ac07aba-e46a-488b-a171-04df0e22a504 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1658 microversion: 2.1 time: 0.160466 Aug 27 21:50:02.779690 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3450/6801] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:02 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1658 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:02.799835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:02.802142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:02.809366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.809859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.810302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:02.811134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.811633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.812058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:02.842867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:02.850395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:50:02.857341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:50:02.857799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:50:02.858275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:50:02.858701 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:50:02.859103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:50:02.934048 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c80de1a4-1cd0-4e2e-b056-e0b63dffa323 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action" status: 202 len: 0 microversion: 2.1 time: 0.138287 Aug 27 21:50:02.934884 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3352/6802] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:50:02 2022] POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 21:50:02.947583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:02.948219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:02.954397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.954891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.955369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:02.956073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:02.957049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:02.957178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:03.095774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:03.106221 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07922094-58ed-41f0-bd74-26015ac15683 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.166148 Aug 27 21:50:03.106925 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3451/6803] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:02 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:04.129949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:04.130475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:04.136997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:04.137503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:04.137985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:04.138840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:04.139618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:04.140410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:04.296096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:04.305074 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5f7b83b8-9a51-40e4-8311-02372d060e21 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.181270 Aug 27 21:50:04.306245 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3353/6804] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:04 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:05.328049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:05.328675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:05.336175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:05.337062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:05.337512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:05.338218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:05.338718 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:05.339156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:05.478207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:05.486768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5c4b1dd6-60a4-4360-b81c-7da2ab581c78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1681 microversion: 2.1 time: 0.162794 Aug 27 21:50:05.487391 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3452/6805] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:05 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:06.509877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:06.510573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:06.518052 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:06.518524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:06.518979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:06.520100 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:06.520566 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:06.521008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:06.665804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:06.677088 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e4d33178-ff74-4304-a369-7aa6f6bdcb7e tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1686 microversion: 2.1 time: 0.171266 Aug 27 21:50:06.677835 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3354/6806] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:06 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:07.701912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:07.702643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:07.711829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:07.712357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:07.712879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:07.713633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:07.714169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:07.714633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:07.971172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:07.979784 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66624e91-a0c3-47b8-a5d1-d240c8bb7e70 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1685 microversion: 2.1 time: 0.284285 Aug 27 21:50:07.980381 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3453/6807] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:07 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1685 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:08.357604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "name": "network-vif-unplugged", "status": "completed", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:08.369105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:08.369547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:08.370180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:08.383413 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Creating event network-vif-unplugged:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch2-master-1 Aug 27 21:50:08.389575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:50:08.401358 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-4e0d6d65-6fae-4cd9-8b1e-c5c597353c70 req-a9d5d36f-5a87-4bfd-81b2-cd529ee20fbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047502 Aug 27 21:50:08.401983 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3355/6808] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:50:09.002572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:09.003271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:09.011525 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:09.012013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:09.012455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:09.013211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:09.013707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:09.014136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:09.230645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:09.239746 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93906f67-2ac6-453b-8346-3295c0974b40 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1685 microversion: 2.1 time: 0.241267 Aug 27 21:50:09.240334 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3454/6809] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:08 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1685 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:10.267753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:10.268906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:10.279408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:10.280249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:10.280971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:10.282104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:10.282859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:10.283605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:10.420908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:10.435903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:10.436888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:10.437384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:10.437826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:10.443981 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21dda05d-e82d-4231-80ba-6bf6ca3c7afc tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1683 microversion: 2.1 time: 0.184770 Aug 27 21:50:10.444560 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3356/6810] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:10 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:10.451185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Creating event network-changed:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch2-master-1 Aug 27 21:50:10.457043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:50:10.468477 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b76bf908-94db-49a8-9df0-d65121d2dd86 req-e7eb1f78-2cdb-41e4-9312-e438eaeab25a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051773 Aug 27 21:50:10.469080 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3455/6811] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:50:11.466437 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:11.467066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:11.474075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:11.474714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:11.475477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:11.476347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:11.476802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:11.477223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:11.628136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:11.636481 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a5738028-47fd-4b3f-9bf9-a85ec28ff895 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1683 microversion: 2.1 time: 0.174322 Aug 27 21:50:11.637091 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3357/6812] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:11 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:12.659354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:12.660071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:12.667319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:12.667845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:12.668288 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:12.668987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:12.669446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:12.669876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:12.916970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:12.925825 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3c268996-ab58-49d4-8c4c-8ed4670a20f3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1679 microversion: 2.1 time: 0.271460 Aug 27 21:50:12.926606 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3456/6813] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:12 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:12.947716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:12.948300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:12.955768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:12.956299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:12.956747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:12.957446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:12.957914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:12.958344 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:13.023173 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61777a53-708c-4682-9feb-de88f3af2980 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action" status: 204 len: 0 microversion: 2.1 time: 0.079309 Aug 27 21:50:13.023879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3358/6814] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:50:12 2022] POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:50:13.032498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:13.033163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:13.039529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:13.040024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:13.040692 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:13.041584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:13.042107 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:13.042540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:13.269936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:13.280121 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3e4e5f0b-9731-4df9-a6e1-d5c1dd55fac5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1679 microversion: 2.1 time: 0.251825 Aug 27 21:50:13.281068 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3457/6815] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:13 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:14.304524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:14.305098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:14.312994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:14.313507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:14.313952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:14.315073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:14.315571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:14.316293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:14.461001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:14.469247 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9aee9c83-5969-4599-b98e-2bb59da8ecb3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1679 microversion: 2.1 time: 0.170244 Aug 27 21:50:14.469801 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3359/6816] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:14 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:15.340950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "name": "network-vif-plugged", "status": "completed", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:15.353137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.353602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.354039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.366271 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] Creating event network-vif-plugged:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch2-master-1 Aug 27 21:50:15.371441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f1899fa2-ffab-4876-b793-e24235f55da5 req-8275b9c0-6633-4427-9e9b-5fb0303117ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Aug 27 21:50:15.372055 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3458/6817] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:50:15.494747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:15.495397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:15.506396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.506915 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.507373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.508086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.508549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.508977 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.665091 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:15.674864 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fce6ccd6-7057-4830-80f5-e783a3f06f62 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1658 microversion: 2.1 time: 0.187299 Aug 27 21:50:15.675467 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3360/6818] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:15 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1658 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:15.698281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:15.698983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:15.705342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.705827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.706264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.706946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.707425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.707853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.854636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:15.866328 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f880e84b-2fad-4956-bc2b-ddbe0452dccf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1658 microversion: 2.1 time: 0.172409 Aug 27 21:50:15.866915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3459/6819] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:15 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1658 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:15.886857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:15.893198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.893679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.894272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.907850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:15.918503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Going to try to start instance {{(pid=140433) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 21:50:15.964255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d1732924-3c36-4a76-bf28-610049b5ff07 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action" status: 202 len: 0 microversion: 2.1 time: 0.081116 Aug 27 21:50:15.965668 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3361/6820] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:50:15 2022] POST /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:50:15.974252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:15.975618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:15.982238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.982735 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.983180 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:15.984801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:15.985266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:15.986041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:16.541586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:16.551915 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ac72dd86-acc7-448b-ba58-e750db694ca9 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1667 microversion: 2.1 time: 0.581604 Aug 27 21:50:16.552941 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3460/6821] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:15 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1667 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:17.575173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:17.575776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:17.583512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:17.584755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:17.585215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:17.585945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:17.586414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:17.586850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:17.731563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:17.741568 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-61261435-7491-4607-8fe4-94abce2090e6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1667 microversion: 2.1 time: 0.171175 Aug 27 21:50:17.742157 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3362/6822] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:17 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:18.768556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:18.769156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:18.776597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:18.777108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:18.777555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:18.778247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:18.778709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:18.779146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:18.799030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:18.974512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:18.982945 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-658fd819-ca0e-4d71-a55b-e8eb6eeae9c8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1671 microversion: 2.1 time: 0.218427 Aug 27 21:50:18.993796 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3461/6823] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:18 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1671 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:19.003777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:19.004251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:19.011518 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:19.012016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:19.012480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:19.013171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:19.013612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:19.014068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:19.043759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:50:19.123370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-64643d9b-059c-44df-a7d7-c00fa75c4285 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 204 len: 0 microversion: 2.1 time: 0.123254 Aug 27 21:50:19.124095 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3363/6824] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:50:18 2022] DELETE /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:50:19.133594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:19.134689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:19.141326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:19.141824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:19.142290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:19.143005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:19.143499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:19.143990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:19.291041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:19.299459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ed55026-938c-4a79-9574-503bf711f466 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1677 microversion: 2.1 time: 0.170754 Aug 27 21:50:19.299951 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3462/6825] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:19 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:50:20.321987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:20.322725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:20.329871 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:20.330364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:20.330808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:20.331664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:20.332130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:20.332558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:20.488749 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:20.497092 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6154de5a-3ca4-404e-be7c-89576562dd18 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1677 microversion: 2.1 time: 0.179619 Aug 27 21:50:20.497630 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3364/6826] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:20 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:21.518935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:21.519641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:21.526980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:21.527515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:21.527952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:21.528663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:21.529124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:21.529554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:21.611233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:21.621058 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5a6b997-cfad-4f39-9077-9f94d2300c8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 200 len: 1609 microversion: 2.1 time: 0.106013 Aug 27 21:50:21.625223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29", "name": "network-vif-deleted", "tag": "8824e04b-4b5b-438f-8adb-502398ea0e14"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:21.632397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3463/6827] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:21 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 1609 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:21.635882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:21.636359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:21.636790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:21.648907 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] Creating event network-vif-deleted:8824e04b-4b5b-438f-8adb-502398ea0e14 for instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 on nch2-master-1 Aug 27 21:50:21.654625 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-46e3e88a-ed08-4ef1-9853-7f710fb02de1 req-7be9169b-bc93-4862-91cd-916d2d32336b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Aug 27 21:50:21.657893 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3365/6828] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:50:22.645152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:22.645729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:22.648557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=39 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:22.654565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:22.655065 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:22.655556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:22.656290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:22.656775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:22.657190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:22.671293 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 HTTP/1.1 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29'} Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:50:22.673029 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-67639934-d0a5-4336-b8b7-b057f468b8d6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 404 len: 111 microversion: 2.1 time: 0.033363 Aug 27 21:50:22.677215 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3464/6829] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:22 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:50:22.693735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:22.694469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:22.696475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:22.702019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:22.702503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:22.702935 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:22.703656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:22.704109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:22.704529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:22.719699 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 HTTP/1.1 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29'} Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:50:22.721247 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e44df5f3-94da-4edf-9b66-cd5fb3f6121d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 404 len: 111 microversion: 2.1 time: 0.034174 Aug 27 21:50:22.725435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3366/6830] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:22 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:50:22.779088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2026256627", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "2e275c09-e955-4381-9537-fe0388add10e"}], "security_groups": [{"name": "tempest-securitygroup--2125195220"}], "key_name": "tempest-keypair-1196508420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:22.890956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] validate_networks() for [('2e275c09-e955-4381-9537-fe0388add10e', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:50:23.367848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:50:23.368599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:50:23.369102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:50:23.369545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:50:23.369963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:50:23.379679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:23.380170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:23.380608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:23.381338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:23.381792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:23.382243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:23.402887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:50:23.408635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:50:23.422683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:50:23.425089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:50:23.478995 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5d0c86e-783b-4372-bc40-58220b3a42b0 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703505 Aug 27 21:50:23.480585 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3465/6831] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:50:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:50:23.492323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-760751fc-367f-4923-8a9c-6a869f75a236 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:23.492941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-760751fc-367f-4923-8a9c-6a869f75a236 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:23.552182 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-760751fc-367f-4923-8a9c-6a869f75a236 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:23.560105 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-760751fc-367f-4923-8a9c-6a869f75a236 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1239 microversion: 2.1 time: 0.072324 Aug 27 21:50:23.560691 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3367/6832] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:23 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:24.583621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:24.584253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:24.594055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:24.594754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:24.595494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:24.596679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:24.597456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:24.598187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:24.671028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:24.680485 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-415cc325-984e-4f41-ad95-d26e72b4211a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1291 microversion: 2.1 time: 0.101600 Aug 27 21:50:24.681170 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3466/6833] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:24 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1291 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:25.703177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:25.704444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:25.718214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:25.719747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:25.723219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:25.724643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:25.725455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:25.725902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:25.861722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:25.869957 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ae636e4-9829-4fe9-ac37-a285dc651373 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.171154 Aug 27 21:50:25.870544 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3368/6834] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:25 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:26.150340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:26.162031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:26.162524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:26.162963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:26.174750 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] Creating event network-changed:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:50:26.180072 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-413a0796-b4ad-4f34-a8e4-0a01bc8803c0 req-abd20b29-59be-46d3-9c42-0c6c52a3b3c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033523 Aug 27 21:50:26.180997 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3467/6835] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:50:26.899534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:26.900673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:26.909093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:26.909584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:26.910025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:26.910708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:26.911144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:26.911625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:27.049898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:27.058401 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2cb85a77-049e-47d8-bbbd-3244a7edd846 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.168113 Aug 27 21:50:27.058953 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3369/6836] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:26 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:28.086268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:28.087429 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:28.098872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:28.099752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:28.100493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:28.101653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:28.102421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:28.103147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:28.256372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:28.267018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c683b899-95a6-4df0-84ec-506a9ef33cd3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.189466 Aug 27 21:50:28.267724 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3468/6837] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:28 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:29.292681 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:29.293422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:29.303011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:29.303761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:29.304398 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:29.305420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:29.306116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:29.306738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:29.449994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:29.458472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-77e728b3-7a7d-4cb9-80b7-6deae71d861b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.172185 Aug 27 21:50:29.459022 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3370/6838] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:29 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:30.485848 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:30.486914 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:30.497492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:30.498313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:30.499069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:30.500133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:30.500495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:30.500930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:30.650089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:30.660265 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6178aabe-622e-445f-af22-514c06a95950 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.181710 Aug 27 21:50:30.661141 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3469/6839] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:30 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:31.571019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-plugged", "status": "completed", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:31.582835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:31.583442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:31.583886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:31.599421 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] Creating event network-vif-plugged:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:50:31.604750 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-ae8463db-be74-44b5-998e-067d45a26571 req-dfbb8fab-b877-497d-8bf2-daf8e31a2861 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037503 Aug 27 21:50:31.605379 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3371/6840] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:50:31.683677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:31.684306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:31.692383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:31.692881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:31.693335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:31.694032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:31.694493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:31.694898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:31.834290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:31.842612 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7000f341-b149-46c7-b17d-61b2ee4b0d8f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.163699 Aug 27 21:50:31.843314 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3470/6841] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:31 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:32.868089 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:32.868828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:32.878490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:32.879283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:32.879998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:32.881079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:32.881801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:32.882514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:33.025950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:33.034168 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4d2c65f-f336-4f9d-a656-fd8955677586 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1365 microversion: 2.1 time: 0.172242 Aug 27 21:50:33.034786 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3372/6842] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:32 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:34.056815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:34.057603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:34.060543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:34.061255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:34.067623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:34.068122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:34.068573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:34.069285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:34.069751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:34.070174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:34.219278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:50:34.227638 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7906fcee-6fff-4eda-a3f5-291c8b0fb821 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1553 microversion: 2.1 time: 0.174845 Aug 27 21:50:34.228225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3471/6843] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:50:34 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:50:34.248573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:50:34.249102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:50:34.251506 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:50:34.257989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:34.258482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:34.258925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:34.259764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:34.260226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:34.260658 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:34.344677 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1ded89d8-a6d3-40d3-a2de-0e1260c4282d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099993 Aug 27 21:50:34.345293 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3373/6844] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:50:34 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:50:35.568563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:50:35.579570 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:50:35.580052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:50:35.580489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:50:35.593315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] Creating event network-changed:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:50:35.600056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-5b4620ec-4068-4929-bfd7-6a2a61f3bc73 req-e447b1fd-0b35-4b4f-8e5e-e1ae82c2eafb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035122 Aug 27 21:50:35.600887 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3472/6845] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:51:47.591606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=17 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:51:47.592512 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:51:47.645096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:51:47.647434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:47.654097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:47.654577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:47.655011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:47.655711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:47.656161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:47.656579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:47.687174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:47.693349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Old instance type m1.heat2, new instance type m1.heat {{(pid=140433) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 21:51:47.700430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:51:47.700858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:51:47.701337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:51:47.701752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:51:47.702168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:51:47.776398 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6e1af879-54bd-47f0-b8ea-4b8d5d1a186d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/action" status: 202 len: 0 microversion: 2.1 time: 0.187633 Aug 27 21:51:47.777166 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3374/6846] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:51:47 2022] POST /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:51:47.784258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:51:47.785424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=52 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:51:47.789649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:47.790885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:47.798200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:47.798782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:47.799225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:47.799947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:47.800413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:47.800823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:47.937569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:47.946492 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2db35f4d-413d-4418-94a7-d64fdf940b45 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1681 microversion: 2.1 time: 0.164725 Aug 27 21:51:47.947091 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3473/6847] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:47 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:48.971196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:48.971847 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:48.974160 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:51:48.974325 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 (ip 10.222.0.40) !!! Aug 27 21:51:48.982316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:48.982894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:48.983416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:48.984161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:48.984810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:48.985325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:49.116609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:49.124690 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c901839a-0e25-46d7-afd6-8e8eb51bd11a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1681 microversion: 2.1 time: 0.157688 Aug 27 21:51:49.125280 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3375/6848] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:48 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:50.154746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:50.155452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:50.164846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:50.165470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:50.166026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:50.166943 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:50.167533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:50.168124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:50.306311 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:50.315162 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ed28163-fb9e-43ef-9859-3812de680167 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.165267 Aug 27 21:51:50.315357 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3474/6849] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:50 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:51.337753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:51.338427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:51.347373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:51.347870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:51.348317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:51.349024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:51.349486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:51.349918 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:51.492779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:51.501151 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-674b7b11-4c6f-4703-85f2-537cf02506af tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.167454 Aug 27 21:51:51.501737 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3376/6850] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:51 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:52.532301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:52.533758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:52.535850 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:51:52.535995 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 (ip 10.222.0.40) !!! Aug 27 21:51:52.544276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:52.544767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:52.545254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:52.546046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:52.546501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:52.546930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:52.700285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:52.708641 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7037cfa3-6cc0-4d94-a8f3-f6ac1e04ff2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.183016 Aug 27 21:51:52.709230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3475/6851] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:52 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:53.734523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:53.735598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:53.743443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:53.743936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:53.744375 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:53.745077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:53.745531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:53.745964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:53.893015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:53.901230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c15ace2-bf0f-487e-a7ab-a183e97e76a4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.173189 Aug 27 21:51:53.901996 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3377/6852] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:53 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:54.926143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:54.927021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:54.937952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:54.938715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:54.939459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:54.940152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:54.940633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:54.941071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:55.081323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:55.089666 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a98431d5-7054-4b43-bf1b-9b5be2821f7a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.170174 Aug 27 21:51:55.090638 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3476/6853] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:54 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:56.114888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:56.115626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:56.124037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:56.124620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:56.125141 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:56.125960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:56.126505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:56.127015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:56.268718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:56.277341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0a7de7c4-75fd-4cc9-8fef-5490d7bc9ca4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.168578 Aug 27 21:51:56.277918 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3378/6854] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:56 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:57.303252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:57.304248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:57.315977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:57.317081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:57.317341 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:57.318112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:57.318572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:57.319007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:57.468080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:57.479749 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3b64e7d9-c9de-4c32-9d5c-472c4ed9f2a3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.182982 Aug 27 21:51:57.480582 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3477/6855] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:57 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:58.505514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:58.506148 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:58.513319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:58.513782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:58.514206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:58.514898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:58.515376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:58.515819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:58.651612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:58.659742 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ec2c87f8-35ee-4f0e-926c-3bcc7dfe1686 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.161080 Aug 27 21:51:58.660320 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3379/6856] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:58 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:51:59.683268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:51:59.683873 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:51:59.691395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:59.691961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:59.692993 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:59.693795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:51:59.694296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:51:59.694779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:51:59.837189 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:51:59.845719 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cb36c51e-4c4f-46dc-9a01-f2c72be2c22f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.167601 Aug 27 21:51:59.846294 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3478/6857] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:51:59 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:00.869877 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:00.870685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:00.878266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:00.878793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:00.879237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:00.880403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:00.880765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:00.881199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:01.040022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:01.054112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-24e3aa9d-53fb-4117-88cc-a29311c6d00f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.188229 Aug 27 21:52:01.054714 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3380/6858] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:00 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:02.082252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:02.083521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:02.094701 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:02.095312 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:02.095923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:02.096951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:02.097488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:02.098053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:02.248862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:02.257888 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2669d925-f7b8-4c67-8e78-4c335b3688e5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.181864 Aug 27 21:52:02.258496 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3479/6859] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:02 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:03.284219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:03.285219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:03.293508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:03.293931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:03.294365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:03.295059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:03.295551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:03.295975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:03.440241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:03.448712 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b69dde43-9a64-4ebd-a65e-ca88709f8065 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.171061 Aug 27 21:52:03.449293 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3381/6860] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:03 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:04.474412 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:04.475036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:04.482824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:04.483361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:04.483842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:04.484613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:04.485066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:04.485493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:04.640278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:04.651802 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d22aa261-2eb9-45ab-823d-4c290bbd3773 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.184782 Aug 27 21:52:04.652394 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3480/6861] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:04 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:05.681031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:05.681978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:05.693234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:05.694150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:05.694880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:05.695631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:05.696088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:05.696520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:05.852016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:05.860203 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9b137078-d2cf-4bb9-90cf-08772633840f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.185497 Aug 27 21:52:05.860756 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3382/6862] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:05 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:06.881957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:06.882640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:06.890403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:06.890905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:06.891445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:06.892089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:06.892550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:06.892984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:07.030657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:07.039000 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a745763f-5581-46ec-b8e2-623543215a7b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1686 microversion: 2.1 time: 0.161268 Aug 27 21:52:07.040527 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3481/6863] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:06 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:07.689446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-unplugged", "status": "completed", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:07.700648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:07.701128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:07.701582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:07.715541 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Creating event network-vif-unplugged:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch2-master-1 Aug 27 21:52:07.721323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] Instance b4a83643-b3e0-4810-8138-52934f6f2766 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:52:07.732758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f8f1d80e-09ad-4938-a349-aee33692059f req-59c44cb1-1086-4da3-a983-ed9e9880eafb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047290 Aug 27 21:52:07.733373 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3383/6864] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:08.061360 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:08.061974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:08.069110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:08.069702 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:08.070160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:08.070875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:08.071389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:08.071804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:08.324612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:08.332939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5e3b3de3-be61-4c8b-a0f2-d913d8db4c01 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1685 microversion: 2.1 time: 0.275610 Aug 27 21:52:08.333586 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3482/6865] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:08 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1685 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:09.359911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:09.360787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:09.369194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:09.369813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:09.370374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:09.371244 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:09.371856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:09.372401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:09.517708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:09.526197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-15e84b3e-aee5-4dd2-953a-04d5b34b4171 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1683 microversion: 2.1 time: 0.172959 Aug 27 21:52:09.526814 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3384/6866] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:09 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:09.752353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:09.765980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:09.766584 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:09.767143 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:09.780649 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Creating event network-changed:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch2-master-1 Aug 27 21:52:09.786437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] Instance b4a83643-b3e0-4810-8138-52934f6f2766 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:52:09.799645 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8772f6ad-db63-4919-bd4f-006910585be3 req-755762b5-2cc5-4fbe-884d-c5f7c427a28f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051956 Aug 27 21:52:09.800799 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3483/6867] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:10.548926 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:10.549501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:10.556898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:10.557426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:10.557908 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:10.558615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:10.559081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:10.559562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:10.693550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:10.701721 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d63ee1a-95f6-4ae0-96de-d1fd4e287bbd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1683 microversion: 2.1 time: 0.156985 Aug 27 21:52:10.702304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3385/6868] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:10 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:11.733564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:11.734298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:11.743199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:11.743739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:11.744373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:11.745134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:11.745644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:11.746087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:12.071381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:12.080349 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-064e561a-ccfa-4def-9baf-06c247b17247 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1683 microversion: 2.1 time: 0.358631 Aug 27 21:52:12.081139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3484/6869] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:11 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1683 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:13.102561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:13.103183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:13.110625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.111152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.111643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.112352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.112815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.113270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.254486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:13.263802 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5fe5f13a-f44f-41d8-90af-993ee88ff477 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1680 microversion: 2.1 time: 0.165220 Aug 27 21:52:13.264385 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3386/6870] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:13 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:13.284799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:13.285351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:13.292841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.293345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.293797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.294502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.294965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.295403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.335671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.335968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.336344 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.337069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.337528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.338004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.359534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:52:13.364907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:52:13.473297 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2d27d52-148a-4a77-9a14-9654249417fa tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/action" status: 202 len: 0 microversion: 2.1 time: 0.192242 Aug 27 21:52:13.473847 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3485/6871] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:52:13 2022] POST /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:52:13.482793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:13.483547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:13.490051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.490549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.490992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.492907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.492907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.493330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.699390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:13.711143 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-818bd8b6-bf4c-46f7-874c-3e5d049824b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.232336 Aug 27 21:52:13.711770 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3387/6872] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:13 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:13.949970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-plugged", "status": "completed", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:13.959874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:13.960410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:13.960746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:13.973967 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Creating event network-vif-plugged:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch2-master-1 Aug 27 21:52:13.980477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] Instance b4a83643-b3e0-4810-8138-52934f6f2766 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:52:13.993424 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-d38719e8-2482-490f-9c21-59a45dd597d3 req-2215455a-2fbf-4585-addc-5d87c9d0d9c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046933 Aug 27 21:52:13.994751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3486/6873] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:14.738273 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:14.739224 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:14.752103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:14.752920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:14.753695 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:14.754861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:14.755635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:14.756355 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:14.896170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:14.905153 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba4398cc-3086-4b38-bf22-425d471db3bf tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.173520 Aug 27 21:52:14.905749 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3388/6874] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:14 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:15.932446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:15.933166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:15.939740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:15.940242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:15.940691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:15.941401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:15.941870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:15.942274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:15.946590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:16.089414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:16.101344 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b544962-d49c-46cd-9768-f31f58e35409 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.177524 Aug 27 21:52:16.102015 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3487/6875] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:15 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:17.123767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:17.124337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:17.131364 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:17.131883 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:17.132324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:17.133690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:17.134158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:17.134594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:17.153714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:17.263400 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-unplugged", "status": "completed", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:17.276317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:17.276765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:17.277468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:17.277947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:17.285141 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ca587396-ffc7-4814-84b6-1cff8a25acba tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.165377 Aug 27 21:52:17.292185 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Creating event network-vif-unplugged:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:52:17.299467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] Instance b4a83643-b3e0-4810-8138-52934f6f2766 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:52:17.299984 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3389/6876] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:17 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:17.311775 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-8810fb71-b06e-40da-b772-748b364b8176 req-c95896ec-b4dc-4ea7-bbd0-bc241ad701cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054880 Aug 27 21:52:17.312394 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3488/6877] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:18.308359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:18.308941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:18.311939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=37 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:18.318460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:18.318460 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:18.318968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:18.320217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:18.320875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:18.320875 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:18.459408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:18.471197 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c495cf2-41b6-4da8-a6d9-b9c29b00e4d5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.166838 Aug 27 21:52:18.472022 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3390/6878] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:18 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:19.341999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:19.346856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:19.353705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:19.354185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:19.354617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:19.366363 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Creating event network-changed:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:52:19.372544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] Instance b4a83643-b3e0-4810-8138-52934f6f2766 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 21:52:19.384068 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b7faabd8-399a-465c-886d-edef2262dbe2 req-e4214960-c47f-4d59-8eec-e887d7e7a77f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047471 Aug 27 21:52:19.384641 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3489/6879] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:19.495849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:19.496423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:19.504042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:19.504544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:19.504989 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:19.505700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:19.506184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:19.506593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:19.726773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:19.735723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ce90035d-86a1-45b9-8859-1e0eeab3a8fb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.244029 Aug 27 21:52:19.736318 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3391/6880] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:19 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:20.759246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:20.760746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:20.767393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:20.768380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:20.768380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:20.769250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:20.769783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:20.770308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:20.915651 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:20.923651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb5b9566-30c3-437a-8006-c6cdab7d16b4 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1679 microversion: 2.1 time: 0.169843 Aug 27 21:52:20.924241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3490/6881] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:20 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:21.948423 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:21.949028 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:21.956530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:21.957013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:21.957452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:21.958114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:21.958589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:21.959012 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.098574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:22.107265 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ebc208f8-882f-45ff-aee1-fdd6fb5d3d9d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1672 microversion: 2.1 time: 0.164716 Aug 27 21:52:22.107864 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3392/6882] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:21 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:22.128217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:22.128841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:22.136137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.136610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.137055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.137759 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.138220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.138647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.192107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-plugged", "status": "completed", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:22.202354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.203055 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.203515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.215844 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] Creating event network-vif-plugged:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:52:22.221180 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6b03e433-f8ad-4df5-b799-24d2a8a0e8a2 req-4e7a9afc-b0b0-4c6a-a6fa-ba1510df7efb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Aug 27 21:52:22.222050 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3393/6883] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:22.282481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:22.290567 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7250343b-c4ec-472b-a9f2-4a0fded218b5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1672 microversion: 2.1 time: 0.166385 Aug 27 21:52:22.291288 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3491/6884] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:22 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:22.312071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:22.312759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:22.319310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.319845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.320283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.320979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.321438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.321861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.476402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:22.489122 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-007a0504-d645-491a-a951-f18f2209f4b1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1672 microversion: 2.1 time: 0.181195 Aug 27 21:52:22.489878 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3394/6885] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:22 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:22.511213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:22.511752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:22.518875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.519434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.519877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.520579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.521040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.521465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.549946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:52:22.637419 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0fe40600-546a-4f63-84ac-75336275aab6 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 204 len: 0 microversion: 2.1 time: 0.130604 Aug 27 21:52:22.638020 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3492/6886] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:52:22 2022] DELETE /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:52:22.646578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:22.647192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:22.653562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.654048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.654480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.655174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:22.655676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:22.656099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:22.789878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:22.798178 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62218365-6d4b-413c-a7d0-0416367ceb4d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1678 microversion: 2.1 time: 0.155597 Aug 27 21:52:22.798789 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3395/6887] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:22 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:23.829166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:23.830345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:23.835010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:23.842885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:23.843365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:23.843859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:23.844572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:23.845029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:23.845459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:23.986816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:23.995244 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93cc3203-3aa1-403e-99db-3746c2b9ef5c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1678 microversion: 2.1 time: 0.177044 Aug 27 21:52:23.995831 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3493/6888] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:23 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:25.017399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:25.018020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:25.025166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:25.025676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:25.026130 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:25.026816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:25.027284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:25.027848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:25.078181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a83643-b3e0-4810-8138-52934f6f2766", "name": "network-vif-deleted", "tag": "988651d0-2f40-42cf-9367-e34427544beb"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:25.089447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:25.090417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:25.091093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:25.107584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:25.108783 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] Creating event network-vif-deleted:988651d0-2f40-42cf-9367-e34427544beb for instance b4a83643-b3e0-4810-8138-52934f6f2766 on nch1-master-1 Aug 27 21:52:25.116283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ac671e6-dc52-45f3-8fc2-b619f5c16bb1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 200 len: 1610 microversion: 2.1 time: 0.103018 Aug 27 21:52:25.117137 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3396/6889] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:25 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 1610 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:25.123494 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-194e8394-dd31-45ad-a4a8-50d9a45cc750 req-f86ff90e-cb18-4514-afec-04c6534bdda8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055362 Aug 27 21:52:25.123494 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3494/6890] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:26.143800 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:26.144506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:26.153489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.153973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.154410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.155103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.155563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.156021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.170491 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 HTTP/1.1 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b4a83643-b3e0-4810-8138-52934f6f2766'} Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:52:26.172196 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74dbe30b-4c47-440a-b53d-7e555801bbdb tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 404 len: 111 microversion: 2.1 time: 0.038014 Aug 27 21:52:26.177227 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3495/6891] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:26 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:52:26.189923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:26.190639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:26.198196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.198788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.199459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.200178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.200667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.201099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.215510 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 HTTP/1.1 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b4a83643-b3e0-4810-8138-52934f6f2766'} Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:52:26.217176 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ff755a7-7ef6-4408-b4f4-7c9e5af8a27b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 404 len: 111 microversion: 2.1 time: 0.032753 Aug 27 21:52:26.221642 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3397/6892] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:26 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:52:26.270746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2091622156", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "2e275c09-e955-4381-9537-fe0388add10e"}], "security_groups": [{"name": "tempest-securitygroup--2125195220"}], "key_name": "tempest-keypair-1196508420", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:26.399419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] validate_networks() for [('2e275c09-e955-4381-9537-fe0388add10e', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:52:26.791904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:52:26.792518 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:52:26.793227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:52:26.793831 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:52:26.794425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:52:26.808949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.809448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.809895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.810612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:26.811090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:26.811562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:26.831940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:52:26.837659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Getting quotas for user 4d833cb910284a019d6f09a36cb72c71 and project da35a1b00868458387afe78b8ffbaec4. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:52:26.850603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:52:26.853038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:52:26.907303 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c3f96bc7-7341-42ee-b9cc-dc83e0025e52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.640462 Aug 27 21:52:26.907984 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3496/6893] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:52:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:52:26.919129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c78472fa-63a7-4850-baf4-f7643be4b935 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:26.919770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c78472fa-63a7-4850-baf4-f7643be4b935 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:26.973458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c78472fa-63a7-4850-baf4-f7643be4b935 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:26.980814 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c78472fa-63a7-4850-baf4-f7643be4b935 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1239 microversion: 2.1 time: 0.065413 Aug 27 21:52:26.981394 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3398/6894] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:26 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:28.003939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:28.004903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:28.015393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:28.015929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:28.016476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:28.017175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:28.017644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:28.018083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:28.097443 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:28.106133 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8af22aff-1765-4287-9768-9cc253247761 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1299 microversion: 2.1 time: 0.107300 Aug 27 21:52:28.106753 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3497/6895] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:27 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:52:29.132887 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:29.133690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:29.140911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:29.141411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:29.141857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:29.142727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:29.143168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:29.143640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:29.359326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:29.367867 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e9c92c06-aa7c-457a-a1a7-7ba91b1e0e1b tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.241326 Aug 27 21:52:29.368858 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3399/6896] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:29 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:52:29.681085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871ca7b8-a089-4e11-bc2f-feb739f222b3", "tag": "4aee04bb-8e82-4c47-aeed-90c41c62575c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:29.691096 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:29.691608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:29.692039 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:29.705997 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] Creating event network-changed:4aee04bb-8e82-4c47-aeed-90c41c62575c for instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 on nch2-master-1 Aug 27 21:52:29.711473 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-949fd80c-cc31-40d1-a6f0-b5082c029175 req-95e8c759-dabb-490b-bf62-304c0ba2abdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Aug 27 21:52:29.712460 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3498/6897] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:30.393361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:30.394268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:30.404751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:30.405502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:30.406125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:30.407121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:30.407833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:30.408447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:30.554281 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:30.562681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-276e37a3-ead3-4138-823c-09affa60a8fd tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.175335 Aug 27 21:52:30.563276 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3400/6898] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:30 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:31.590265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:31.591533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:31.599266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:31.599925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:31.600373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:31.601082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:31.601548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:31.601983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:31.753060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:31.762139 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba29e244-8ef2-4d86-bce9-da03d1fb0910 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.179599 Aug 27 21:52:31.762894 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3499/6899] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:31 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:32.785715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:32.786536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:32.796626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:32.797213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:32.797642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:32.798414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:32.799031 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:32.799500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:33.003218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:33.012043 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cb96441-14ae-4422-8da6-6466da61a038 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.230457 Aug 27 21:52:33.012601 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3401/6900] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:32 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:34.035077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:34.035767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:34.043211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:34.043854 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:34.044285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:34.045052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:34.046233 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:34.046717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:34.186329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:34.194490 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-089e1c64-1927-4223-b265-b9ea7bcbde52 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.163494 Aug 27 21:52:34.195076 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3500/6901] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:34 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:35.219369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:35.220008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:35.227748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:35.228239 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:35.228685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:35.229381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:35.229840 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:35.230270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:35.367200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:35.380064 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44e53b22-54bb-4268-91ec-543d67bdc76a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.166377 Aug 27 21:52:35.380946 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3402/6902] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:35 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:36.188811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871ca7b8-a089-4e11-bc2f-feb739f222b3", "name": "network-vif-plugged", "status": "completed", "tag": "4aee04bb-8e82-4c47-aeed-90c41c62575c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:36.201906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:36.202593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:36.203035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:36.215202 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] Creating event network-vif-plugged:4aee04bb-8e82-4c47-aeed-90c41c62575c for instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 on nch2-master-1 Aug 27 21:52:36.220816 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-fa73312b-d343-465f-8eb7-3765b261a181 req-8583c4de-4451-4c9e-a870-c395d340df25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Aug 27 21:52:36.221646 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3501/6903] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:52:36.405779 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:36.406430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:36.413709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:36.414209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:36.414651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:36.415453 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:36.415923 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:36.416351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:36.555817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:36.564137 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-34fe154a-e48f-41f9-99f1-b31df614a20d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.162448 Aug 27 21:52:36.564719 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3403/6904] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:36 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:37.586642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:37.587751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:37.596606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:37.597766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:37.609398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:37.610082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:37.610531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:37.611212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:37.611704 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:37.612125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:37.759830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:37.768192 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-20cee74b-6785-4150-9fcd-a7d392e1953d tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1365 microversion: 2.1 time: 0.183509 Aug 27 21:52:37.768829 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3502/6905] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:37 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:38.790587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:38.791208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:38.793292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:52:38.799879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:38.800368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:38.800808 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:38.801507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:38.801968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:38.802402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:38.936421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:52:38.945044 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c46d2a89-0c9a-4b65-a49a-4ca59b607d66 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1552 microversion: 2.1 time: 0.158643 Aug 27 21:52:38.945602 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3404/6906] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:52:38 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:52:38.966832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:52:38.967413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:52:38.975002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:38.975434 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:38.975870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:38.976569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:38.977033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:38.977484 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:39.062795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ceac0c94-aec4-499a-b5a1-c43ad9fec257 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100167 Aug 27 21:52:39.063371 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3503/6907] 10.222.0.40 () {58 vars in 1275 bytes} [Sat Aug 27 21:52:38 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:52:40.091671 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871ca7b8-a089-4e11-bc2f-feb739f222b3", "tag": "4aee04bb-8e82-4c47-aeed-90c41c62575c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:52:40.102099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:52:40.102585 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:52:40.103022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:52:40.114749 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] Creating event network-changed:4aee04bb-8e82-4c47-aeed-90c41c62575c for instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 on nch2-master-1 Aug 27 21:52:40.120347 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-29a70b64-fce6-49c1-b35a-36ba9f911d58 req-0dbed21b-277a-4661-9dd4-a8155c166a18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032801 Aug 27 21:52:40.120987 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3405/6908] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:53:53.534215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:53:53.535001 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:53:53.540414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:53.541033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:53.549037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:53.549606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:53.550118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:53.550857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:53.551323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:53.551786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:53.765007 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:53:53.773516 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d70374c8-198c-4027-814a-5092de1945d3 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1671 microversion: 2.1 time: 0.241863 Aug 27 21:53:53.774100 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3504/6909] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:53 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:53:53.936711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=33 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:53:53.937474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=80 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:53:53.938427 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 21:53:53.946006 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:53.946598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:53.953426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:53.953920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:53.954360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:53.955056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:53.955561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:53.955993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:53.984964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:53:54.071780 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0742e1ff-1281-4ec8-954c-1420c05e040c tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 204 len: 0 microversion: 2.1 time: 0.138211 Aug 27 21:53:54.072443 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3406/6910] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:53:53 2022] DELETE /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:53:54.080900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:54.081527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:54.087871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:54.088372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:54.088819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:54.089899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:54.090353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:54.090789 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:54.229062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:53:54.237452 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a7ffb715-c29f-416e-a153-470f360c62ab tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1677 microversion: 2.1 time: 0.160491 Aug 27 21:53:54.237931 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3505/6911] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:54 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:53:55.259011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:55.259756 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:55.267190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:55.267720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:55.268167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:55.268869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:55.269332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:55.269766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:55.456258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:53:55.464434 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50561fbf-b500-437c-9053-dc72cbbecce5 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1677 microversion: 2.1 time: 0.209826 Aug 27 21:53:55.465377 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3407/6912] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:55 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:53:56.487736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:56.488499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:56.496474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:56.497063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:56.497563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:56.498428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:56.499004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:56.499536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:56.600599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871ca7b8-a089-4e11-bc2f-feb739f222b3", "name": "network-vif-deleted", "tag": "4aee04bb-8e82-4c47-aeed-90c41c62575c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:53:56.609253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d833cb910284a019d6f09a36cb72c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da35a1b00868458387afe78b8ffbaec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:53:56.617689 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f5c35f92-430c-418d-88ce-f58d6e8ec82f tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 200 len: 1609 microversion: 2.1 time: 0.134959 Aug 27 21:53:56.618346 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3506/6913] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:56 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 1609 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:53:56.632151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:56.632741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:56.633207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:56.650031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] Creating event network-vif-deleted:4aee04bb-8e82-4c47-aeed-90c41c62575c for instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 on nch2-master-1 Aug 27 21:53:56.655445 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b5daa89d-6ae7-4bce-80e5-38593d460eb6 req-abdf2ef7-e72c-470c-a1ff-f2f86f56c0f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149007 Aug 27 21:53:56.656038 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3408/6914] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:53:57.640909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.641786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 871ca7b8-a089-4e11-bc2f-feb739f222b3] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.655915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.656401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.656837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.657540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.657988 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.658408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.677019 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 HTTP/1.1 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '871ca7b8-a089-4e11-bc2f-feb739f222b3'} Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.679781 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance 871ca7b8-a089-4e11-bc2f-feb739f222b3 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7f21309d-2483-49af-83c7-68c2aa3b6f2a tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3" status: 404 len: 111 microversion: 2.1 time: 0.045065 Aug 27 21:53:57.684479 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3507/6915] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:57 2022] GET /compute/v2.1/servers/871ca7b8-a089-4e11-bc2f-feb739f222b3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:53:57.691922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.692553 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.699202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.699714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.700161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.701088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.701550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.701981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.716490 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 HTTP/1.1 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b4a83643-b3e0-4810-8138-52934f6f2766'} Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.718156 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c49c245d-07fc-435b-bbf2-5eba06ed88e1 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 404 len: 111 microversion: 2.1 time: 0.032963 Aug 27 21:53:57.725194 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3409/6916] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:53:57 2022] DELETE /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:53:57.728481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.729076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b4a83643-b3e0-4810-8138-52934f6f2766] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.735601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.736093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.736573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.737318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.737760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.738218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.752441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 HTTP/1.1 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b4a83643-b3e0-4810-8138-52934f6f2766'} Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.754006 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b4a83643-b3e0-4810-8138-52934f6f2766 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0033aecd-5c26-4d57-b5e9-ea634689d6e8 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766" status: 404 len: 111 microversion: 2.1 time: 0.031125 Aug 27 21:53:57.759035 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3508/6917] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:57 2022] GET /compute/v2.1/servers/b4a83643-b3e0-4810-8138-52934f6f2766 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:53:57.764210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.764755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.770834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.771327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.771801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.772530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.772982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.773415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.787909 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 HTTP/1.1 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29'} Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.789494 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c6332c33-18cd-4962-87db-4d27ed8bfb57 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 404 len: 111 microversion: 2.1 time: 0.030801 Aug 27 21:53:57.794112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3410/6918] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:53:57 2022] DELETE /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:53:57.799684 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.800317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.806643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.807135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.807610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.808303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.808776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.809204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.823028 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 HTTP/1.1 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29'} Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.824688 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance 7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b685d26-1250-42d8-9ece-ccd58b9456f7 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29" status: 404 len: 111 microversion: 2.1 time: 0.030487 Aug 27 21:53:57.830115 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3509/6919] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:57 2022] GET /compute/v2.1/servers/7ebf9e62-c76a-4cf8-8f7e-7cf3bb807e29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 21:53:57.834945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.835481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.842752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.843250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.843772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.844415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.844876 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.845312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.859573 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc HTTP/1.1 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'b8c24a41-117d-473c-9e87-c00be5ba9ddc'} Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.861090 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79eca11d-546a-4fb2-963d-246938f3cf78 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 27 21:53:57.865753 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3411/6920] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:53:57 2022] DELETE /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:53:57.870984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.871645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] [instance: b8c24a41-117d-473c-9e87-c00be5ba9ddc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:53:57.878256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.878750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.879200 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.879927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:53:57.880392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:53:57.880824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:53:57.895510 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] HTTP exception thrown: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Request method failure captured: Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc HTTP/1.1 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpDAc29NOq1Dl_y0pDABgtS8gUe36qVarbw7tGGOKvTd_9U1qa8tCxFYUYMfItqNW55eAPAgDJ5Es7g9TSmHtp3gY_2mDeKHvPFEIkxIH5RVNyysjDmjDdIC7M171R85NYf9qMiuTOH7c6hXXssiNyQ7FFbVGWmwmgwUSPHoctscF0I Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/da35a1b00868458387afe78b8ffbaec4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_da35a1b00868458387afe78b8ffbaec4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/da35a1b00868458387afe78b8ffbaec4"}]}] Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: da35a1b00868458387afe78b8ffbaec4 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServerActionsTestJSON-882987212 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 4d833cb910284a019d6f09a36cb72c71 Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServerActionsTestJSON-882987212-project Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'b8c24a41-117d-473c-9e87-c00be5ba9ddc'} Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:53:57.897058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Returning 404 to user: Instance b8c24a41-117d-473c-9e87-c00be5ba9ddc could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5af28bba-af54-471b-b7dc-801cf347f2c2 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc" status: 404 len: 111 microversion: 2.1 time: 0.031378 Aug 27 21:53:57.901609 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3510/6921] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:53:57 2022] GET /compute/v2.1/servers/b8c24a41-117d-473c-9e87-c00be5ba9ddc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:53:57.907359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-45f4c823-9be0-46b9-8b6a-aa3f74d8a654 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] Calling method '.version_select at 0x7ff84df48f70>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:53:57.935934 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-45f4c823-9be0-46b9-8b6a-aa3f74d8a654 tempest-ServerActionsTestJSON-882987212 tempest-ServerActionsTestJSON-882987212-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196508420" status: 202 len: 0 microversion: 2.1 time: 0.032567 Aug 27 21:53:57.936805 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3412/6922] 10.222.0.40 () {58 vars in 1221 bytes} [Sat Aug 27 21:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196508420 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:54:07.875597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=14 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:07.885787 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=26 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:07.896072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978021628", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "55da693f-96da-4d9a-aca4-d1604053fc74"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:07.953498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] validate_networks() for [('55da693f-96da-4d9a-aca4-d1604053fc74', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:54:08.376455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:54:08.376998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:54:08.377633 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:54:08.378151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:54:08.378645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:54:08.390182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:08.390774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:08.391226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:08.392028 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:08.392681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:08.393117 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:08.411280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Getting quotas for project efd55b4ebdc84dbcb4d9e19858c60d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:54:08.417457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Getting quotas for user 1d20e3664cad4bcca829bddc594188d9 and project efd55b4ebdc84dbcb4d9e19858c60d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:54:08.431934 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:54:08.433915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:54:08.486885 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ddb19a58-a3a5-4b6c-ae2d-6bbdd74311f9 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731457 Aug 27 21:54:08.487744 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3511/6923] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:54:08.496644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:08.497892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:08.501917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-31fe158d-7de9-4a9c-884a-7d7c5237ab64 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:08.502764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-31fe158d-7de9-4a9c-884a-7d7c5237ab64 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:08.566404 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-31fe158d-7de9-4a9c-884a-7d7c5237ab64 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:08.574036 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-31fe158d-7de9-4a9c-884a-7d7c5237ab64 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1216 microversion: 2.1 time: 0.079292 Aug 27 21:54:08.574775 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3413/6924] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:08 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:09.596323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b4ceba5-a52c-4c41-bc57-99f84627c0c5 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:09.597628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b4ceba5-a52c-4c41-bc57-99f84627c0c5 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:09.654730 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9b4ceba5-a52c-4c41-bc57-99f84627c0c5 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:09.663027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b4ceba5-a52c-4c41-bc57-99f84627c0c5 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1216 microversion: 2.1 time: 0.071985 Aug 27 21:54:09.663614 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3512/6925] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:09 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:10.685077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-41c2aee8-9820-4ce7-a30f-9ec0123ba358 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:10.685834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-41c2aee8-9820-4ce7-a30f-9ec0123ba358 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:10.747025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-41c2aee8-9820-4ce7-a30f-9ec0123ba358 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:10.754734 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-41c2aee8-9820-4ce7-a30f-9ec0123ba358 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1216 microversion: 2.1 time: 0.073602 Aug 27 21:54:10.755834 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3414/6926] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:10 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:11.779375 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:11.780235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:11.789690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:11.790667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:11.791225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:11.792303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:11.792912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:11.793389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:11.877705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:11.888149 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c5e53f8-f0c2-4ef8-9f0b-f9a519b5b8d8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1276 microversion: 2.1 time: 0.113671 Aug 27 21:54:11.888776 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3513/6927] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:11 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:12.909501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:12.910111 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:12.918337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:12.918939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:12.919387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:12.920133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:12.920589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:12.920999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:13.061313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:13.069937 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-62ee0c27-dcec-4402-9faa-6bdfa0f8b365 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.164312 Aug 27 21:54:13.070591 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3415/6928] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:12 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:13.671162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc", "tag": "24dbdd75-4114-4a37-97f4-9ea606318db8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:13.681516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:13.682008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:13.682631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:13.694648 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] Creating event network-changed:24dbdd75-4114-4a37-97f4-9ea606318db8 for instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc on nch1-master-1 Aug 27 21:54:13.699800 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-eb1a76b2-1549-421f-b636-57034fe61d4a req-df4d30cf-160f-4f02-ab3c-00d2cbca94ae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089208 Aug 27 21:54:13.700478 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3514/6929] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:54:14.092963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:14.093556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:14.101309 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:14.101804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:14.102240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:14.103163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:14.103742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:14.104114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:14.249778 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:14.258111 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d227f3c4-4af4-4aca-8268-258cfb402d60 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.169735 Aug 27 21:54:14.258698 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3416/6930] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:14 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:15.281365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:15.282075 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:15.288622 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:15.289124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:15.289567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:15.290274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:15.290737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:15.291171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:15.435025 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:15.443098 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a3fcaa45-c7aa-4386-bfd2-697195f20c4d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.167370 Aug 27 21:54:15.443702 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3515/6931] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:15 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:16.469159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:16.471086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:16.489929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:16.490850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:16.491308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:16.492222 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:16.492693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:16.493117 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:16.652524 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:16.661150 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6109b4a2-3e1e-4b74-ad7d-8761a267c693 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.199242 Aug 27 21:54:16.661751 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3417/6932] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:16 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:17.685991 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:17.687631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:17.697813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:17.698497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:17.699110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:17.700113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:17.700751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:17.701337 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:17.850105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:17.858047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ad763482-b5de-4065-94bd-e26ba37ace14 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.177395 Aug 27 21:54:17.858639 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3516/6933] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:17 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:18.882867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:18.883910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:18.894785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:18.895287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:18.895799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:18.896513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:18.896974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:18.897406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:19.032240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:19.042876 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-79fc7f96-e536-4539-b988-ec14e2373716 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.166366 Aug 27 21:54:19.043699 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3418/6934] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:18 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:20.074667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:20.075733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:20.078850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:20.081644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:20.087821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:20.088290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:20.088765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:20.089844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:20.090304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:20.090738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:20.235128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:20.246069 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d6542f65-4cd2-4629-9cf8-4812e3ef871c tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.177290 Aug 27 21:54:20.246671 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3517/6935] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:20 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:20.854700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:20.914838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc", "name": "network-vif-plugged", "status": "completed", "tag": "24dbdd75-4114-4a37-97f4-9ea606318db8"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:20.925283 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:20.925775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:20.926218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:20.937639 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] Creating event network-vif-plugged:24dbdd75-4114-4a37-97f4-9ea606318db8 for instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc on nch1-master-1 Aug 27 21:54:20.942821 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-025da845-c670-453f-ba34-0fc7df196975 req-bf401ab9-4bcf-4b35-bdeb-942a6e53a970 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093680 Aug 27 21:54:20.943447 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3419/6936] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:54:21.267016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:21.267925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:21.275102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:21.275644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:21.276093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:21.276799 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:21.277263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:21.277697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:21.414840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:21.425673 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9c68a144-73e3-46e3-be39-7cd855ed6e7d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.162727 Aug 27 21:54:21.426281 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3518/6937] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:21 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:22.453489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:22.454679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:22.461735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:22.462217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:22.462654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:22.463374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:22.463826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:22.464235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:22.616886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:22.624928 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e24978e-b427-4f26-950b-1477a832c72a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1316 microversion: 2.1 time: 0.180293 Aug 27 21:54:22.625512 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3420/6938] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:22 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:23.647977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:23.648838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:23.659419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:23.660165 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:23.662478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:23.663715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:23.664431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:23.665072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:23.802066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:23.810614 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d0bd8d1-76d0-4066-8ca8-fc4f8af72e2a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.168424 Aug 27 21:54:23.811207 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3519/6939] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:23 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:23.874692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-832700496", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "55da693f-96da-4d9a-aca4-d1604053fc74"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:23.931320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] validate_networks() for [('55da693f-96da-4d9a-aca4-d1604053fc74', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:54:24.635246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:54:24.635768 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:54:24.636406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:54:24.636961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:54:24.637519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:54:24.649406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:24.649886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:24.650322 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:24.651040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:24.651530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:24.651956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:24.669856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Getting quotas for project efd55b4ebdc84dbcb4d9e19858c60d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:54:24.676435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Getting quotas for user 1d20e3664cad4bcca829bddc594188d9 and project efd55b4ebdc84dbcb4d9e19858c60d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:54:24.691024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:54:24.693474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:54:24.751200 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-54c8eff6-0ac7-43ba-a603-2c0f24526cb3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880280 Aug 27 21:54:24.752514 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3421/6940] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:54:24.763770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2432327f-1f7f-4eba-9389-64bac0c5641e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:24.764494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2432327f-1f7f-4eba-9389-64bac0c5641e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:24.826511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2432327f-1f7f-4eba-9389-64bac0c5641e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:24.833709 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2432327f-1f7f-4eba-9389-64bac0c5641e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1216 microversion: 2.1 time: 0.073958 Aug 27 21:54:24.834316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3520/6941] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:24 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:25.856008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:25.856635 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:25.863814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:25.864311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:25.864788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:25.865494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:25.865952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:25.866379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:25.947987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:25.957112 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8d02bcc2-0e6d-455d-908b-689f42bb7fec tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1276 microversion: 2.1 time: 0.106669 Aug 27 21:54:25.958049 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3422/6942] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:25 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:26.978863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:26.979508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:26.988290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:26.988797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:26.989240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:26.989952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:26.990489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:26.990804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:27.206181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:27.214917 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84b1d0aa-6c28-49b7-92ab-00adf65be38a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.239670 Aug 27 21:54:27.215539 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3521/6943] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:26 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:27.416533 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96939426-dc0f-4494-a5c7-791beedf2dc6", "tag": "403d13ef-11f7-416d-bd23-f36197f0d3f7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:27.427304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:27.427912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:27.428417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:27.715204 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] Creating event network-changed:403d13ef-11f7-416d-bd23-f36197f0d3f7 for instance 96939426-dc0f-4494-a5c7-791beedf2dc6 on nch2-master-1 Aug 27 21:54:27.720365 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-dea54e2d-d80b-453a-a8f5-f4ab17572f49 req-fb077dc9-769d-4a8f-a560-8b558524b53b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307675 Aug 27 21:54:27.721183 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3423/6944] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:54:28.237824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:28.238451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:28.245998 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:28.246496 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:28.246950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:28.247696 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:28.248166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:28.248601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:28.400081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:28.412320 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dfa95f6a-956b-497d-b5fd-6e886c1fc1b4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.178315 Aug 27 21:54:28.413164 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3522/6945] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:28 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:29.443776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:29.444559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:29.452113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:29.452666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:29.453171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:29.453950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:29.454467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:29.454949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:29.598307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:29.606447 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55f5bab6-bedd-424d-bbf4-15004b15cdd1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.170279 Aug 27 21:54:29.607024 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3424/6946] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:29 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:30.632022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:30.632688 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:30.641981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:30.642711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:30.643393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:30.644405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:30.644895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:30.645790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:30.783164 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:30.791371 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b19e71f0-e35b-4d48-acbb-31de9b6ff902 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.165581 Aug 27 21:54:30.792005 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3523/6947] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:30 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:31.812899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:31.813491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:31.820474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:31.821004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:31.821447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:31.822151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:31.822607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:31.823067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:31.959773 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:31.968341 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-14cb4144-32a9-47f4-a833-afe597427013 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.159561 Aug 27 21:54:31.968908 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3425/6948] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:31 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:32.608292 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96939426-dc0f-4494-a5c7-791beedf2dc6", "name": "network-vif-plugged", "status": "completed", "tag": "403d13ef-11f7-416d-bd23-f36197f0d3f7"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:32.621801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:32.622317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:32.622752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:32.635090 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] Creating event network-vif-plugged:403d13ef-11f7-416d-bd23-f36197f0d3f7 for instance 96939426-dc0f-4494-a5c7-791beedf2dc6 on nch2-master-1 Aug 27 21:54:32.640268 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-b4d8ec4f-f22b-411f-a1a8-c0190a2ec757 req-07975f2d-d825-4e74-9527-3d4833d1b2b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035807 Aug 27 21:54:32.641075 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3524/6949] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:54:32.993705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:32.994311 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:33.001689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:33.002180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:33.002622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:33.003314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:33.003982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:33.004595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:33.156633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:33.164978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2d104dfb-a3d8-4960-92f4-995bdede250b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.175223 Aug 27 21:54:33.165557 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3426/6950] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:32 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:34.192071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:34.192775 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:34.199384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:34.199874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:34.200320 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:34.201013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:34.201474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:34.201905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:34.346885 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:34.353840 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e6ff6f47-c59c-4e37-bc70-18a4763e9eef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1316 microversion: 2.1 time: 0.170242 Aug 27 21:54:34.354421 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3525/6951] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:34 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:35.376197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:35.376874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:35.379861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:35.380587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:35.387084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.387638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.388082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.388802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.389276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.389710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.537485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:35.546155 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1e489c4b-ff80-4283-889a-b9cc85e273ef tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1506 microversion: 2.1 time: 0.174080 Aug 27 21:54:35.546745 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3427/6952] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:35 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:54:35.567358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:35.567879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:35.570046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:35.576921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.577422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.577866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.578573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.579034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.579498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.606394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:54:35.686337 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5af44ee-0bca-414e-94de-627429bfce74 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "DELETE /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 204 len: 0 microversion: 2.1 time: 0.123139 Aug 27 21:54:35.687003 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3526/6953] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:54:35 2022] DELETE /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:54:35.695863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:35.696492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:35.702734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.703255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.703737 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.704444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:35.704907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:35.705357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:35.836666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:35.847829 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6388c45e-a856-4e48-9afb-d89930049d0a tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1512 microversion: 2.1 time: 0.155967 Aug 27 21:54:35.848654 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3428/6954] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:35 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:36.872508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:36.873214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:36.881235 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:36.881750 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:36.882218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:36.882931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:36.883468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:36.883903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:37.024766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:37.032913 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-979e6555-e0c9-4ed2-a367-ec3848497b01 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1512 microversion: 2.1 time: 0.165752 Aug 27 21:54:37.033485 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3527/6955] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:36 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:37.759919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96939426-dc0f-4494-a5c7-791beedf2dc6", "name": "network-vif-deleted", "tag": "403d13ef-11f7-416d-bd23-f36197f0d3f7"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:37.771445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:37.771948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:37.772396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:37.786377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] Creating event network-vif-deleted:403d13ef-11f7-416d-bd23-f36197f0d3f7 for instance 96939426-dc0f-4494-a5c7-791beedf2dc6 on nch2-master-1 Aug 27 21:54:37.792705 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-987f0334-1119-4e55-bce5-59b65579b04b req-8d9e168c-b5b4-4935-bdb1-be011b302002 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036773 Aug 27 21:54:37.794057 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3429/6956] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:54:38.054461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:38.055150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:38.058089 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:38.063954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:38.064448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:38.064892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:38.065598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:38.066059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:38.066488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:38.069855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:38.102605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:38.103097 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:38.103588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:38.104044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lazy-loading 'fault' on Instance uuid 96939426-dc0f-4494-a5c7-791beedf2dc6 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:54:38.150871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:38.158933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-78b8218e-053d-48c6-a9e2-47dc3d7f936f tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 200 len: 1306 microversion: 2.1 time: 0.108470 Aug 27 21:54:38.159529 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3528/6957] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:38 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:39.182600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:39.183317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.185426 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:39.191609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.192131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.192577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.193287 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.193751 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.194230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.197885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=75 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:54:39.212912 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 HTTP/1.1 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '96939426-dc0f-4494-a5c7-791beedf2dc6'} Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.214963 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 404 to user: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-daf4ee61-00f1-4476-a14d-e0435dd2a423 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 404 len: 111 microversion: 2.1 time: 0.039634 Aug 27 21:54:39.220172 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3430/6958] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:39 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:54:39.226057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:39.226685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.234676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.234837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.235327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.236070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.236538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.236973 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.381659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:39.390747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-519c56d1-c05c-4ffb-9947-7b568533884d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.168697 Aug 27 21:54:39.391380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3529/6959] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:39 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:39.414804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:39.417150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 86b80a7d-7035-4592-b743-d4781ebc5cb6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.423047 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/86b80a7d-7035-4592-b743-d4781ebc5cb6/action HTTP/1.1 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 32 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: {"resize": {"flavorRef": "452"}} Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '86b80a7d-7035-4592-b743-d4781ebc5cb6', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:54:39.424659 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 404 to user: Instance 86b80a7d-7035-4592-b743-d4781ebc5cb6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-50a7535d-d073-4724-9e5d-497d8aea4ff8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "POST /compute/v2.1/servers/86b80a7d-7035-4592-b743-d4781ebc5cb6/action" status: 404 len: 111 microversion: 2.1 time: 0.015452 Aug 27 21:54:39.429436 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3431/6960] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:54:39 2022] POST /compute/v2.1/servers/86b80a7d-7035-4592-b743-d4781ebc5cb6/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:54:39.437511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:39.438515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.447175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.447695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.448139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.448839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.449301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.449727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.594681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:39.607382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fb8ebac9-988c-486e-9e8b-fc1b9cd52af1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.175884 Aug 27 21:54:39.608250 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3530/6961] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:39 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:39.633563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:39.634395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.641543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.642029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.642468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.643168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.643654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.644083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.780361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:39.793020 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7faf3dd6-a92c-49d8-9c7b-6f8a6e374afe tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.163307 Aug 27 21:54:39.793784 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3432/6962] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:39 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:54:39.819264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1c17ad6a-9818-479c-adf4-f08e4c64bd52"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:39.821547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.828181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.828667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.829101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.829793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.830243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.830676 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.873093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:39.878767 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: request: POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action HTTP/1.1 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 65 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: {"resize": {"flavorRef": "1c17ad6a-9818-479c-adf4-f08e4c64bd52"}} Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: exception: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc', 'body': {'resize': {'flavorRef': '1c17ad6a-9818-479c-adf4-f08e4c64bd52'}}} Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:39.880714 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 400 to user: Flavor 1c17ad6a-9818-479c-adf4-f08e4c64bd52 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-64a52d4a-4dc3-4bc1-a841-8bbe1b80e81d tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action" status: 400 len: 107 microversion: 2.1 time: 0.066918 Aug 27 21:54:39.885514 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3531/6963] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:54:39 2022] POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action => generated 107 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:54:39.891132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:39.891790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:39.898008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.898490 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.898925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:39.900004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:39.900461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:39.900891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.042349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:40.050791 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ad6d6bca-143d-4082-a9f0-568fd08d12c3 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.163529 Aug 27 21:54:40.051374 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3433/6964] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:39 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:40.073116 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.073736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.083865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.084695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.085441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.086601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.087515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.088223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.230731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:40.240151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c7c280e-fc12-4d8a-a790-bd175d7a3bcf tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.171584 Aug 27 21:54:40.240738 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3532/6965] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:40 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:40.261093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44476fcb-1b61-4a78-bf98-92797cb07da8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44476fcb-1b61-4a78-bf98-92797cb07da8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: request: POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action HTTP/1.1 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 29 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: {"resize": {"flavorRef": ""}} Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc', 'body': {'resize': {'flavorRef': ''}}} Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise error Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi '' Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.264745 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-44476fcb-1b61-4a78-bf98-92797cb07da8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-44476fcb-1b61-4a78-bf98-92797cb07da8 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action" status: 400 len: 113 microversion: 2.1 time: 0.009366 Aug 27 21:54:40.270217 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3434/6966] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:54:40 2022] POST /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 21:54:40.274488 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.275203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.281858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.282352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.282797 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.283549 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.284013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.284439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.434517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:40.443064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-29c1afd6-8cd1-465c-acef-d24b1912a58b tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1506 microversion: 2.1 time: 0.172422 Aug 27 21:54:40.443774 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3533/6967] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:40 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:40.468384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.468889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.476226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.476712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.477231 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.478015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.478473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.478911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.492499 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: request: DELETE /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 HTTP/1.1 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '96939426-dc0f-4494-a5c7-791beedf2dc6'} Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:54:40.494226 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 404 to user: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc4e7557-1229-4424-9d50-585b61f8aa83 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "DELETE /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 404 len: 111 microversion: 2.1 time: 0.032481 Aug 27 21:54:40.499118 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3435/6968] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:54:40 2022] DELETE /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:54:40.504405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.505054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: 96939426-dc0f-4494-a5c7-791beedf2dc6] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.511573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.512062 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.512534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.513226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.513685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.514109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.529096 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 HTTP/1.1 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '96939426-dc0f-4494-a5c7-791beedf2dc6'} Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:40.530634 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 404 to user: Instance 96939426-dc0f-4494-a5c7-791beedf2dc6 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b12e9283-8079-41dd-8fd7-c18565fdd124 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6" status: 404 len: 111 microversion: 2.1 time: 0.031759 Aug 27 21:54:40.535572 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3534/6969] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:40 2022] GET /compute/v2.1/servers/96939426-dc0f-4494-a5c7-791beedf2dc6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:54:40.540964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.541469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.547801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.548293 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.548738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.549435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.549891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.550317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.575932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:54:40.658864 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-695f5ac7-6c85-4235-a961-a01baff097a1 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 204 len: 0 microversion: 2.1 time: 0.121362 Aug 27 21:54:40.659565 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3436/6970] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:54:40 2022] DELETE /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 21:54:40.670324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:40.670977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:40.677859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.678748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.678886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.679780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:40.680250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:40.680776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:40.832351 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:40.840843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b8a3dd2d-9ac4-413d-82f4-eb52adc19e3e tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1512 microversion: 2.1 time: 0.176740 Aug 27 21:54:40.841423 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3535/6971] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:40 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:41.867422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:41.868811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:41.876254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:41.876753 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:41.877199 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:41.877912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:41.878369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:41.878798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:42.017780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:42.026080 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9be47158-c09b-44e6-a463-c58e06654560 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1512 microversion: 2.1 time: 0.165946 Aug 27 21:54:42.026693 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3437/6972] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:41 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:42.893423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc", "name": "network-vif-deleted", "tag": "24dbdd75-4114-4a37-97f4-9ea606318db8"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:54:42.907122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:42.907725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:42.908196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:42.923087 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] Creating event network-vif-deleted:24dbdd75-4114-4a37-97f4-9ea606318db8 for instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc on nch1-master-1 Aug 27 21:54:42.929141 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f4447965-be19-45da-ba1b-bd5c3a86593b req-b50fc5f5-31ea-4d14-841e-ff54427c55ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041085 Aug 27 21:54:42.929821 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3536/6973] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:54:43.047816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:43.048537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:43.056218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:43.056442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:43.056811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:43.057523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:43.057982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:43.058411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:43.094109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:43.094556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:43.094997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:43.095498 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lazy-loading 'fault' on Instance uuid ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:54:43.145085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d20e3664cad4bcca829bddc594188d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd55b4ebdc84dbcb4d9e19858c60d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:54:43.153566 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-407f52ea-3958-415e-b66d-770674dfc6d4 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 200 len: 1306 microversion: 2.1 time: 0.109771 Aug 27 21:54:43.154134 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3438/6974] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:43 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:54:44.180950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:54:44.181630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] [instance: ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:54:44.188464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:44.188975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:44.189398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:44.190222 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:54:44.190686 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:54:44.191114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:54:44.207164 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] HTTP exception thrown: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Request method failure captured: Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc HTTP/1.1 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpJ_ptidC_8jnBS-QKxDO9D0w1BZrnsWQhJgPMe-dc1V73UsmgPg_QjN8e_K4kV9YCDHNBQio2VnQb0pROUZXGOWldV-FoNBl63qdrY3z1do-c2U9N0rBYL7nQ-um1GicZRFBkW8ylMFavucX6qcjijTDRX3fKT63mHcqzuMb3GM-Pc Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_efd55b4ebdc84dbcb4d9e19858c60d4d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/efd55b4ebdc84dbcb4d9e19858c60d4d"}]}] Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: efd55b4ebdc84dbcb4d9e19858c60d4d Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1557911660 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1d20e3664cad4bcca829bddc594188d9 Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-ServersNegativeTestJSON-1557911660-project Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc'} Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:54:44.208853 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] Returning 404 to user: Instance ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3bdfe65f-53b7-4e2a-b797-5a9b82a33f08 tempest-ServersNegativeTestJSON-1557911660 tempest-ServersNegativeTestJSON-1557911660-project] 10.222.0.40 "GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc" status: 404 len: 111 microversion: 2.1 time: 0.038171 Aug 27 21:54:44.213957 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3537/6975] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:54:44 2022] GET /compute/v2.1/servers/ecb761d2-68d7-41f6-9e6d-58d1ac0a77fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:55:25.538785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bbbd54c8-8ad9-4f51-8f3c-ce6914f361d4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Action: 'create', calling method: .version_select at 0x7ff84deae0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-132392025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvKVafJEuXpmI4SmtvPTm/eU5LpMQq0AzZHx2CU93vmcjjz5Vt0PQnjniDSAm5214QwuDjVZyv4tTQ6eVvnf+Jf0rgsebQJz/9LF+O+zoOc1CTBQG0nxWUfPTY6evEVhQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:55:25.545366 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:25.546042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:25.563583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bbbd54c8-8ad9-4f51-8f3c-ce6914f361d4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for project 671198a4c9204d81bb3f7b5115083706. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:55:25.568795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-bbbd54c8-8ad9-4f51-8f3c-ce6914f361d4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for user e1a37e21041c4872b3cba5fc75d52765 and project 671198a4c9204d81bb3f7b5115083706. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:55:25.595677 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bbbd54c8-8ad9-4f51-8f3c-ce6914f361d4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060961 Aug 27 21:55:25.596321 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3439/6976] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:55:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:55:25.653725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-505674376", "imageRef": "516e3889-9876-46d1-aa6d-7f7e716e782a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-132392025", "networks": [{"uuid": "e3480e96-c9b2-4084-aaa6-bb4d9473a15c"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:55:25.664148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=23 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:25.664980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=47 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:25.725814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] validate_networks() for [('e3480e96-c9b2-4084-aaa6-bb4d9473a15c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:55:26.524250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:55:26.524899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:55:26.525493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:55:26.525905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:55:26.526358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:55:26.536103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:26.536596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:26.537042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:26.537783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:26.538220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:26.538653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:26.558444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for project 671198a4c9204d81bb3f7b5115083706. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:55:26.564133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for user e1a37e21041c4872b3cba5fc75d52765 and project 671198a4c9204d81bb3f7b5115083706. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:55:26.577236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:55:26.579602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='516e3889-9876-46d1-aa6d-7f7e716e782a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:55:26.628094 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-94bbd045-a2ea-4de6-afe6-a11df356d662 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978832 Aug 27 21:55:26.631380 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3538/6977] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:55:26.641543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fe857be4-5405-4bba-96d1-bafbf11a43e6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:26.642177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fe857be4-5405-4bba-96d1-bafbf11a43e6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:26.696268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe857be4-5405-4bba-96d1-bafbf11a43e6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:26.703837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fe857be4-5405-4bba-96d1-bafbf11a43e6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1257 microversion: 2.1 time: 0.067327 Aug 27 21:55:26.704387 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3440/6978] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:26 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:27.725869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:27.726508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:27.735890 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:27.736397 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:27.736839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:27.737565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:27.738024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:27.738466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:27.806930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:27.815297 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3415c6de-b5ed-401f-8af8-1613ddd80ac2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1309 microversion: 2.1 time: 0.093589 Aug 27 21:55:27.815900 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3539/6979] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:27 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:28.837155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:28.838540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:28.852676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:28.854121 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:28.855142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:28.858957 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:28.860074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:28.860820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:29.011324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:29.019446 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f689e2b3-7b9d-4a67-a6eb-a07c089cbb49 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.186348 Aug 27 21:55:29.020020 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3441/6980] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:28 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:30.045727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:30.046585 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:30.056664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:30.057281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:30.058036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:30.058821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:30.059819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:30.060380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:30.208766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:30.218245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f7973b8f-c74b-4c95-97d6-57e3ce23df0b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.176430 Aug 27 21:55:30.219205 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3540/6981] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:30 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:31.240270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:31.241187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:31.248929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:31.249421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:31.249863 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:31.250571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:31.251010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:31.251477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:31.406874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:31.415084 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ba194e2-06b0-43d0-9d1b-b2db193eb47c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.178892 Aug 27 21:55:31.415847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3442/6982] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:31 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:32.436736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:32.437363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:32.444903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:32.445438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:32.445904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:32.446679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:32.447122 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:32.447719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:32.590714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:32.599261 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4cd447f1-63f9-49dd-a77f-5a2042129187 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.166649 Aug 27 21:55:32.599900 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3541/6983] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:32 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:33.621018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:33.621723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:33.629485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:33.630001 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:33.630483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:33.631230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:33.631694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:33.632132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:33.774456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:33.784480 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-94376f96-e646-4819-bee7-1e5f7ce4f638 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.167380 Aug 27 21:55:33.785552 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3443/6984] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:33 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:34.806842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:34.807466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:34.814486 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:55:34.814710 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 21:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 (ip 10.222.0.40) !!! Aug 27 21:55:34.816643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:34.817142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:34.817608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:34.818479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:34.818920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:34.819369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:34.981384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:34.989966 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3ab7e9e9-4fe9-4990-a2c3-bfe9956b3f01 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.187330 Aug 27 21:55:34.991375 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3542/6985] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:34 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:36.015592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:36.016572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:36.027482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:36.027985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:36.028436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:36.029147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:36.029613 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:36.030053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:36.175703 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:36.184245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ed3de840-6e58-458f-896e-035779b6d4e0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.175324 Aug 27 21:55:36.184828 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3444/6986] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:36 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:37.209543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:37.210127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:37.213280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:37.213960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:37.219990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:37.220479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:37.220915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:37.221606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:37.222055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:37.222479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:37.362081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:37.370639 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c81834ff-d74e-476b-8aef-dd09d83900fa tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.165225 Aug 27 21:55:37.371229 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3543/6987] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:37 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:38.399838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:38.400467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:38.402395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:38.408782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:38.409301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:38.409732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:38.410424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:38.410899 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:38.411302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:38.556011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:38.569542 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3cc654da-ab23-419f-890b-fffb4b6e2285 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.173530 Aug 27 21:55:38.570345 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3445/6988] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:38 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:39.592145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:39.592765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:39.599980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:39.600776 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:39.601267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:39.601979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:39.602454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:39.602979 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:39.743713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:39.751903 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1c0dc2c9-b7a7-472a-b767-ba4631706a1d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.164142 Aug 27 21:55:39.752518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3544/6989] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:39 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:39.924155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ed2ead-07a5-4f7f-a1d7-12cadf57eb15", "tag": "f4b204bf-7ed4-4223-b56c-bdf132d36e55"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:55:39.937759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:39.938302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:39.938742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:39.950473 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] Creating event network-changed:f4b204bf-7ed4-4223-b56c-bdf132d36e55 for instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 on nch1-master-1 Aug 27 21:55:39.974569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bee6c698-b92e-4ae0-80b7-af07c5d40591 req-05952c6b-7d8c-479d-bd24-74996cc37347 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040507 Aug 27 21:55:39.979832 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3446/6990] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:55:40.776891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:40.777519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:40.785010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:40.785507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:40.785956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:40.786669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:40.787114 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:40.787600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:40.933513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:40.941671 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8bfaedc0-d6fa-4428-b730-c9f2f9234a39 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.170541 Aug 27 21:55:40.942293 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3545/6991] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:40 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:41.966027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:41.967019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:41.974170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:41.974708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:41.975795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:41.977371 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:41.978869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:41.979657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:42.132975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:42.141284 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7219c847-3809-4e3c-a567-25e5a6981f7f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.181590 Aug 27 21:55:42.141887 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3447/6992] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:41 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:43.166563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:43.167513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:43.179054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:43.179923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:43.180629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:43.181617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:43.182073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:43.182492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:43.325187 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:43.333183 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a76776a7-507c-4590-912a-f249f0e59219 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.172921 Aug 27 21:55:43.333768 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3546/6993] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:43 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:44.355307 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:44.355996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:44.363354 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:44.363866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:44.364294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:44.365024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:44.365507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:44.365896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:44.502540 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:44.511146 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-788dc679-3528-47f2-a985-ce6a61d974c2 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.160463 Aug 27 21:55:44.511773 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3448/6994] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:44 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:45.532395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:45.533029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:45.540536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:45.541159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:45.541610 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:45.542460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:45.542924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:45.543365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:45.679758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:45.688103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c485cfb9-0373-4ed8-b2cf-2af578fc1bf0 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.159822 Aug 27 21:55:45.688693 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3547/6995] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:45 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:46.713809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:46.714770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:46.723998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:46.724812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:46.725522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:46.726606 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:46.727241 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:46.727866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:46.876625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:46.885039 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a3a7c800-8ae2-4888-a49f-fcd8d4b9870a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.178008 Aug 27 21:55:46.885599 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3449/6996] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:46 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:47.120170 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed2ead-07a5-4f7f-a1d7-12cadf57eb15", "name": "network-vif-plugged", "status": "completed", "tag": "f4b204bf-7ed4-4223-b56c-bdf132d36e55"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:55:47.133019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:47.134207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:47.134652 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:47.147378 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] Creating event network-vif-plugged:f4b204bf-7ed4-4223-b56c-bdf132d36e55 for instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 on nch1-master-1 Aug 27 21:55:47.152933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a5256369-28ce-4aba-8be3-1d268302928e req-793f1fb9-ef2e-4872-8c00-1b8a7521d5ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036784 Aug 27 21:55:47.153543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3548/6997] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:55:47.910901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:47.911922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:47.921502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:47.922004 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:47.922452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:47.923163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:47.923663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:47.924104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:48.066237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:48.076450 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a658525-78d5-4497-9cd2-64d914280429 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1357 microversion: 2.1 time: 0.172283 Aug 27 21:55:48.077023 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3450/6998] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:47 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:49.104219 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:49.105650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:49.117882 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.118685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.119420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.120713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.121250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.121677 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.265367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:49.273933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9f30157-3d3a-47ce-be62-a67c26616404 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1546 microversion: 2.1 time: 0.177074 Aug 27 21:55:49.274525 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3549/6999] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:49 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:49.294628 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:49.295255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:49.303723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.304236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.304713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.305440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.305967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.306410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.445034 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:49.453255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-67b2eedf-672e-4b34-916f-b48a234c384d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1546 microversion: 2.1 time: 0.162656 Aug 27 21:55:49.453835 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3451/7000] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:49 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:49.473764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:49.478548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:49.479317 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Searching by: {'deleted': False, 'project_id': '671198a4c9204d81bb3f7b5115083706'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:55:49.484961 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.485414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.485849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.486539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.486985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.487442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.513846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:55:49.540651 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-75435ec2-fba8-4f6f-a28a-4d9b14d124e5 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070718 Aug 27 21:55:49.541225 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3550/7001] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:55:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:55:49.555917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:49.556838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:49.566598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.567097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.567746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.568740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:49.569195 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:49.569807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:49.702403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:49.710809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0ee4d380-7cd7-4f53-9d07-04157840cb0e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1546 microversion: 2.1 time: 0.161454 Aug 27 21:55:49.711362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3452/7002] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:49 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:51.309521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:51.310971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:51.318579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:51.319077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:51.319582 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:51.320468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:51.320956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:51.321377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:51.355034 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:55:51.435496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-74e549f1-5fa4-4624-ac3a-7cef5b7ffb1c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 204 len: 0 microversion: 2.1 time: 0.130693 Aug 27 21:55:51.436241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3551/7003] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:55:51 2022] DELETE /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:55:51.445027 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:51.445761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:51.453560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:51.454056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:51.454576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:51.455511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:51.455975 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:51.456410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:51.610138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:51.618418 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-54f5914f-2b69-470d-b52f-39dc21d8584c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1552 microversion: 2.1 time: 0.177348 Aug 27 21:55:51.618995 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3453/7004] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:51 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:52.640669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:52.641345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:52.648532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:52.649036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:52.649471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:52.650178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:52.650629 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:52.651059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:52.787612 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:52.796045 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-791d5642-78be-4733-b9e5-afcd97203e42 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1552 microversion: 2.1 time: 0.159908 Aug 27 21:55:52.796624 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3552/7005] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:52 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:53.552317 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed2ead-07a5-4f7f-a1d7-12cadf57eb15", "name": "network-vif-deleted", "tag": "f4b204bf-7ed4-4223-b56c-bdf132d36e55"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:55:53.566321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:53.566826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:53.567250 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:53.581023 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] Creating event network-vif-deleted:f4b204bf-7ed4-4223-b56c-bdf132d36e55 for instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 on nch1-master-1 Aug 27 21:55:53.587184 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f03ff795-394a-4af9-97fd-140d09c0d88e req-83dc446d-689c-4e9f-9bc6-4742840a0e77 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039164 Aug 27 21:55:53.588209 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3454/7006] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:55:53.818262 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:53.818888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:53.826508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:53.827004 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:53.827480 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:53.828203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:53.828657 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:53.829094 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:53.861739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:53.862212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:53.862667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:53.863127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lazy-loading 'fault' on Instance uuid 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:55:53.866137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:55:53.910391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:55:53.920683 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4ed85bfa-f407-409e-a548-06ef2b0e450e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 200 len: 1347 microversion: 2.1 time: 0.106506 Aug 27 21:55:53.921263 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3553/7007] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:53 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 1347 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:55:54.943815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:54.944486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:55:54.952177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:54.952666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:54.953138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:54.953837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:55:54.954289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:55:54.954742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:55:54.968889 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] HTTP exception thrown: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Request method failure captured: Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 HTTP/1.1 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpK_2Kdua-RLa6svl9rg1dE6S68vzgfh21-MetvmL1Vj6rLJVb7-wVvQ2Uuq33tcVv6hpkfWz214GX68H19hSnxPIShtIbg-y_aEpWOpQAPgDKpDCXtMB3Lm1ILdKYZvpfTATqhC93Tkqo7LzmGo8YDeIXEZpTxb0oprFEEnYMAb6_M Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 671198a4c9204d81bb3f7b5115083706 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/671198a4c9204d81bb3f7b5115083706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/671198a4c9204d81bb3f7b5115083706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_671198a4c9204d81bb3f7b5115083706", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/671198a4c9204d81bb3f7b5115083706"}]}] Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 671198a4c9204d81bb3f7b5115083706 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestMinimumBasicScenario-1640982395-project Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e1a37e21041c4872b3cba5fc75d52765 Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestMinimumBasicScenario-1640982395-project Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '10ed2ead-07a5-4f7f-a1d7-12cadf57eb15'} Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:55:54.970536 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Returning 404 to user: Instance 10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f507066e-24a0-45d6-9434-fdcd24eccbd3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15" status: 404 len: 111 microversion: 2.1 time: 0.032776 Aug 27 21:55:54.975475 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3455/7008] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:55:54 2022] GET /compute/v2.1/servers/10ed2ead-07a5-4f7f-a1d7-12cadf57eb15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:55:54.981110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1952f091-c712-49c7-abcb-d02f004fdfa4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '.version_select at 0x7ff84f37aca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:55:55.010007 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1952f091-c712-49c7-abcb-d02f004fdfa4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-132392025" status: 202 len: 0 microversion: 2.1 time: 0.032460 Aug 27 21:55:55.011069 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3554/7009] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:55:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-132392025 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:56:04.174292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f33ac4ff-23fd-44d5-abb0-2b40b3692838 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Action: 'create', calling method: .version_select at 0x7ff84df589d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-153683986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgKnHcVKqUVxlu86S9xgEbmfdTuQhF7ht0RkNjJxnxuleoGxPXN4F3Xchfber1+6p0YKwvG2BHPZyKs/lOtOY9MlpPg1QEkIpn8+mYc4AY1N8eKiysuAq/x66hWoFfxfQ=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:04.179990 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:04.196215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f33ac4ff-23fd-44d5-abb0-2b40b3692838 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for project 671198a4c9204d81bb3f7b5115083706. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:56:04.201999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f33ac4ff-23fd-44d5-abb0-2b40b3692838 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for user e1a37e21041c4872b3cba5fc75d52765 and project 671198a4c9204d81bb3f7b5115083706. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:56:04.235333 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f33ac4ff-23fd-44d5-abb0-2b40b3692838 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065313 Aug 27 21:56:04.235987 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3456/7010] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:56:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:04.287569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:04.288458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:04.292838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-23605793", "imageRef": "7ad5aa72-0dde-460a-95f6-2896375ae57e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-153683986", "networks": [{"uuid": "e3480e96-c9b2-4084-aaa6-bb4d9473a15c"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:04.302451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:04.348864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] validate_networks() for [('e3480e96-c9b2-4084-aaa6-bb4d9473a15c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:56:04.756309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:56:04.756751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:56:04.757239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:56:04.757658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:56:04.758079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:56:04.768068 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:04.768547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:04.769057 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:04.769802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:04.770266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:04.770682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:04.788695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for project 671198a4c9204d81bb3f7b5115083706. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:56:04.794417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Getting quotas for user e1a37e21041c4872b3cba5fc75d52765 and project 671198a4c9204d81bb3f7b5115083706. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:56:04.807818 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:56:04.810218 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ad5aa72-0dde-460a-95f6-2896375ae57e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:56:04.864751 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c92943b3-6be0-4008-940e-4df614fd1ba8 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578870 Aug 27 21:56:04.865427 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3555/7011] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:56:04.876997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c5000085-0955-4869-9bd7-4279a3c1414b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:04.877620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c5000085-0955-4869-9bd7-4279a3c1414b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:04.938062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c5000085-0955-4869-9bd7-4279a3c1414b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:04.946404 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c5000085-0955-4869-9bd7-4279a3c1414b tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1256 microversion: 2.1 time: 0.073634 Aug 27 21:56:04.947368 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3457/7012] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:04 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:05.969346 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:05.970722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:05.977422 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:05.977911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:05.978345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:05.979047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:05.979540 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:05.979966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:06.043031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:06.051248 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0628c708-19eb-412a-b5ef-6dfde77f0418 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1308 microversion: 2.1 time: 0.087452 Aug 27 21:56:06.052501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3556/7013] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:05 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:07.074038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:07.075616 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:07.081138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=78 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:07.084301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:07.084835 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:07.085260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:07.085987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:07.086449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:07.086910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:07.236516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:07.246578 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-232e319a-f3b0-41ac-b84d-47ee9ef85dc1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.176363 Aug 27 21:56:07.247629 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3458/7014] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:07 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:08.268358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:08.269192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:08.279806 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:08.280711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:08.281380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:08.282333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:08.283012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:08.283675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:08.445459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:08.454799 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8404911d-ef08-47b7-ba7d-782e5d59f439 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.190312 Aug 27 21:56:08.455408 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3557/7015] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:08 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:09.479718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:09.481411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:09.489422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:09.490328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:09.491011 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:09.491849 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:09.492373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:09.492885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:09.642769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:09.652661 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-32dbafdc-fede-45ec-8e8f-53027210e180 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.179025 Aug 27 21:56:09.654578 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3459/7016] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:09 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:10.674274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:10.675753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:10.682801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:10.683282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:10.683745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:10.684512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:10.684966 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:10.685413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:10.840154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:10.849712 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a219374a-5798-4a47-a6fa-931335f02d2c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.179417 Aug 27 21:56:10.850665 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3558/7017] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:10 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:11.874716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:11.875325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:11.884150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:11.884796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:11.885212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:11.885962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:11.886424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:11.886857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:12.062063 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:12.070811 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-96cbb9cf-eeeb-4191-956e-8fae0208ad21 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.200410 Aug 27 21:56:12.071435 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3460/7018] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:11 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:13.093611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:13.094228 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:13.101374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:13.101881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:13.102325 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:13.103088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:13.103578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:13.104010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:13.306118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:13.317165 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-280caf2b-66c1-4af0-b01d-7ae82bd3175d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.228085 Aug 27 21:56:13.318122 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3559/7019] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:13 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:14.342341 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:14.342970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:14.350536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:14.351035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:14.351508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:14.352208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:14.352666 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:14.353096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:14.491869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:14.500298 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1913b93c-cba9-44ea-832a-d20bf8afbc29 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.164679 Aug 27 21:56:14.500951 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3461/7020] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:14 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:15.521935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:15.522548 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:15.525389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:15.526098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:15.532547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:15.533048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:15.533492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:15.534193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:15.534648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:15.535064 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:15.680647 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:15.696204 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-93480feb-55e0-43e1-ac4c-eb9d7dd95720 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.175424 Aug 27 21:56:15.697102 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3560/7021] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:15 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:16.722719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:16.723550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:16.725791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:16.734299 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:16.734911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:16.735571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:16.736438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:16.737000 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:16.737534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:16.882160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:16.894301 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dfb39cbc-d0b5-45d8-9693-8fc6ab32553a tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.176526 Aug 27 21:56:16.895179 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3462/7022] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:16 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:17.919469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:17.920070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:17.928083 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:17.929253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:17.929711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:17.930449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:17.930893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:17.931353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:18.086564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:18.096037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-84a4fa4d-32b3-42ed-9c9b-18ffffbd465d tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.180741 Aug 27 21:56:18.096859 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3561/7023] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:17 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:18.214995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75d5a44-a8dc-45e6-bb92-903f3069ec0b", "tag": "e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:18.226308 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:18.227016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:18.227499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:18.238852 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] Creating event network-changed:e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692 for instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b on nch1-master-1 Aug 27 21:56:18.244462 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9e6d5a2d-8629-444b-b13b-b3ffbf5732d7 req-d6cb2092-93fb-40b5-8552-8463507d0e80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Aug 27 21:56:18.245141 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3463/7024] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:19.117051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:19.117663 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:19.125872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:19.126373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:19.126820 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:19.127562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:19.128022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:19.128459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:19.271984 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:19.280868 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1a1eb410-49c9-4683-a1a1-510042e902e3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.167232 Aug 27 21:56:19.281432 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3562/7025] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:19 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:20.304921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:20.305741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:20.314572 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:20.315073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:20.315560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:20.316410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:20.316727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:20.317159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:20.463211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:20.472055 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7065e68f-04ce-455d-8da5-5a50c32897e7 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.173031 Aug 27 21:56:20.472632 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3464/7026] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:20 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:21.498156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:21.499012 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:21.511287 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:21.512185 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:21.512925 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:21.514087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:21.514781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:21.515215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:21.650648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:21.658715 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63d8db7c-4b04-41ad-95a6-ebda830cf373 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.167467 Aug 27 21:56:21.659323 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3563/7027] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:21 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:22.680352 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:22.680933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:22.688608 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:22.689068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:22.689542 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:22.690237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:22.690700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:22.691138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:22.839676 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:22.848321 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c20374c-234f-48b3-9325-d05d97402bd4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.172088 Aug 27 21:56:22.848905 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3465/7028] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:22 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:23.878964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:23.879593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:23.888405 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:23.889031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:23.889578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:23.890477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:23.890945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:23.891383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:24.042223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:24.050570 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15c4b29a-21b6-499b-846e-1aa546b17b2e tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.176457 Aug 27 21:56:24.051157 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3564/7029] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:23 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:25.074982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:25.075962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:25.091170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:25.091969 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:25.092792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:25.093873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:25.094704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:25.095515 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:25.244995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:25.253569 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-37a207bc-5e90-4e2c-855f-104c3da9017c tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.184638 Aug 27 21:56:25.254232 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3466/7030] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:25 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:25.299835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75d5a44-a8dc-45e6-bb92-903f3069ec0b", "name": "network-vif-plugged", "status": "completed", "tag": "e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:25.311644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:25.312024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:25.312446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:25.328545 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] Creating event network-vif-plugged:e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692 for instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b on nch1-master-1 Aug 27 21:56:25.333729 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ee819dfb-4e9d-42c2-9d2b-afac55934932 req-ea9ec74e-b262-4916-ae0e-572241e68441 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037826 Aug 27 21:56:25.334547 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3565/7031] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 21:56:26.279414 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:26.280575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:26.288043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:26.288530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:26.288971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:26.289668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:26.290120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:26.290544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:26.428538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:26.438944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05f6e432-25f6-4316-aa27-e7d1b33c6294 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1356 microversion: 2.1 time: 0.166211 Aug 27 21:56:26.439623 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3467/7032] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:26 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:27.462644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:27.463390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:27.472382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.472918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.473403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.474174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.474671 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.475128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.628871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:27.637093 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0d129fca-3de1-4479-bda2-d509f10eab9f tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1545 microversion: 2.1 time: 0.179284 Aug 27 21:56:27.637792 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3566/7033] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:27 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1545 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:27.665702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:27.666320 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:27.672947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.673417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.674032 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.674943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.675427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.675855 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.812166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:27.820975 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6d261212-f47b-4958-8540-364eb3da0e40 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1545 microversion: 2.1 time: 0.159837 Aug 27 21:56:27.821551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3468/7034] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:27 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:27.841587 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:27.847498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:27.848290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Searching by: {'deleted': False, 'project_id': '671198a4c9204d81bb3f7b5115083706'} {{(pid=140434) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 21:56:27.854156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.854645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.855090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.855862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.856374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.856809 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.882714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.multi_cell_list [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 21:56:27.913089 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9827641d-ff25-4b4d-8801-14977be2e637 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.075770 Aug 27 21:56:27.913697 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3567/7035] 10.222.0.40 () {58 vars in 1125 bytes} [Sat Aug 27 21:56:27 2022] GET /compute/v2.1/servers => generated 341 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:27.925672 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:27.926421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:27.933094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.933589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.934029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:27.934724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:27.935183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:27.935651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:28.079198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:28.087697 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ede4dae-8e8f-4d2c-86fa-0b0566b681b1 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1545 microversion: 2.1 time: 0.166154 Aug 27 21:56:28.088280 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3469/7036] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:27 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1545 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:29.627782 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:29.628361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:29.634896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:29.635621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:29.635815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:29.636689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:29.637113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:29.637559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:29.663382 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:56:29.743779 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2e7b0ae-05e9-4a95-be53-a740bf0e9f97 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 204 len: 0 microversion: 2.1 time: 0.119900 Aug 27 21:56:29.744443 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3568/7037] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:56:29 2022] DELETE /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:56:29.753303 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:29.754053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:29.761297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:29.761879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:29.762580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:29.763379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:29.763896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:29.764327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:29.909002 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:29.923366 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5d1bb499-437e-49fb-9e7a-d28f481fd5b3 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1551 microversion: 2.1 time: 0.173550 Aug 27 21:56:29.923978 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3470/7038] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:29 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:30.950049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:30.951225 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:30.962296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:30.963125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:30.963922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:30.965482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:30.966248 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:30.966960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:31.110876 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:31.119323 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-853b74d4-f1ea-4837-9470-526d5e98a7f6 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1551 microversion: 2.1 time: 0.176502 Aug 27 21:56:31.119946 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3569/7039] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:30 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:31.743654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75d5a44-a8dc-45e6-bb92-903f3069ec0b", "name": "network-vif-deleted", "tag": "e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:31.754116 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:31.754618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:31.755030 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:31.771818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] Creating event network-vif-deleted:e66f73b5-e4c3-4616-b1ae-7d6aa6f3d692 for instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b on nch1-master-1 Aug 27 21:56:31.777269 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f8d96b87-8647-43de-9310-eea5ea100099 req-ab3a3317-0097-4a54-b00f-046ca452f5e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037332 Aug 27 21:56:31.777892 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3471/7040] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:32.144265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:32.144901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:32.153893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:32.154505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:32.155049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:32.155959 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:32.156501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:32.157157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:32.191698 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:32.192173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:32.192606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:32.193054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lazy-loading 'fault' on Instance uuid a75d5a44-a8dc-45e6-bb92-903f3069ec0b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 21:56:32.195944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:32.235523 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a37e21041c4872b3cba5fc75d52765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671198a4c9204d81bb3f7b5115083706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:32.243843 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ec7786c5-20d4-4368-9738-45e2b85ab433 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 200 len: 1346 microversion: 2.1 time: 0.105645 Aug 27 21:56:32.244431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3570/7041] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:32 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 1346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:33.268358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:33.269035 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] [instance: a75d5a44-a8dc-45e6-bb92-903f3069ec0b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:33.278329 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:33.278824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:33.279480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:33.280214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:33.280665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:33.281095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:33.298032 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] HTTP exception thrown: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Request method failure captured: Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b HTTP/1.1 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpK_2Kdua-RLa6svl9rg1dE6S68vzgfh21-MetvmL1Vj6rLJVb7-wVvQ2Uuq33tcVv6hpkfWz214GX68H19hSnxPIShtIbg-y_aEpWOpQAPgDKpDCXtMB3Lm1ILdKYZvpfTATqhC93Tkqo7LzmGo8YDeIXEZpTxb0oprFEEnYMAb6_M Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 671198a4c9204d81bb3f7b5115083706 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/671198a4c9204d81bb3f7b5115083706"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/671198a4c9204d81bb3f7b5115083706"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_671198a4c9204d81bb3f7b5115083706", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/671198a4c9204d81bb3f7b5115083706"}]}] Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 671198a4c9204d81bb3f7b5115083706 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1640982395 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestMinimumBasicScenario-1640982395-project Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: e1a37e21041c4872b3cba5fc75d52765 Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestMinimumBasicScenario-1640982395-project Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'a75d5a44-a8dc-45e6-bb92-903f3069ec0b'} Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:56:33.299738 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Returning 404 to user: Instance a75d5a44-a8dc-45e6-bb92-903f3069ec0b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-839bcabb-3952-420d-b2ac-c1b74f0980e4 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b" status: 404 len: 111 microversion: 2.1 time: 0.038404 Aug 27 21:56:33.304941 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3472/7042] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:33 2022] GET /compute/v2.1/servers/a75d5a44-a8dc-45e6-bb92-903f3069ec0b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:56:33.310457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1b4b192b-e910-40af-b181-46ed90c682e9 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] Calling method '.version_select at 0x7ff84f1f2e50>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:33.337341 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1b4b192b-e910-40af-b181-46ed90c682e9 tempest-TestMinimumBasicScenario-1640982395 tempest-TestMinimumBasicScenario-1640982395-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-153683986" status: 202 len: 0 microversion: 2.1 time: 0.030753 Aug 27 21:56:33.337927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3571/7043] 10.222.0.40 () {58 vars in 1269 bytes} [Sat Aug 27 21:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-153683986 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:56:42.962521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-db90401b-564d-4dc0-a00b-f12f0fbd8007 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: .version_select at 0x7ff84e1a2040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1595943370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyoV++oAVUFnuuylebbB4fAuR3QaX6fhBhJ8IQvoxHngNx0y1A+IKmZyE9iMt5f2pStUvA6k5LAUBoK32PDgUdfNuslt/6d/43ywm1ZSp4D4D2Mjdd6SQmMYcyx4PJTXw=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:42.968435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:42.981629 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-db90401b-564d-4dc0-a00b-f12f0fbd8007 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:56:42.987811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-db90401b-564d-4dc0-a00b-f12f0fbd8007 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:56:43.013145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-db90401b-564d-4dc0-a00b-f12f0fbd8007 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.225922 Aug 27 21:56:43.013953 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3473/7044] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:56:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:49.389905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:49.390858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:49.391506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:49.395736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-225186661", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "76a0100b-fd27-4d18-86f7-7e8141f1c93c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1595943370", "security_groups": [{"name": "tempest-secgroup-smoke-642171375"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:49.545290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] validate_networks() for [('76a0100b-fd27-4d18-86f7-7e8141f1c93c', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:56:49.951753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:56:49.952181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:56:49.952668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:56:49.953112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:56:49.953526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:56:49.965304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:49.967266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:49.967812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:49.968786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:49.969232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:49.969868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:49.988093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:56:49.993640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:56:50.006623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:56:50.009238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:56:50.059859 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7393b8ac-40ff-46b1-917c-3ced4861a718 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671449 Aug 27 21:56:50.066754 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3572/7045] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:56:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:56:50.068799 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=78 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:56:50.074142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f5eccd6-4596-49e3-b0b1-64f6870252db tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:50.074774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f5eccd6-4596-49e3-b0b1-64f6870252db tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:50.136174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2f5eccd6-4596-49e3-b0b1-64f6870252db tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:50.145450 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f5eccd6-4596-49e3-b0b1-64f6870252db tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1266 microversion: 2.1 time: 0.077278 Aug 27 21:56:50.146043 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3474/7046] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:50 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:51.167655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:51.170656 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:51.184053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:51.184907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:51.185563 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:51.186886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:51.187722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:51.192221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:51.289063 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:51.298538 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-81b16ee4-c2f9-473b-aae2-747566f1aba7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1326 microversion: 2.1 time: 0.134890 Aug 27 21:56:51.299194 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3573/7047] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:51 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:52.321475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:52.322708 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:52.331003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:52.331547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:52.332269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:52.333335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:52.334106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:52.334713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:52.477838 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:52.486059 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-964cafee-3d59-4d0c-8107-aa9bb94aa57c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.168833 Aug 27 21:56:52.486794 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3475/7048] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:52 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:52.790590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e09ba6b-9c4f-4c28-b67c-690e5b93e36c", "tag": "592a3304-0b24-44d9-8d2e-4c0bbcee6d38"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:52.803554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:52.804046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:52.804466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:52.816505 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] Creating event network-changed:592a3304-0b24-44d9-8d2e-4c0bbcee6d38 for instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c on nch1-master-1 Aug 27 21:56:52.821493 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-00a63e4f-e661-40b7-b41f-69b592f93d00 req-46e5567c-7958-4413-ae93-d5c512e244e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034984 Aug 27 21:56:52.822097 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3574/7049] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:53.509238 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:53.509872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:53.517757 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:53.518127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:53.518583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:53.519334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:53.519820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:53.520258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:53.675662 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:53.683637 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e6a153e-eb10-4285-9b21-8c23dba0b367 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.178984 Aug 27 21:56:53.684218 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3476/7050] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:53 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:54.708013 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:54.708841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:54.717364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:54.717907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:54.718428 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:54.719246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:54.719824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:54.720333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:54.863542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:54.875537 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4338b6a-1e3c-45ca-947e-6a56da0259de tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.173473 Aug 27 21:56:54.876396 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3575/7051] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:54 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:55.901674 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:55.902647 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:55.915093 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:55.916062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:55.916720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:55.917896 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:55.918704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:55.919439 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:56.059139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:56.070837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b9f69b8-a386-4010-8349-8847a968c267 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.176148 Aug 27 21:56:56.071631 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3477/7052] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:55 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:57.097181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:57.097884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:57.106589 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:57.107092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:57.107667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:57.108465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:57.109050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:57.109569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:57.251147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:57.259770 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-02fa42e2-bf77-4984-935f-206b2ced0588 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.169189 Aug 27 21:56:57.260357 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3576/7053] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:57 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:58.286692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:58.287820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:58.298174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:58.299500 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:58.299962 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:58.300673 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:58.301143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:58.301604 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:58.438010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:58.446608 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bb225ac3-3f27-49dd-90f1-9e8c72e93fa7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.167945 Aug 27 21:56:58.447230 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3478/7054] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:58 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:56:59.442500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e09ba6b-9c4f-4c28-b67c-690e5b93e36c", "name": "network-vif-plugged", "status": "completed", "tag": "592a3304-0b24-44d9-8d2e-4c0bbcee6d38"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:56:59.453620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:59.454753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:59.454886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:59.469276 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] Creating event network-vif-plugged:592a3304-0b24-44d9-8d2e-4c0bbcee6d38 for instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c on nch1-master-1 Aug 27 21:56:59.475203 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f9859e01-08d0-43b6-a138-eb611de6e85b req-3705c376-ca02-405a-94e0-e0ba81114f7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037147 Aug 27 21:56:59.476139 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3577/7055] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:56:59.477653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:56:59.478833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:56:59.486372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:59.486885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:59.487332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:59.488068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:56:59.489114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:56:59.489557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:56:59.634200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:56:59.642626 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4bb8cc4-79f0-46dc-a47c-0198875e088e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.169209 Aug 27 21:56:59.643549 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3479/7056] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:56:59 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:57:00.666765 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:57:00.667494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:57:00.669503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:57:00.670358 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:57:00.677459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:00.677962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:00.678409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:00.679115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:00.679606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:00.680040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:00.819090 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:57:00.827372 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-eaa4d8d8-2b06-4b18-9fc1-8a177b6bf1e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1391 microversion: 2.1 time: 0.165167 Aug 27 21:57:00.827967 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3578/7057] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:57:00 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:57:01.852632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:57:01.853443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:57:01.856296 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:57:01.865721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:01.866227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:01.866665 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:01.867442 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:01.867919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:01.868356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:02.014911 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:57:02.023702 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-05fefdfd-ef50-4d0c-923b-acf22d38c687 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1564 microversion: 2.1 time: 0.177551 Aug 27 21:57:02.024266 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3480/7058] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:57:01 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:57:02.044201 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:57:02.044812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:57:02.052207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:02.052963 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:02.053142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:02.053872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:02.054327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:02.054756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:02.206594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:57:02.219642 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-283d070a-a5bc-43b0-8310-7ecaf7741610 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1564 microversion: 2.1 time: 0.179106 Aug 27 21:57:02.220509 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3579/7059] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:57:02 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:57:03.855059 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:57:03.855720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:57:03.855869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e09ba6b-9c4f-4c28-b67c-690e5b93e36c", "tag": "592a3304-0b24-44d9-8d2e-4c0bbcee6d38"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:57:03.862933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:03.864321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:03.865547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:03.866488 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:03.867167 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:03.867802 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:03.867949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:03.868636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:03.869713 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:03.885288 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] Creating event network-changed:592a3304-0b24-44d9-8d2e-4c0bbcee6d38 for instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c on nch1-master-1 Aug 27 21:57:03.894064 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-3195590d-35d4-4863-9131-10d9893d864b req-3adf1885-83c5-4e91-b8ac-501ba515edb2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041689 Aug 27 21:57:03.895391 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3580/7060] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:57:04.024529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:57:04.032964 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-21b01122-f124-4030-96f0-82ef31982c6f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1564 microversion: 2.1 time: 0.183347 Aug 27 21:57:04.039421 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3481/7061] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:57:03 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:57:37.403905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:57:37.404674 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=38 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:57:37.409672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:57:37.412109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:57:37.419884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:37.420371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:37.420867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:37.421546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:57:37.421999 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:57:37.422415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:57:37.496356 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5989047c-cc65-4424-9a38-c53e9399a51f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action" status: 200 len: 24570 microversion: 2.1 time: 0.093691 Aug 27 21:57:37.497240 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3581/7062] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:57:37 2022] POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action => generated 24570 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:58:16.588399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:16.589619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:16.590748 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 21:58:16.590923 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 21:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action (ip 10.222.0.40) !!! Aug 27 21:58:16.595879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:16.596418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:16.604656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:16.605134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:16.605574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:16.606365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:16.606815 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:16.607245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:16.684038 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ace407f6-1027-4b1f-ab76-dfa07adca4bb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action" status: 202 len: 0 microversion: 2.1 time: 0.097422 Aug 27 21:58:16.684682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3482/7063] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:58:16 2022] POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:58:16.694578 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:16.695280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:16.698274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:16.699086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:16.706308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:16.706872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:16.707323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:16.708052 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:16.708513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:16.708941 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:16.856130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:16.864681 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-63ecbb23-8a0d-436e-b683-40e5fd6c481a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1688 microversion: 2.1 time: 0.174419 Aug 27 21:58:16.865259 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3582/7064] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:16 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:17.896595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:17.897775 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:17.909874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:17.910350 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:17.910796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:17.911577 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:17.912023 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:17.912467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:18.076900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:18.085289 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7594b5ee-0975-4cc1-9372-6ab3ef5f325d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1668 microversion: 2.1 time: 0.197034 Aug 27 21:58:18.085867 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3483/7065] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:17 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:19.193665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:19.195949 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:19.204160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.204813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.205512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.206221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.206672 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.207128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.276565 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47f89b99-a590-45cf-ab35-d880f26fd64e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action" status: 200 len: 32642 microversion: 2.1 time: 0.087010 Aug 27 21:58:19.277229 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3583/7066] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:58:19 2022] POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action => generated 32642 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:58:19.289174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:19.289726 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:19.297219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.297716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.298169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.299316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.299823 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.300258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.376616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2ad9a6b4-0535-4823-936f-eaeb08595ae3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action" status: 202 len: 0 microversion: 2.1 time: 0.091048 Aug 27 21:58:19.377735 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3484/7067] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:58:19 2022] POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:58:19.386636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:19.387353 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:19.394634 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.395124 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.395597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.396277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:19.396724 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:19.397148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:19.545454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:19.554546 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-846910fa-2c70-414b-b28b-432e064bad9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1675 microversion: 2.1 time: 0.172102 Aug 27 21:58:19.555303 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3584/7068] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:19 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:20.582112 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:20.582727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:20.594163 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:20.594834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:20.595435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:20.596387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:20.596895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:20.597365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:20.752905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:20.761715 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a4c0941c-1c63-4c40-ae58-f83772d82f9e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1683 microversion: 2.1 time: 0.186692 Aug 27 21:58:20.762304 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3485/7069] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:20 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:20.860764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:20.863603 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:20.871837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:20.872302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:20.872740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:20.873453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:20.873906 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:20.874350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:20.936664 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c360f9e9-ddf5-4e59-99e1-f54004225bbf tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action" status: 200 len: 38430 microversion: 2.1 time: 0.079753 Aug 27 21:58:20.937320 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3585/7070] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:58:20 2022] POST /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c/action => generated 38430 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:58:22.259861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:22.260410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e09ba6b-9c4f-4c28-b67c-690e5b93e36c", "tag": "592a3304-0b24-44d9-8d2e-4c0bbcee6d38"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:22.261056 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:22.268545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:22.269169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:22.269732 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:22.270601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:22.271289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:22.271572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:22.271776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:22.272059 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:22.272497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:22.285460 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] Creating event network-changed:592a3304-0b24-44d9-8d2e-4c0bbcee6d38 for instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c on nch1-master-1 Aug 27 21:58:22.290528 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-aa0858c7-71e6-4b29-a768-4e03f51954af req-c1048ed6-fdef-4325-b06d-030143039950 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Aug 27 21:58:22.291780 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3586/7071] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:22.300741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 21:58:22.390293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2f9c8d55-6390-4a8c-8076-e1e364b4a010 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 204 len: 0 microversion: 2.1 time: 0.135640 Aug 27 21:58:22.391600 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3486/7072] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 21:58:22 2022] DELETE /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 21:58:22.402567 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:22.403420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:22.410719 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:22.411251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:22.411740 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:22.412457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:22.412921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:22.413354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:22.568207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:22.576678 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a98f8994-751a-4ad3-8514-fa5aa2ade156 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1689 microversion: 2.1 time: 0.179891 Aug 27 21:58:22.577252 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3587/7073] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:22 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:23.605054 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:23.606184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:23.617952 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:23.618765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:23.619547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:23.620684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:23.621435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:23.622137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:23.766581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:23.774812 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86397a03-d750-4fb4-a194-2c9a2579f738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1689 microversion: 2.1 time: 0.177636 Aug 27 21:58:23.775397 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3487/7074] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:23 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:24.796706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:24.797348 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:24.806383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:24.806891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:24.807475 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:24.808206 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:24.808846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:24.809538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:24.825567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e09ba6b-9c4f-4c28-b67c-690e5b93e36c", "name": "network-vif-deleted", "tag": "592a3304-0b24-44d9-8d2e-4c0bbcee6d38"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:24.837903 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:24.839377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:24.839377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:24.861490 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] Creating event network-vif-deleted:592a3304-0b24-44d9-8d2e-4c0bbcee6d38 for instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c on nch1-master-1 Aug 27 21:58:24.866788 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cbda3e88-a0eb-4e4e-9f9e-9a1f11f1a278 req-df008c76-7944-4271-9782-89f8ce3906f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044994 Aug 27 21:58:24.868945 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3488/7075] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:24.891829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:24.900929 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5119c81c-3a76-4552-8771-46e54377e6f8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 200 len: 1503 microversion: 2.1 time: 0.108340 Aug 27 21:58:24.911253 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3588/7076] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:24 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 1503 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:25.928889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:25.930071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:25.940971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:25.941807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:25.942576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:25.943330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:25.943806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:25.944272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:25.958283 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] HTTP exception thrown: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Request method failure captured: Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c HTTP/1.1 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpMamkfsxmnYNCoceuv8zagP_ZZNdYZoovVgXUsg2rLlnbsws0AsbsbEUpJ0aYoCpndsnkWW7YB5lO9OkDLSPT5FsyMKh4wolBqBSGC07JNVt1mqLsTuUWCX8Ntfn20-odtY5URGEepAKIw13xyJLsjYrdlMSYScItsyW-YtS1m7otw Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e90292bcae4ce7995cce7a8b67780f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}] Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1a7cdfb52b654fb4a46664b3043f8e70 Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '7e09ba6b-9c4f-4c28-b67c-690e5b93e36c'} Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:58:25.959980 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Returning 404 to user: Instance 7e09ba6b-9c4f-4c28-b67c-690e5b93e36c could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-388a4dfd-e469-47b3-b87f-922188925b85 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c" status: 404 len: 111 microversion: 2.1 time: 0.041300 Aug 27 21:58:25.965508 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3489/7077] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:25 2022] GET /compute/v2.1/servers/7e09ba6b-9c4f-4c28-b67c-690e5b93e36c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 21:58:29.419477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9d96c01b-ad2c-4419-8d0d-260a82f84117 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '.version_select at 0x7ff84ee4e700>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:29.444943 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9d96c01b-ad2c-4419-8d0d-260a82f84117 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595943370" status: 202 len: 0 microversion: 2.1 time: 0.031432 Aug 27 21:58:29.445557 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3589/7078] 10.222.0.40 () {58 vars in 1284 bytes} [Sat Aug 27 21:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1595943370 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:58:29.474968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f45e5937-cb26-4626-8786-ab39f9ba9f8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: .version_select at 0x7ff857cb1160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-152827897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbudGMWJ18q3SImizcOZMN3jM7IuLSxKFaLy3WAjN/z35sQfkQ/1RglMB5OTmxRKMhWXp0yeIY0/hEryXC4XCh7nFeh8/SxoESpDzUTTk5OIen+I/j7e6po+086o8wzKg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:29.493109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f45e5937-cb26-4626-8786-ab39f9ba9f8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:58:29.498393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-f45e5937-cb26-4626-8786-ab39f9ba9f8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:58:29.526110 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f45e5937-cb26-4626-8786-ab39f9ba9f8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055678 Aug 27 21:58:29.526757 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3490/7079] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 21:58:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:35.653644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=34 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:35.658631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-325747443", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "fdc52ece-9aa2-45b3-bb93-0b1e897410a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-152827897", "security_groups": [{"name": "tempest-secgroup-smoke-965283364"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:35.787790 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] validate_networks() for [('fdc52ece-9aa2-45b3-bb93-0b1e897410a5', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 21:58:36.258863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 21:58:36.259456 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 21:58:36.260132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 21:58:36.260695 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 21:58:36.261380 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 21:58:36.278670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:36.279302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:36.279619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:36.280404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:36.280804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:36.281289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:36.305829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 21:58:36.314620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 21:58:36.334302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 21:58:36.337191 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 21:58:36.391388 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7608b609-9310-4cc8-8cf2-bce7a0b2149c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739673 Aug 27 21:58:36.392264 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3590/7080] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 21:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 21:58:36.403892 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5ab00aaa-695f-4d4c-a318-17820e36d7e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:36.405382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5ab00aaa-695f-4d4c-a318-17820e36d7e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:36.410058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:36.484377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5ab00aaa-695f-4d4c-a318-17820e36d7e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:36.497271 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5ab00aaa-695f-4d4c-a318-17820e36d7e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1265 microversion: 2.1 time: 0.097443 Aug 27 21:58:36.503778 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3491/7081] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:36 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 21:58:37.519715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:37.522945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:37.550870 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:37.551689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:37.552447 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:37.553411 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:37.554071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:37.554726 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:37.635544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:37.645681 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4dbc8026-1556-41e5-80e9-e156c917c126 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1325 microversion: 2.1 time: 0.130786 Aug 27 21:58:37.646874 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3591/7082] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:37 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1325 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:38.667610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:38.668827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:38.676314 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:38.677036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:38.677667 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:38.678580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:38.679107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:38.679596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:38.845018 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:38.853982 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b0e44b94-1144-467b-9cf5-a04b99c8a060 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.190749 Aug 27 21:58:38.854579 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3492/7083] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:38 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:39.072706 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c34ba6c-9fd5-4008-8750-cf8171e60547", "tag": "3cee70dc-5855-4804-94e7-50f7a665b9e0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:39.083788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:39.084371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:39.084829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:39.097124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] Creating event network-changed:3cee70dc-5855-4804-94e7-50f7a665b9e0 for instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 on nch1-master-1 Aug 27 21:58:39.105851 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-026b641b-4c3a-4d91-9d0d-b83c30b0b687 req-f3df4eb9-2aeb-4aaa-a7d2-970f3f690ac2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037103 Aug 27 21:58:39.106462 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3592/7084] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:39.879331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:39.880173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:39.891174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:39.891971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:39.892656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:39.893713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:39.894412 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:39.895070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:40.041300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:40.049624 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3e6a287f-e533-466b-8ba4-26549368e833 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.176609 Aug 27 21:58:40.050196 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3493/7085] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:39 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:41.073593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:41.074308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:41.081305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:41.081801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:41.082247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:41.082952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:41.083625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:41.084137 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:41.222458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:41.231235 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15ed65d1-595a-49d9-85b8-9ab2bef37bb6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.163232 Aug 27 21:58:41.232084 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3593/7086] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:41 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:42.256212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:42.256827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:42.264127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:42.264627 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:42.265074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:42.265786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:42.266249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:42.266651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:42.403029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:42.411129 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2a6e11c2-5cc4-436c-8343-39515c882d0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.160761 Aug 27 21:58:42.411956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3494/7087] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:42 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:43.434621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:43.435330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:43.444242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:43.444967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:43.445642 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:43.446727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:43.447498 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:43.448174 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:43.590253 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:43.598154 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-420ad5dd-7adc-4142-a7ce-e3fef94fd141 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.168126 Aug 27 21:58:43.598732 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3594/7088] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:43 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:44.622057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:44.622856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:44.630541 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:44.631045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:44.631532 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:44.632318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:44.632725 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:44.633137 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:44.768713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:44.778681 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-80c3df0e-9831-498a-9a1d-8a2c8a6d0f3c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.162852 Aug 27 21:58:44.779270 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3495/7089] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:44 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:45.803796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:45.804461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:45.812700 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:45.813251 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:45.813745 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:45.814524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:45.815043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:45.815556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:45.958508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:45.967517 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e13c324e-4f05-46c7-b82b-d3415e0a460c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.170104 Aug 27 21:58:45.968138 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3595/7090] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:45 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:46.032347 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c34ba6c-9fd5-4008-8750-cf8171e60547", "name": "network-vif-plugged", "status": "completed", "tag": "3cee70dc-5855-4804-94e7-50f7a665b9e0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:46.043797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:46.044369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:46.044814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:46.057369 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] Creating event network-vif-plugged:3cee70dc-5855-4804-94e7-50f7a665b9e0 for instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 on nch1-master-1 Aug 27 21:58:46.062571 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-2b7f1fe7-8d6d-4870-9165-98ac558d940e req-e8b39b13-cbfd-4b1b-9742-eec7d561c558 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034165 Aug 27 21:58:46.063184 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3496/7091] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:46.989175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:46.989772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:46.992069 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:46.992739 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:46.994239 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:47.000965 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:47.001466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:47.001905 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:47.002611 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:47.003106 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:47.003575 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:47.145600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:47.154445 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7b110b49-52cc-4f8c-9a9b-7bda8e5f708a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1390 microversion: 2.1 time: 0.169257 Aug 27 21:58:47.155042 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3596/7092] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:46 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:48.177185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:48.177946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:48.180805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:48.182690 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:58:48.189686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:48.190271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:48.190809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:48.191719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:48.192285 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:48.192812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:48.334068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:48.343236 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-51c48a1d-7001-4b9e-ae9d-dab43f234058 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1562 microversion: 2.1 time: 0.171158 Aug 27 21:58:48.343834 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3497/7093] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:48 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:48.364246 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:48.364900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:48.372355 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:48.372845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:48.373289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:48.373975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:48.374457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:48.374889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:48.515220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:48.525554 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5041585b-c40b-44b0-acca-83515d33f40f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1562 microversion: 2.1 time: 0.165305 Aug 27 21:58:48.526144 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3597/7094] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:48 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:58:50.503782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:58:50.504419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:58:50.506644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c34ba6c-9fd5-4008-8750-cf8171e60547", "tag": "3cee70dc-5855-4804-94e7-50f7a665b9e0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:58:50.512019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:50.512761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:50.513215 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:50.513936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:50.514649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:50.515133 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:50.517766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:58:50.518457 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:58:50.519085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:58:50.531165 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] Creating event network-changed:3cee70dc-5855-4804-94e7-50f7a665b9e0 for instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 on nch1-master-1 Aug 27 21:58:50.536402 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-33ae6f8f-9ea7-439b-9974-589eaac6e0d0 req-9183d8a8-69ef-42d5-b114-aad4453deaff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034402 Aug 27 21:58:50.537009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3598/7095] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 21:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 21:58:50.668783 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:58:50.677834 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-168406df-c3f8-4ef1-99c3-2fb20f8eef14 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1562 microversion: 2.1 time: 0.178272 Aug 27 21:58:50.678623 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3498/7096] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:58:50 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:59:23.998932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=5 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:23.999748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=42 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:24.005814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:59:24.009469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:24.019210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:24.019734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:24.020169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:24.020880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:24.021352 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:24.021830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:24.092836 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-facaf574-b1a0-45e8-9dd9-9f2331137fea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action" status: 200 len: 24569 microversion: 2.1 time: 0.096008 Aug 27 21:59:24.093535 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3599/7097] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:59:23 2022] POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 21:59:54.541730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:54.542745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=38 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:54.548171 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 21:59:54.551124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:54.560491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:54.561147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:54.561746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:54.562686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:54.563304 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:54.563921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:54.649758 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2244bb75-f9f9-471f-bc66-3a77c73297a4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action" status: 202 len: 0 microversion: 2.1 time: 0.110554 Aug 27 21:59:54.650551 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3499/7098] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 21:59:54 2022] POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 21:59:54.661372 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:59:54.662335 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:54.665461 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:54.666369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 21:59:54.672650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:54.673177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:54.673643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:54.674392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:54.674877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:54.675309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:54.916725 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:59:54.924987 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-85cdf83f-8f98-4f21-b8b5-1eaa3216a67f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1673 microversion: 2.1 time: 0.268125 Aug 27 21:59:54.925639 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3600/7099] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:59:54 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:59:55.952036 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:59:55.952874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:55.960961 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:55.961459 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:55.961912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:55.962617 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:55.963081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:55.963561 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:56.172422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:59:56.184614 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-964814fa-4af2-4566-955c-65c1b41ef214 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.238994 Aug 27 21:59:56.185388 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3500/7100] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:59:55 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:59:57.212359 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:59:57.212939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:57.221573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:57.222072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:57.222519 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:57.223234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:57.223727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:57.224194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:57.369301 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:59:57.377680 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5b1b6bec-1473-4318-a70e-df07aa215f17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.171031 Aug 27 21:59:57.378241 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3601/7101] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:59:57 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:59:58.404774 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:59:58.405813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:58.416963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:58.417457 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:58.417906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:58.418612 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:58.419080 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:58.419570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:58.584348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:59:58.594029 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e7bc91da-dd51-4f32-9196-45ce6f66fe28 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.196664 Aug 27 21:59:58.594611 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3501/7102] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:59:58 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 21:59:59.615864 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 21:59:59.616414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 21:59:59.623473 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:59.623980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:59.624423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:59.625128 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 21:59:59.625602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 21:59:59.626032 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 21:59:59.765338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 21:59:59.773576 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ead1e5b4-3d30-44e5-9220-15ac7d6b977f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.161904 Aug 27 21:59:59.774159 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3602/7103] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 21:59:59 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:00.796593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:00.797251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:00.804832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:00.805335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:00.805790 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:00.806521 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:00.807377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:00.807916 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:00.959988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:00.968405 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-935e8d99-101e-4782-adc2-04531890767d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.175839 Aug 27 22:00:00.969002 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3502/7104] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:00 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:01.994930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:01.995798 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:02.003439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:02.003935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:02.004371 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:02.005111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:02.005550 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:02.005976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:02.151619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:02.160066 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aed7adc8-2495-459c-9bcf-78930c069aea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.172034 Aug 27 22:00:02.160648 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3603/7105] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:01 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:03.186696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:03.187747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:03.199094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:03.199637 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:03.200085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:03.200787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:03.201252 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:03.201711 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:03.342900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:03.351296 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b84a3283-2a07-4cf7-ad87-3e82d0217a50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.171269 Aug 27 22:00:03.351922 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3503/7106] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:03 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:04.378423 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:04.379047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:04.389987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:04.390616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:04.391435 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:04.392546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:04.393289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:04.393933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:04.547685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:04.560283 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-99ec75da-573a-489c-96f4-5dbe26092f31 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.189903 Aug 27 22:00:04.561138 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3604/7107] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:04 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:05.581924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:05.582502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:05.590449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:05.590948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:05.591435 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:05.592139 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:05.592607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:05.593050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:05.742734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:05.752614 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b040d094-9be0-4f70-a5a9-cefc1112c88c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1678 microversion: 2.1 time: 0.174843 Aug 27 22:00:05.753204 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3504/7108] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:05 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:06.786737 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:06.787774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:06.796974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:06.797472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:06.797915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:06.798619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:06.799079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:06.799560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:06.942464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:06.951449 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-da0afeac-9658-43cb-a666-b168d7a852d8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1681 microversion: 2.1 time: 0.171407 Aug 27 22:00:06.952040 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3605/7109] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:06 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:39.215254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:00:39.217531 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:39.220155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:39.220833 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:39.227760 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:39.228240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:39.228692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:39.229408 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:39.229873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:39.230305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:39.314436 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d8bbebaf-63f7-40cd-9399-b97d253df982 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action" status: 200 len: 69119 microversion: 2.1 time: 0.103345 Aug 27 22:00:39.315230 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3505/7110] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:00:39 2022] POST /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547/action => generated 69119 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:00:56.383508 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:56.384067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:56.386214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:56.389560 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:56.390743 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:56.390974 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=36 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:00:56.397048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:56.397266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:56.397628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:56.398600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:56.399281 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:56.399921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:56.427968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:00:56.475305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c34ba6c-9fd5-4008-8750-cf8171e60547", "tag": "3cee70dc-5855-4804-94e7-50f7a665b9e0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:00:56.486734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:56.487620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:56.488065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:56.499644 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] Creating event network-changed:3cee70dc-5855-4804-94e7-50f7a665b9e0 for instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 on nch1-master-1 Aug 27 22:00:56.504940 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-c5245002-5684-46ac-9009-f0561c7e71c9 req-e0923a4d-053e-4bbc-b8c5-c43a2c0f394a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123018 Aug 27 22:00:56.505720 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3506/7111] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:00:56.532795 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73e93bb2-e5ee-46fb-8fb8-7a16bb678e5a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 204 len: 0 microversion: 2.1 time: 0.154030 Aug 27 22:00:56.533674 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3606/7112] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:00:56 2022] DELETE /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:00:56.544792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:56.545520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:56.552332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:56.553097 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:56.553622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:56.554411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:56.554902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:56.555333 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:56.702984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:56.711070 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fcf13ad5-2e37-4e75-a7e9-0fadb55dcb50 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1687 microversion: 2.1 time: 0.172298 Aug 27 22:00:56.711767 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3507/7113] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:56 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:57.735606 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:57.736314 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:57.744616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:57.745120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:57.745562 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:57.746263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:57.747383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:57.747838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:57.886850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:57.895213 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c0da146d-7ff6-4c2c-96bf-836fd991901d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1687 microversion: 2.1 time: 0.164576 Aug 27 22:00:57.895868 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3607/7114] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:57 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:58.918031 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:00:58.918812 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:00:58.925669 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:58.926266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:58.926952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:58.927777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:58.928227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:58.928691 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:59.003100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:00:59.008174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c34ba6c-9fd5-4008-8750-cf8171e60547", "name": "network-vif-deleted", "tag": "3cee70dc-5855-4804-94e7-50f7a665b9e0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:00:59.012564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-77c84852-4169-4107-a326-bd7a49fd5667 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 200 len: 1350 microversion: 2.1 time: 0.098671 Aug 27 22:00:59.013123 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3608/7115] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:00:58 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:00:59.018345 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:00:59.018834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:00:59.019261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:00:59.032100 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] Creating event network-vif-deleted:3cee70dc-5855-4804-94e7-50f7a665b9e0 for instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 on nch1-master-1 Aug 27 22:00:59.037927 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-e348c4a9-f748-4254-93a7-9c3f26e05780 req-d48eaa05-73ff-41a6-887d-bcbe1f09fe6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147259 Aug 27 22:00:59.038522 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3508/7116] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:01:00.035356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:00.035975 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 3c34ba6c-9fd5-4008-8750-cf8171e60547] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:00.043859 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:00.044309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:00.044824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:00.045537 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:00.046000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:00.046438 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:00.061046 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] HTTP exception thrown: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Request method failure captured: Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 HTTP/1.1 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpMamkfsxmnYNCoceuv8zagP_ZZNdYZoovVgXUsg2rLlnbsws0AsbsbEUpJ0aYoCpndsnkWW7YB5lO9OkDLSPT5FsyMKh4wolBqBSGC07JNVt1mqLsTuUWCX8Ntfn20-odtY5URGEepAKIw13xyJLsjYrdlMSYScItsyW-YtS1m7otw Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e90292bcae4ce7995cce7a8b67780f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}] Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1a7cdfb52b654fb4a46664b3043f8e70 Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '3c34ba6c-9fd5-4008-8750-cf8171e60547'} Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:01:00.062729 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Returning 404 to user: Instance 3c34ba6c-9fd5-4008-8750-cf8171e60547 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aaf233da-2c8e-4bb7-9136-9b332bbe85ff tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547" status: 404 len: 111 microversion: 2.1 time: 0.032932 Aug 27 22:01:00.068050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3609/7117] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:00 2022] GET /compute/v2.1/servers/3c34ba6c-9fd5-4008-8750-cf8171e60547 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:01:03.446276 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d7331cbf-06df-4d9c-818a-32093822e33a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '.version_select at 0x7ff84dec1ca0>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:03.450922 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d7331cbf-06df-4d9c-818a-32093822e33a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:01:04.465212 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-d7331cbf-06df-4d9c-818a-32093822e33a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37396. Aug 27 22:01:04.493181 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d7331cbf-06df-4d9c-818a-32093822e33a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-152827897" status: 202 len: 0 microversion: 2.1 time: 1.054312 Aug 27 22:01:04.494122 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3509/7118] 10.222.0.40 () {58 vars in 1281 bytes} [Sat Aug 27 22:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-152827897 => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:01:04.526399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f42decf1-c210-4914-a4cd-72a538dd7bf6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: .version_select at 0x7ff84eeb4310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1331205866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGrOoDWgMWT3fojxjukvb/GdEw1pAv0gKSfX24yz0RGT0bazdqUIT+cU/2BsOo5JXwM+VlNwXSQm06Rudw36i5aFGwhDLaA/45judUhBWkL9ghQ+BymnSboTIWjxa3G3Q=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:04.533963 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:01:04.534145 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 22:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.40) !!! Aug 27 22:01:04.551464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f42decf1-c210-4914-a4cd-72a538dd7bf6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:01:04.556826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-f42decf1-c210-4914-a4cd-72a538dd7bf6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:01:04.588240 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f42decf1-c210-4914-a4cd-72a538dd7bf6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.065814 Aug 27 22:01:04.588817 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3610/7119] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:01:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:01:10.264528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-481357533", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "7e9d0361-ed45-4458-9ad3-ed2940bfcf6f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1331205866", "security_groups": [{"name": "tempest-secgroup-smoke-1586395659"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:10.276102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:10.406771 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] validate_networks() for [('7e9d0361-ed45-4458-9ad3-ed2940bfcf6f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:01:10.885746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:01:10.886200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:01:10.886712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:01:10.887205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:01:10.887653 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:01:10.897620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:10.898211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:10.898668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:10.899458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:10.899928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:10.900590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:10.918821 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:01:10.924642 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:01:10.937709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:01:10.940228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:01:10.990523 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3f90b540-f018-4ac9-96f9-94ca0318c345 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730090 Aug 27 22:01:10.991410 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3510/7120] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:01:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 22:01:11.000506 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:11.005002 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-4c854a05-114d-4f04-a8fc-4ddbf958ae9a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:11.005627 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-4c854a05-114d-4f04-a8fc-4ddbf958ae9a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:11.087468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-4c854a05-114d-4f04-a8fc-4ddbf958ae9a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:11.097747 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-4c854a05-114d-4f04-a8fc-4ddbf958ae9a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1266 microversion: 2.1 time: 0.099195 Aug 27 22:01:11.098395 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3611/7121] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:10 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:12.121331 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:12.122907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:12.131723 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:12.132110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:12.132549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:12.134153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:12.135169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:12.135801 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:12.248812 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:12.261589 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7731f569-2cf3-4a50-923e-14c760ddf840 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1318 microversion: 2.1 time: 0.145344 Aug 27 22:01:12.262428 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3511/7122] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:12 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:13.285490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:13.288167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:13.298911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:13.299542 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:13.300245 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:13.301100 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:13.301631 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:13.302136 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:13.474644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:13.483100 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f0bd11e2-48a3-4c4b-965b-f1a232c95d95 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.202641 Aug 27 22:01:13.484162 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3612/7123] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:13 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:13.686392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:13.701256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:13.701950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:13.702678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:13.714345 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] Creating event network-changed:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch1-master-1 Aug 27 22:01:13.721666 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-97737874-80c8-46bd-b3f7-0ecb91e0cacc req-2cdb3a28-8939-4827-8cb0-ac48dcf20de4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043648 Aug 27 22:01:13.722550 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3512/7124] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:01:14.505919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:14.506524 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:14.515823 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:14.516315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:14.516766 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:14.517479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:14.517939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:14.518370 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:14.671705 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:14.680382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-13273a5f-05e9-41b6-9953-a051de592e17 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.178847 Aug 27 22:01:14.680967 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3613/7125] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:14 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:15.705792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:15.706485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:15.717202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:15.717731 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:15.718192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:15.718910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:15.719406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:15.719850 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:15.862713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:15.870092 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-266034e1-b1fb-47c4-bb51-033e6ad39d02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.171407 Aug 27 22:01:15.870682 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3513/7126] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:15 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:16.893976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:16.894912 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:16.903898 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:16.904493 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:16.905625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:16.906103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:16.906636 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:16.907073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:17.087557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:17.102594 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6ad78c73-2820-4482-8010-a0f9cb6c065c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.214220 Aug 27 22:01:17.103707 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3614/7127] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:16 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:18.135594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:18.136218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:18.144670 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:18.145160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:18.145601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:18.146387 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:18.146827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:18.147240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:18.287208 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:18.295329 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-03accc17-a869-4263-a22d-edde3d60f20f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.165902 Aug 27 22:01:18.296049 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3514/7128] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:18 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:19.317840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:19.318469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:19.327213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:19.327756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:19.328205 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:19.328923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:19.329581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:19.330169 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:19.470796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:19.479310 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d0032207-4387-4e03-9762-24e1fae6a35b tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.165642 Aug 27 22:01:19.479940 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3615/7129] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:19 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:20.501305 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:20.501907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:20.509415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:20.509919 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:20.510372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:20.511194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:20.511700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:20.512138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:20.660251 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:20.669045 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-63baad1e-dce7-4a07-bdd5-efc8731dbf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.171797 Aug 27 22:01:20.670149 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3515/7130] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:20 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:20.724019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "name": "network-vif-plugged", "status": "completed", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:20.733683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:20.734160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:20.734599 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:20.745933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] Creating event network-vif-plugged:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch1-master-1 Aug 27 22:01:20.751996 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-c644293b-c495-41aa-8600-000910555f7f req-1851ee17-aa01-4af6-aa46-95a84371a0c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105748 Aug 27 22:01:20.752589 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3616/7131] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:01:21.693966 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:21.694719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:21.697278 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:21.698143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:21.706399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:21.706893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:21.707324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:21.708064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:21.708526 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:21.708963 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:21.849029 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:21.860626 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8f908bfc-f28a-4594-9ad9-9e3822edcbd2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1392 microversion: 2.1 time: 0.171473 Aug 27 22:01:21.861226 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3516/7132] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:21 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:22.881842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:22.889621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:22.890357 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:22.900849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:22.901481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:22.902102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:22.903159 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:22.903857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:22.904378 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:23.056415 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:23.066103 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-024dec42-3be3-4167-b8e5-5c5cd6100f46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1564 microversion: 2.1 time: 0.186302 Aug 27 22:01:23.066704 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3617/7133] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:22 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:23.089186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:23.090170 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:23.098210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:23.098648 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:23.099107 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:23.099885 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:23.100353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:23.100798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:23.246292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:23.254823 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-807f8052-ba51-4695-bcca-4f2eaf8a0bf5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1564 microversion: 2.1 time: 0.169685 Aug 27 22:01:23.256224 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3517/7134] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:23 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:25.228967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:01:25.230210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:25.230393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:25.241481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:25.242084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:25.242619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:25.242849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:25.243537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:25.243951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:25.245482 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:25.245926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:25.246635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:25.259245 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] Creating event network-changed:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch1-master-1 Aug 27 22:01:25.265759 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-88c5a016-699d-4f85-9d32-219ac72d661e req-8a3f3f33-7383-48ac-95c5-8e1031942ba1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039050 Aug 27 22:01:25.267822 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3518/7135] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:01:25.400267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:01:25.408575 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5222eff8-bb11-4ebb-81aa-51fa4f66e6b3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1564 microversion: 2.1 time: 0.183947 Aug 27 22:01:25.409180 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3618/7136] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:01:25 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:01:58.736610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:58.737340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:01:58.793794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:01:58.796272 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:01:58.803601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:58.804102 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:58.804557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:58.805270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:01:58.805733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:01:58.806144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:01:58.875713 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cf1bb943-90f4-47fa-8dc9-a0cb1c2de055 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action" status: 200 len: 24562 microversion: 2.1 time: 0.140559 Aug 27 22:01:58.876575 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3519/7137] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:01:58 2022] POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action => generated 24562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:02:29.436043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:02:29.437038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=38 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:02:29.442807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:02:29.445927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:29.455102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:29.455644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:29.456084 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:29.456786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:29.457243 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:29.457670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:29.487886 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:29.494021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Old instance type m1.heat2, new instance type m1.heat {{(pid=140434) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 22:02:29.501173 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:02:29.501604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:02:29.502082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:02:29.502500 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:02:29.502926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:02:29.580820 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d749f46b-ae57-4a0c-b837-631842d07393 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action" status: 202 len: 0 microversion: 2.1 time: 0.147548 Aug 27 22:02:29.581540 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3619/7138] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:02:29 2022] POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:02:29.591261 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:29.592019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:29.594650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:02:29.595584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:02:29.602520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:29.603211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:29.604013 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:29.604837 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:29.605356 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:29.605865 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:29.753907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:29.762725 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-dfe5904a-e132-45ea-9b1f-57ab12e5e346 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1692 microversion: 2.1 time: 0.176566 Aug 27 22:02:29.763315 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3520/7139] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:29 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:30.787334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:30.788045 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:30.796625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:30.797120 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:30.797566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:30.798267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:30.798727 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:30.799153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:30.950689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:30.959056 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-deef41e1-ee06-4cb4-a9af-c00373e7bf1c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1692 microversion: 2.1 time: 0.177738 Aug 27 22:02:30.959678 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3620/7140] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:30 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:31.981406 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:31.982015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:31.989377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:31.989867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:31.990390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:31.991094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:31.991609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:31.992048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:32.126898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:32.137570 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4a421fd-7e36-4c3f-8314-dd7593d7169e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.160028 Aug 27 22:02:32.138372 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3521/7141] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:31 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:33.160328 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:33.160953 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:33.168755 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:33.169234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:33.169744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:33.170465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:33.170931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:33.171389 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:33.324840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:33.333183 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71d27f94-7f3f-4a32-b75c-02ad6f85e25f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.176941 Aug 27 22:02:33.333761 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3621/7142] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:33 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:34.359859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:34.360583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:34.371759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:34.372237 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:34.372689 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:34.373405 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:34.373874 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:34.374312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:34.518920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:34.532164 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0379ba9b-8410-4dc0-b7e9-58e93d002541 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.178349 Aug 27 22:02:34.533110 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3522/7143] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:34 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:35.557793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:35.558487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:35.566077 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:35.566571 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:35.567024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:35.567771 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:35.568230 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:35.568659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:35.721161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:35.734490 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-654ef9f4-a5d4-46cb-881f-10f8e0f41b19 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.180483 Aug 27 22:02:35.735424 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3622/7144] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:35 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:36.761867 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:36.762548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:36.769956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:36.770440 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:36.770900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:36.771641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:36.772110 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:36.772556 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:36.914573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:36.924293 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6a621e72-6cc0-411c-91e6-2c7c201ebf4d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.167728 Aug 27 22:02:36.924847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3523/7145] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:36 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:37.950327 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:37.951418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:37.963081 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:37.963958 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:37.964681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:37.965929 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:37.967109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:37.967865 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:38.111911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:38.120027 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-126efbe6-680e-47a5-b2de-81e5a1696c7f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.176536 Aug 27 22:02:38.120640 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3623/7146] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:37 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:39.144373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:39.144981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:39.152580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:39.153081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:39.153543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:39.154292 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:39.154754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:39.155198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:39.308937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:39.317795 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-073dcbc7-7fa8-43cd-b8bb-f9a981cb4a0a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.178372 Aug 27 22:02:39.318397 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3524/7147] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:39 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:40.340276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:40.341557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:40.349774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:40.350273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:40.350721 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:40.351467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:40.351931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:40.352364 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:40.501648 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:40.511151 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-76035ffe-d331-4f04-a63b-635f86d24c8a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.174915 Aug 27 22:02:40.511791 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3624/7148] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:40 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:41.535124 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:41.535817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:41.543734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:41.544257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:41.544735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:41.545483 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:41.545972 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:41.546436 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:41.706136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:41.714472 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-778036d1-de84-4fb5-b2ff-e28b1c1588cb tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.184491 Aug 27 22:02:41.715066 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3525/7149] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:41 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:42.739366 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:42.739990 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:42.747466 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:42.747968 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:42.748399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:42.749104 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:42.749569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:42.749995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:42.891595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:42.900475 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-084f9268-4a5c-419c-b18f-2768b2d96915 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1697 microversion: 2.1 time: 0.166168 Aug 27 22:02:42.901402 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3625/7150] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:42 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:43.922415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:43.923042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:43.933614 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:43.934466 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:43.935172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:43.935925 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:43.936431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:43.936845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:44.154233 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:44.162893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-763d1833-f384-4435-8d72-699eeb5ccbc5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1696 microversion: 2.1 time: 0.244531 Aug 27 22:02:44.163545 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3526/7151] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:43 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1696 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:44.484978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "name": "network-vif-unplugged", "status": "completed", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:02:44.495879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:44.496367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:44.496824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:44.509055 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Creating event network-vif-unplugged:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch2-master-1 Aug 27 22:02:44.514573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] Instance c0beae8b-43b2-43af-85b0-0584f2e22843 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140434) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 22:02:44.525808 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-ac8533ee-7b5f-417d-8bb6-0f479dc72df2 req-9498b400-fbd3-4f20-a3b1-e1e4bbe861df service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044732 Aug 27 22:02:44.526431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3626/7152] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:02:45.185536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:45.186143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:45.194480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:45.194999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:45.195471 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:45.196192 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:45.196663 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:45.197098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:45.424914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:45.433920 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-55e67809-71a1-4080-be0d-e902d5c9b93d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1696 microversion: 2.1 time: 0.252445 Aug 27 22:02:45.447362 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3527/7153] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:45 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:46.465402 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:46.466997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:46.476086 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:46.476581 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:46.477027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:46.477734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:46.478193 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:46.478624 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:46.562728 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:02:46.574576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:46.574993 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:46.575455 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:46.588872 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Creating event network-changed:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch2-master-1 Aug 27 22:02:46.594856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] Instance c0beae8b-43b2-43af-85b0-0584f2e22843 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140433) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 22:02:46.606651 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-0b3d1b0e-07b5-4c8c-ba39-4d8d6e0f42ac req-3a39c6ff-2ba4-493a-ae2e-b51ed598996a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047717 Aug 27 22:02:46.607272 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3528/7154] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 22:02:46.627373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:46.636470 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-53412c93-4f67-4402-b2d0-43a1aae1a3b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1694 microversion: 2.1 time: 0.181502 Aug 27 22:02:46.637060 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3627/7155] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:46 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:47.668845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:47.669707 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:47.677858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:47.678359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:47.678811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:47.679562 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:47.680024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:47.680461 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:47.824289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:47.832723 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d911f004-dcff-45c9-90f3-09e5c17022d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1694 microversion: 2.1 time: 0.171005 Aug 27 22:02:47.833281 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3529/7156] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:47 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:48.855751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:48.856347 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:48.863945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:48.864437 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:48.864900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:48.865594 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:48.866051 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:48.866476 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.009280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:49.017528 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d2966373-39f8-43ef-858b-99323f9efc2c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1691 microversion: 2.1 time: 0.165973 Aug 27 22:02:49.018166 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3628/7157] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:48 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:49.040575 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:02:49.041159 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:49.049346 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.049848 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.050301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.051178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.051702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.052142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.126042 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-76673740-965c-40d2-b3b4-ac5dbf7fe148 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action" status: 204 len: 0 microversion: 2.1 time: 0.090666 Aug 27 22:02:49.126694 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3530/7158] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:02:49 2022] POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:02:49.135234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:49.135881 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:49.141996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.142469 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.143030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.143778 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.144236 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.144653 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.286321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:49.294869 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c5d247ff-8369-43b1-bfa5-609f7669a4c6 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1691 microversion: 2.1 time: 0.163534 Aug 27 22:02:49.295482 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3629/7159] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:49 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:49.318294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:49.319015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:49.325968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.326485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.326937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.327968 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:49.328797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:49.329563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:49.474420 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:49.482607 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cc027e61-5b47-4eac-90ae-48187b631899 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1691 microversion: 2.1 time: 0.170172 Aug 27 22:02:49.483135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3531/7160] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:49 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:50.504741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:02:50.505543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:02:50.512742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:50.513237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:50.513685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:50.514392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:50.514856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:50.515285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:50.658242 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:02:50.666564 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d25dd718-4f07-4f14-b118-b284e13ed764 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1683 microversion: 2.1 time: 0.165828 Aug 27 22:02:50.667155 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3630/7161] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:02:50 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:02:52.941289 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "name": "network-vif-plugged", "status": "completed", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:02:52.952770 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:02:52.953266 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:02:52.953712 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:02:52.965732 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] Creating event network-vif-plugged:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch2-master-1 Aug 27 22:02:52.971401 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-891c9424-10c1-4af8-bc5e-46f186c2571a req-4b8e5294-2687-4cf7-b281-ef11db8c004f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Aug 27 22:02:52.972111 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3532/7162] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:03:22.936741 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:03:22.939118 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:22.941619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=28 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:22.942300 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:22.948690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:22.949194 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:22.949645 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:22.950403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:22.950868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:22.951306 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:23.023949 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ad844d6-98d8-4a85-8f36-c2992e57b4a1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action" status: 200 len: 24569 microversion: 2.1 time: 0.091014 Aug 27 22:03:23.025014 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3631/7163] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:03:22 2022] POST /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:03:40.126202 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:40.126785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:40.127844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:03:40.130588 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=26 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:40.131332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:40.132982 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:03:40.133130 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 (ip 10.222.0.40) !!! Aug 27 22:03:40.134687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:40.135112 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=4 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:40.142880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:40.143210 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:40.143407 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:40.143620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:40.143924 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:40.144189 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:40.144984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:40.145505 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:40.146181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:40.158694 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] Creating event network-changed:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch2-master-1 Aug 27 22:03:40.163933 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-674a992f-e812-4a7b-a52d-0fd7edf7e09a req-a049554a-4df0-47dd-b7c5-2de32287d18b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Aug 27 22:03:40.164733 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3632/7164] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:03:40.178177 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:03:40.267635 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eca78b4d-ca83-4a9e-83b1-8ee4875e2176 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 204 len: 0 microversion: 2.1 time: 0.145342 Aug 27 22:03:40.270039 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3533/7165] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:03:40 2022] DELETE /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:03:40.279111 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:40.279960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:40.287121 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:40.287830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:40.288278 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:40.288992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:40.289444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:40.289875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:40.439156 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:40.448526 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b77a6a07-8509-43d8-b994-c3de816618b1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1689 microversion: 2.1 time: 0.173552 Aug 27 22:03:40.449153 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3633/7166] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:40 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:41.475267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:41.476017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:41.487212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:41.487986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:41.488421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:41.489154 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:41.489765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:41.490284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:41.668454 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:41.678665 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6c4bcd39-3fbf-489b-bc45-71f8d99b3ea1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1689 microversion: 2.1 time: 0.209545 Aug 27 22:03:41.679533 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3534/7167] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:41 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:42.353098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0beae8b-43b2-43af-85b0-0584f2e22843", "name": "network-vif-deleted", "tag": "bd8f9001-1a40-4869-8989-7857e1a21568"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:03:42.364177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:42.365073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:42.365510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:42.377120 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] Creating event network-vif-deleted:bd8f9001-1a40-4869-8989-7857e1a21568 for instance c0beae8b-43b2-43af-85b0-0584f2e22843 on nch2-master-1 Aug 27 22:03:42.382541 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-7c7e0269-758c-486b-9684-c1d1ecf10f08 req-9de5f758-1178-4068-acc3-2f5047a953ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 Aug 27 22:03:42.383170 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3634/7168] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:03:42.702383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:42.702999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:42.710991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:42.711551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:42.712007 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:42.712747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:42.713207 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:42.713632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:42.748381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:42.748900 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:42.749334 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:42.749794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lazy-loading 'fault' on Instance uuid c0beae8b-43b2-43af-85b0-0584f2e22843 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 22:03:42.797745 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:42.806031 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-77a6ecc4-9c23-40cb-bc9b-c940a9af96d2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 200 len: 1356 microversion: 2.1 time: 0.107777 Aug 27 22:03:42.806603 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3535/7169] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:42 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:43.835620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:43.836296 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: c0beae8b-43b2-43af-85b0-0584f2e22843] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:43.843685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:43.844181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:43.844628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:43.845334 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:43.845795 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:43.846226 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:43.860358 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] HTTP exception thrown: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Request method failure captured: Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 HTTP/1.1 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpMamkfsxmnYNCoceuv8zagP_ZZNdYZoovVgXUsg2rLlnbsws0AsbsbEUpJ0aYoCpndsnkWW7YB5lO9OkDLSPT5FsyMKh4wolBqBSGC07JNVt1mqLsTuUWCX8Ntfn20-odtY5URGEepAKIw13xyJLsjYrdlMSYScItsyW-YtS1m7otw Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e90292bcae4ce7995cce7a8b67780f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}] Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1a7cdfb52b654fb4a46664b3043f8e70 Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': 'c0beae8b-43b2-43af-85b0-0584f2e22843'} Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:03:43.862014 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Returning 404 to user: Instance c0beae8b-43b2-43af-85b0-0584f2e22843 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-aad27979-eeda-4832-8880-4c81e446f5ad tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843" status: 404 len: 111 microversion: 2.1 time: 0.037982 Aug 27 22:03:43.868058 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3635/7170] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:43 2022] GET /compute/v2.1/servers/c0beae8b-43b2-43af-85b0-0584f2e22843 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:03:47.253099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6b02a8b9-f7e9-42a7-8a7a-df7ce00dc714 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '.version_select at 0x7ff84decfb80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:47.284869 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6b02a8b9-f7e9-42a7-8a7a-df7ce00dc714 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1331205866" status: 202 len: 0 microversion: 2.1 time: 0.035546 Aug 27 22:03:47.285797 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3536/7171] 10.222.0.40 () {58 vars in 1284 bytes} [Sat Aug 27 22:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1331205866 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:03:47.321175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3d07a4a0-7796-48c1-99f0-cc3883e1d094 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: .version_select at 0x7ff84ec09310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1965129321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQRO0zrrrjry9VD6be1DwiGjyGz+lbGzlpSCG7xmfX7axyhForRA1ZRJ08XzUuj+Ey6ymf3BKwT1h9ONsx4VLy0H/uf+QYkbTb7FnFQ+yrXkrSgSBt6UengpWiIk3gi4g=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:03:47.339175 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3d07a4a0-7796-48c1-99f0-cc3883e1d094 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:03:47.345345 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-3d07a4a0-7796-48c1-99f0-cc3883e1d094 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:03:47.374693 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3d07a4a0-7796-48c1-99f0-cc3883e1d094 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058559 Aug 27 22:03:47.375308 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3636/7172] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:03:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:03:53.276584 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1240611956", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "073437fb-3c1f-4e96-8144-14ba1bb70e05"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1965129321", "security_groups": [{"name": "tempest-secgroup-smoke-960811272"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:03:53.287132 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:53.401565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] validate_networks() for [('073437fb-3c1f-4e96-8144-14ba1bb70e05', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:03:53.852019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:03:53.852465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:03:53.852958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:03:53.853383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:03:53.853805 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:03:53.864806 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:53.865914 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:53.866550 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:53.867599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:53.868328 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:53.868947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:53.891641 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:03:53.898716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:03:53.914033 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:03:53.917485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:03:53.987117 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eedc1aa5-fa52-4022-9fe6-acf6f67a1f86 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716147 Aug 27 22:03:53.992647 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3537/7173] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:03:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 22:03:53.999526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1495b867-b306-4abf-98ba-0a38b534c508 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:54.000157 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1495b867-b306-4abf-98ba-0a38b534c508 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:54.003543 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=12 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:03:54.076196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1495b867-b306-4abf-98ba-0a38b534c508 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:54.084556 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1495b867-b306-4abf-98ba-0a38b534c508 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1267 microversion: 2.1 time: 0.088989 Aug 27 22:03:54.084898 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3637/7174] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:53 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:55.106543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-17620eb7-71a0-4386-b9dd-c53f0aeee2b7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:55.107179 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-17620eb7-71a0-4386-b9dd-c53f0aeee2b7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:55.165633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-17620eb7-71a0-4386-b9dd-c53f0aeee2b7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:55.173405 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-17620eb7-71a0-4386-b9dd-c53f0aeee2b7 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1267 microversion: 2.1 time: 0.070837 Aug 27 22:03:55.174094 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3538/7175] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:55 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:56.195474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cacd47bb-520d-46c6-bbcb-60e41ca40d60 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:56.196478 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-cacd47bb-520d-46c6-bbcb-60e41ca40d60 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:56.275421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-cacd47bb-520d-46c6-bbcb-60e41ca40d60 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:56.283218 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cacd47bb-520d-46c6-bbcb-60e41ca40d60 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1267 microversion: 2.1 time: 0.092572 Aug 27 22:03:56.283853 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3638/7176] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:56 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:57.307075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ddaa358a-df6b-4e71-9d4e-c0922cc9c031 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:57.307979 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ddaa358a-df6b-4e71-9d4e-c0922cc9c031 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:57.370161 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-ddaa358a-df6b-4e71-9d4e-c0922cc9c031 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:57.377745 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ddaa358a-df6b-4e71-9d4e-c0922cc9c031 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1267 microversion: 2.1 time: 0.076147 Aug 27 22:03:57.378331 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3539/7177] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:57 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:58.402770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:58.403639 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:58.413601 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:58.414266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:58.414862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:58.415849 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:58.416467 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:58.417046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:58.491266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:58.499370 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-827909a5-ad1a-46e9-8a9f-1dada5d1ea48 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1271 microversion: 2.1 time: 0.101982 Aug 27 22:03:58.500005 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3639/7178] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:58 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:03:59.522902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:03:59.523544 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:03:59.532781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:59.533499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:59.533981 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:59.534740 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:03:59.535166 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:03:59.535632 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:03:59.600298 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:03:59.608500 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-86bb6cbf-d7ae-46d6-b260-fa4666f7b819 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1325 microversion: 2.1 time: 0.090624 Aug 27 22:03:59.609049 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3540/7179] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:03:59 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:00.621108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872353f1-3299-4e82-bd0f-4eb0698af342", "tag": "3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:04:00.631817 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:00.633456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:00.634608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:00.635250 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:00.636256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:00.641291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:00.642067 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:00.642709 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:00.643551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:00.644014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:00.644446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:00.650156 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] Creating event network-changed:3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c for instance 872353f1-3299-4e82-bd0f-4eb0698af342 on nch1-master-1 Aug 27 22:04:00.655773 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-363d1e63-58e9-4d6c-b2dc-24b4407d4d08 req-e7b9c772-a91c-4381-b053-bac115889e1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039394 Aug 27 22:04:00.656919 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3640/7180] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:04:00.784178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:00.792930 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6cb1a28d-ecad-4edf-a767-0546e8b47ba1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.166866 Aug 27 22:04:00.793531 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3541/7181] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:00 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:01.820399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:01.821418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:01.830878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:01.830992 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:01.831673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:01.832764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:01.833511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:01.834166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:01.991986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:02.005014 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39a6238e-0768-4c43-b7a7-61b36dea5ac4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.192518 Aug 27 22:04:02.005914 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3641/7182] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:01 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:03.028024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:03.028626 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:03.036316 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:03.036845 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:03.037297 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:03.038019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:03.038472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:03.039010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:03.185494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:03.193818 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7fd1cb31-51e0-491c-8333-8c5251daa54a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.169841 Aug 27 22:04:03.194568 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3542/7183] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:03 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:04.217687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:04.218362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:04.226146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:04.226641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:04.227088 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:04.227869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:04.228329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:04.228764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:04.372376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:04.381768 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9906775-fbe7-4089-bc4b-58c2132e48ab tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.168432 Aug 27 22:04:04.382342 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3642/7184] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:04 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:05.399982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:05.405172 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:05.405822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:05.412462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:05.412943 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:05.413400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:05.414101 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:05.415318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:05.415803 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:05.555168 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:05.563474 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-383e9faa-52ed-4daf-baf0-ce19185c9aa0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.164471 Aug 27 22:04:05.564037 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3543/7185] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:05 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:06.587373 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:06.587908 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:06.590734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:06.597008 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:06.597499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:06.597921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:06.598614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:06.599070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:06.599529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:06.748614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:06.761952 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-31726885-6a3b-43c4-b152-d69a3dc3a31d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.180328 Aug 27 22:04:06.762701 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3643/7186] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:06 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:07.487639 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872353f1-3299-4e82-bd0f-4eb0698af342", "name": "network-vif-plugged", "status": "completed", "tag": "3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:04:07.502201 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=10 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:07.508719 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:07.509210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:07.509714 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:07.522095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] Creating event network-vif-plugged:3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c for instance 872353f1-3299-4e82-bd0f-4eb0698af342 on nch1-master-1 Aug 27 22:04:07.527985 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-fa986c73-0f24-438c-a4d8-f40f1d6fb304 req-682c7a53-a507-4ba7-a21d-49d65caeea0c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045609 Aug 27 22:04:07.528595 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3544/7187] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:04:07.791098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:07.791714 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:07.799142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:07.799660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:07.800101 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:07.800801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:07.801255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:07.801683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:07.946119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:07.954509 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52001430-db39-4d0d-b003-5713e01873ce tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.169790 Aug 27 22:04:07.955307 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3644/7188] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:07 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:08.980832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:08.981978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:08.994368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:08.994932 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:08.995646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:08.996360 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:08.996829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:08.997268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:09.136587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:09.144910 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0e82a67-a829-4fe4-8bdb-8f177c364bc0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1392 microversion: 2.1 time: 0.171526 Aug 27 22:04:09.145498 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3545/7189] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:08 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:10.169733 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:10.170468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:10.173888 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:10.180635 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:10.181264 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:10.181816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:10.182687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:10.183274 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:10.183837 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:10.335742 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:10.344813 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9f153246-1fd7-410c-823c-2475288b6835 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1565 microversion: 2.1 time: 0.180822 Aug 27 22:04:10.345399 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3645/7190] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:10 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:10.365589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:10.366226 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:10.369494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:10.375522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:10.376022 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:10.376479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:10.377190 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:10.377654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:10.378118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:10.518910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:10.527053 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fe9d3b3f-5eb4-430a-84a3-65814d430b8c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1565 microversion: 2.1 time: 0.165461 Aug 27 22:04:10.527658 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3546/7191] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:10 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:12.573269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:04:12.573915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:12.580294 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872353f1-3299-4e82-bd0f-4eb0698af342", "tag": "3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:04:12.593772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:12.594026 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:12.594256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:12.594381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:12.594685 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:12.594807 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:12.595538 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:12.596229 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:12.596668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:12.606711 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] Creating event network-changed:3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c for instance 872353f1-3299-4e82-bd0f-4eb0698af342 on nch1-master-1 Aug 27 22:04:12.612248 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-97cd1f5f-02b1-4c83-adf9-0331f4b4bdc3 req-e27e3e3b-1f07-47ca-8221-dd3e262232ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035460 Aug 27 22:04:12.612933 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3547/7192] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:04:12.752871 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:04:12.761160 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a540ac92-2e9f-4ac7-b633-b7739a3668a5 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1684 microversion: 2.1 time: 0.191989 Aug 27 22:04:12.761751 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3646/7193] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:04:12 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1684 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:04:46.095470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:46.096338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:04:46.102257 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:04:46.104609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:04:46.111828 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:46.112325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:46.112776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:46.113482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:04:46.113948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:04:46.114388 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:04:46.185801 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d583f45f-57d5-46df-9dd9-6e07d8e3cf26 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action" status: 200 len: 24564 microversion: 2.1 time: 0.093929 Aug 27 22:04:46.186810 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3548/7194] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:04:46 2022] POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action => generated 24564 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:05:16.607710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:05:16.608512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=44 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:05:16.610196 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 22:05:16.615821 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:05:16.623038 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:16.623569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:16.624018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:16.647135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Going to try to stop instance {{(pid=140434) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 22:05:16.693193 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0f303ec9-19e5-4772-8644-e1ad4cab85e3 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action" status: 202 len: 0 microversion: 2.1 time: 0.087267 Aug 27 22:05:16.693824 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3647/7195] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:05:16 2022] POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:05:16.703327 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:16.704081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:16.706715 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:05:16.707486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:05:16.713929 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:16.714565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:16.715046 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:16.715842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:16.716274 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:16.716718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:16.946300 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:16.957518 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0978fd90-199f-4382-97be-2dc355613ad4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.258915 Aug 27 22:05:16.958100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3549/7196] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:16 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:17.985460 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:17.986354 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:17.994902 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:17.995641 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:17.996401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:17.998783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:17.998783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:17.998783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:18.190856 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:18.200594 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68bddb8d-759d-4d32-89ef-90c81bc82d6e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.223103 Aug 27 22:05:18.201186 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3648/7197] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:17 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:19.226155 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:19.228684 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:19.236755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:19.237258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:19.237713 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:19.238720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:19.239464 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:19.240194 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:19.401945 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:19.414192 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1612686b-0b5c-427f-aedb-7327399f9942 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.193733 Aug 27 22:05:19.414881 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3550/7198] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:19 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:20.444161 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:20.444773 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:20.453223 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:20.453723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:20.454167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:20.454866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:20.455330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:20.455794 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:20.606962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:20.615497 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-73b8a72a-cdaa-4b90-bf8d-03f57cca6a15 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.177646 Aug 27 22:05:20.616082 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3649/7199] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:20 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:21.641930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:21.642791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:21.656129 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:21.656619 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:21.657079 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:21.657785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:21.658258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:21.658682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:21.794866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:21.802654 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c58b1218-67d1-4584-93d6-41fe92a8e08f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.168000 Aug 27 22:05:21.803235 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3551/7200] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:21 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:22.827451 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:22.828042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:22.835468 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:22.835972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:22.836421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:22.837134 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:22.837597 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:22.838037 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:22.979426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:22.987986 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-810f1bfc-6acd-4626-823f-159999fa7918 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.166090 Aug 27 22:05:22.988543 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3650/7201] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:22 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:24.009881 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:24.010501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:24.018240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:24.018747 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:24.019200 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:24.019956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:24.020422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:24.020861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:24.158264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:24.166873 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e770752a-5639-431b-97a0-3bb7bf278bdc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.161090 Aug 27 22:05:24.167456 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3552/7202] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:24 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:25.188181 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:25.188786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:25.196247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:25.196738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:25.197178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:25.197867 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:25.198321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:25.198749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:25.340600 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:25.349593 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-235619a2-104f-44b8-b58f-b2d01d7d3ef8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.165464 Aug 27 22:05:25.350187 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3651/7203] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:25 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:26.372873 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:26.373590 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:26.381174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:26.381668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:26.382109 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:26.382814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:26.383270 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:26.383735 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:26.530210 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:26.538430 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8ff1dd3c-666b-42ee-a5d7-e006fded0672 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1694 microversion: 2.1 time: 0.170073 Aug 27 22:05:26.539014 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3553/7204] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:26 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:27.563779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:27.564472 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:27.573119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:27.573609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:27.574110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:27.574893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:27.575448 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:27.575931 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:27.722404 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:27.733540 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-39755043-feb2-4a9a-b00b-42ed8d70e738 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1671 microversion: 2.1 time: 0.174299 Aug 27 22:05:27.734291 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3652/7205] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:27 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:28.849559 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:05:28.852183 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:28.860131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:28.860633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:28.861083 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:28.861797 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:28.862260 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:28.862696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:28.934187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-49b19d9e-d9ea-4d3a-8bdf-89079709abed tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action" status: 200 len: 35864 microversion: 2.1 time: 0.090336 Aug 27 22:05:28.934850 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3554/7206] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:05:28 2022] POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action => generated 35864 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:05:28.947793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:05:28.954681 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:28.955168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:28.955632 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:28.979416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Going to try to start instance {{(pid=140434) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 22:05:29.027076 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7099f7f7-d688-43dd-a87e-c38e66b8f0c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action" status: 202 len: 0 microversion: 2.1 time: 0.083442 Aug 27 22:05:29.027727 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3653/7207] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:05:28 2022] POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:05:29.037686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:29.038465 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:29.046557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:29.047449 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:29.047820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:29.048643 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:29.049122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:29.049596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:29.200759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:29.209377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d6be70c0-5fdd-4bf6-99ec-1c834b35a4e9 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1680 microversion: 2.1 time: 0.175960 Aug 27 22:05:29.209999 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3555/7208] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:29 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:05:30.233425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:05:30.234176 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:05:30.241887 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:30.242381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:30.242817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:30.243557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:05:30.244017 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:05:30.244440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:05:30.383970 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:05:30.392592 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-541f24ce-6369-4c87-a02f-6e238456e4ea tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1684 microversion: 2.1 time: 0.164454 Aug 27 22:05:30.393172 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3654/7209] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:05:30 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:02.676458 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:02.678696 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:02.681593 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=14 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:02.682264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=40 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:02.688396 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:02.688889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:02.689372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:02.690078 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:02.690539 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:02.690970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:02.764809 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-10815a18-4ba3-460d-adce-0cf64e8ad8c1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action" status: 200 len: 60428 microversion: 2.1 time: 0.092282 Aug 27 22:06:02.765454 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3556/7210] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:06:02 2022] POST /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342/action => generated 60428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:06:26.686386 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:26.686946 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:26.689768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=16 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:26.690392 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:26.690813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:26.690917 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:26.696758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:26.697318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:26.697869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:26.698689 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:26.699826 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:26.700269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:26.730070 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:06:26.749131 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872353f1-3299-4e82-bd0f-4eb0698af342", "tag": "3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:26.762668 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:26.763374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:26.763861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:26.775609 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] Creating event network-changed:3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c for instance 872353f1-3299-4e82-bd0f-4eb0698af342 on nch1-master-1 Aug 27 22:06:26.781070 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1ee992eb-bb36-4ada-ae7a-0ec2f09c8874 req-4a316092-90cf-4adb-8399-c38e8d70345c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097106 Aug 27 22:06:26.781942 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3557/7211] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:26.820441 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7d7e46c8-25ab-4336-b636-08f76af978b2 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 204 len: 0 microversion: 2.1 time: 0.134501 Aug 27 22:06:26.821313 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3655/7212] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:06:26 2022] DELETE /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:06:26.834180 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:26.835752 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:26.843976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:26.845218 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:26.845933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:26.846782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:26.847384 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:26.847859 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:26.986245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:26.994081 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d3389151-f31a-4bf0-a84c-9bf1bed3fc52 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1690 microversion: 2.1 time: 0.165048 Aug 27 22:06:26.994673 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3558/7213] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:26 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:28.020150 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:28.020899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:28.028556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:28.029056 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:28.029504 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:28.030391 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:28.030855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:28.031289 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:28.176774 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:28.185009 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2c5c9663-be60-4c86-915a-10ed2e35dc67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1690 microversion: 2.1 time: 0.171029 Aug 27 22:06:28.185605 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3656/7214] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:28 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:29.215667 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872353f1-3299-4e82-bd0f-4eb0698af342", "name": "network-vif-deleted", "tag": "3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:29.216323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:29.216730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:29.224609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:29.225108 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:29.225545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:29.226255 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:29.226710 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:29.227142 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:29.229536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:29.230098 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:29.230592 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:29.244044 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] Creating event network-vif-deleted:3d840590-3dd4-4a84-8dd8-c4b1d3a38f0c for instance 872353f1-3299-4e82-bd0f-4eb0698af342 on nch1-master-1 Aug 27 22:06:29.250794 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-65e2ab18-c18b-4d0d-a60a-b978cefafa6d req-328d8bc6-dc7b-477d-938f-234bf93ba61d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Aug 27 22:06:29.251718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3657/7215] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:29.297551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:29.306049 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f93997da-b11c-40d4-a064-8a5f9570668a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 200 len: 1504 microversion: 2.1 time: 0.102369 Aug 27 22:06:29.306630 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3559/7216] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:29 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 1504 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:30.333697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:30.335010 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 872353f1-3299-4e82-bd0f-4eb0698af342] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:30.342072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:30.342568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:30.343022 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:30.343762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:30.344556 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:30.345005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:30.358780 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] HTTP exception thrown: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Request method failure captured: Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 HTTP/1.1 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpMamkfsxmnYNCoceuv8zagP_ZZNdYZoovVgXUsg2rLlnbsws0AsbsbEUpJ0aYoCpndsnkWW7YB5lO9OkDLSPT5FsyMKh4wolBqBSGC07JNVt1mqLsTuUWCX8Ntfn20-odtY5URGEepAKIw13xyJLsjYrdlMSYScItsyW-YtS1m7otw Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e90292bcae4ce7995cce7a8b67780f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}] Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1a7cdfb52b654fb4a46664b3043f8e70 Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '872353f1-3299-4e82-bd0f-4eb0698af342'} Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:06:30.360441 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Returning 404 to user: Instance 872353f1-3299-4e82-bd0f-4eb0698af342 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:06:30.365883 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-359597a1-3c67-4c51-b16e-36fb48942602 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342" status: 404 len: 111 microversion: 2.1 time: 0.035068 Aug 27 22:06:30.366877 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3658/7217] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:30 2022] GET /compute/v2.1/servers/872353f1-3299-4e82-bd0f-4eb0698af342 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:06:33.800558 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-824a3893-57a3-4d0c-a5d9-719bd08e2e69 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '.version_select at 0x7ff84e78eb80>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:33.805338 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-824a3893-57a3-4d0c-a5d9-719bd08e2e69 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:06:34.816128 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-824a3893-57a3-4d0c-a5d9-719bd08e2e69 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [1bad8cca-39ca-4857-8520-cdd6a9441e07] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37904. Aug 27 22:06:34.843233 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-824a3893-57a3-4d0c-a5d9-719bd08e2e69 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1965129321" status: 202 len: 0 microversion: 2.1 time: 1.047026 Aug 27 22:06:34.844671 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3560/7218] 10.222.0.40 () {58 vars in 1284 bytes} [Sat Aug 27 22:06:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1965129321 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:06:34.875658 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: .version_select at 0x7ff857d9e700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1672335576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd9e4o/wVcrGcpMkVNpSshQ62AWMIKpsrrWSudjCQ6zkAFOB3gzDgtfowOu5pcqb0jcstJOD3chZbPK1qqJrF+osPPrT2NXpv7vCNwyxNQENATzmHFjcLKZdxuLk1XTeQ=="}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:34.898234 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:06:34.904780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'key_pairs'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:06:34.920196 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:06:35.932440 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37908. Aug 27 22:06:35.952869 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-cf798946-6570-4201-8067-1d3c47bf93be tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.081235 Aug 27 22:06:35.953483 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3659/7219] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:06:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:41.555153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=14 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:41.560373 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1438015991", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "networks": [{"uuid": "c8e0d5fe-c4d2-4b5f-a3e3-bff7d7cb503f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1672335576", "security_groups": [{"name": "tempest-secgroup-smoke-736361107"}]}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:41.708834 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.network.neutron [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] validate_networks() for [('c8e0d5fe-c4d2-4b5f-a3e3-bff7d7cb503f', None, None, None, None, None)] {{(pid=140433) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:06:42.192856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:06:42.193381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image limits 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:06:42.193934 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Flavor pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:06:42.194452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Image pref 0:0:0 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:06:42.194906 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.virt.hardware [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140433) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:06:42.204469 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:42.204904 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:42.205351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:42.206095 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:42.206636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:42.207077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:42.228395 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:06:42.234086 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Getting quotas for user 1a7cdfb52b654fb4a46664b3043f8e70 and project a7e90292bcae4ce7995cce7a8b67780f. Resources: {'ram', 'instances', 'cores'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:06:42.247146 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Going to run 1 instances... {{(pid=140433) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:06:42.249582 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140433) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:06:42.296063 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [16c2f7b3-355e-42e1-a8ab-cabd26e9c7aa] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:06:43.305856 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [16c2f7b3-355e-42e1-a8ab-cabd26e9c7aa] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37956. Aug 27 22:06:43.312302 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-ba3e46d8-33e3-4e41-a626-f2b1b2a620c8 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.758422 Aug 27 22:06:43.314885 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3561/7220] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:06:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 22:06:43.324336 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:43.329240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1908479e-6b36-4969-8056-0c624dac0c00 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:43.329904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1908479e-6b36-4969-8056-0c624dac0c00 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:43.393021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1908479e-6b36-4969-8056-0c624dac0c00 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:43.401668 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1908479e-6b36-4969-8056-0c624dac0c00 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1267 microversion: 2.1 time: 0.080084 Aug 27 22:06:43.402412 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3660/7221] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:43 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:44.423486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:44.424782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:44.435755 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:44.437038 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:44.437692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:44.438761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:44.439546 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:44.440040 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:44.520704 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:44.530895 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-170761e8-10c4-48b7-94f2-059e08200cfc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1327 microversion: 2.1 time: 0.112229 Aug 27 22:06:44.543384 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3562/7222] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:44 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:45.553744 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:45.554383 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:45.563329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:45.568171 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:45.568614 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:45.569376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:45.569872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:45.570269 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:45.757244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:45.768830 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-06ec3037-cef4-475e-a73a-8e15feb9e3c0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.219270 Aug 27 22:06:45.785960 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3661/7223] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:45 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:46.360793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35345e1c-cd70-42cc-812c-fae9df7db36b", "tag": "f4a71015-2798-4935-8322-76652ca77fac"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:46.377700 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:46.378522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:46.379234 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:46.394556 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] Creating event network-changed:f4a71015-2798-4935-8322-76652ca77fac for instance 35345e1c-cd70-42cc-812c-fae9df7db36b on nch1-master-1 Aug 27 22:06:46.400662 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-a8248499-5fc1-477e-8b8a-efd0f4b1c087 req-dcaaadca-315e-4f0d-b931-3ac944d69bb6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046597 Aug 27 22:06:46.401484 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3563/7224] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:46.793492 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:46.794215 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:46.801840 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:46.802342 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:46.802780 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:46.803673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:46.804131 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:46.804583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:46.950465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:46.961201 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e9fad448-017c-443d-ab2d-9ecb860b342a tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.171633 Aug 27 22:06:46.961818 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3662/7225] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:46 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:47.985118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:47.985827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:47.993090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:47.993587 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:47.994037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:47.994763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:47.995228 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:47.995702 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:48.143974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:48.152566 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-546c3add-2b3e-416e-92d0-6d5abac7c44f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.172817 Aug 27 22:06:48.153162 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3564/7226] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:47 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:49.174529 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:49.175067 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:49.183271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:49.183950 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:49.184403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:49.185126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:49.185595 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:49.186055 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:49.334643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:49.342849 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-1822315c-420f-480c-ae02-6c473592ec8e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.172395 Aug 27 22:06:49.343431 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3663/7227] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:49 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:50.365764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:50.366422 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:50.373842 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:50.374324 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:50.374785 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:50.375529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:50.375988 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:50.376427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:50.519247 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:50.530461 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-92cd1ed1-821c-4e3f-bb35-e339d01b8c96 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.168952 Aug 27 22:06:50.531417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3565/7228] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:50 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:51.552900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:51.553455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:51.561441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:51.561927 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:51.562369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:51.563066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:51.563545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:51.563995 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:51.700123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:51.708351 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6664e5c0-79e4-47d1-8f14-ff4f5f8a3d64 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.159846 Aug 27 22:06:51.708972 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3664/7229] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:51 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:52.481349 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:52.482145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:52.625986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35345e1c-cd70-42cc-812c-fae9df7db36b", "name": "network-vif-plugged", "status": "completed", "tag": "f4a71015-2798-4935-8322-76652ca77fac"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:52.638438 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:52.638912 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:52.639482 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:52.652192 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] Creating event network-vif-plugged:f4a71015-2798-4935-8322-76652ca77fac for instance 35345e1c-cd70-42cc-812c-fae9df7db36b on nch1-master-1 Aug 27 22:06:52.657370 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-72750f8f-c7fd-468d-aa56-5376b339044c req-57b29b38-9f8f-4647-8e41-0188ad572a80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181533 Aug 27 22:06:52.658032 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3566/7230] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:52.737665 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:52.738369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:52.745539 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:52.746043 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:52.746486 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:52.747197 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:52.747699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:52.748729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:52.887532 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:52.895948 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1d6bb01-f611-4e8c-b979-a244f8e82c0d tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.162299 Aug 27 22:06:52.896501 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3665/7231] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:52 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:53.923094 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:53.924242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:53.932376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:53.932869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:53.933306 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:53.934009 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:53.934467 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:53.934901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:54.080196 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:54.088748 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-66b7c8bd-1034-4d6b-aa32-5ca4c8638b22 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1392 microversion: 2.1 time: 0.173177 Aug 27 22:06:54.089325 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3567/7232] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:53 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:55.114190 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:55.115195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:55.118586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:55.129309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:55.130113 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:55.130839 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:55.132224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:55.132707 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:55.133130 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:55.283271 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:55.296085 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7ae4abc8-4be9-4a04-81a6-a896473738d0 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1565 microversion: 2.1 time: 0.188527 Aug 27 22:06:55.296653 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3666/7233] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:55 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:55.317206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:55.317830 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:55.325302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:55.325798 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:55.326242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:55.326983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:55.327600 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:55.328419 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:55.477693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:55.485914 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-939b5951-81aa-4148-935d-a9efef31a288 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1565 microversion: 2.1 time: 0.172878 Aug 27 22:06:55.486490 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3568/7234] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:55 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:06:57.597795 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35345e1c-cd70-42cc-812c-fae9df7db36b", "tag": "f4a71015-2798-4935-8322-76652ca77fac"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:06:57.603399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:57.610818 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:57.611403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:57.611901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:57.624788 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] Creating event network-changed:f4a71015-2798-4935-8322-76652ca77fac for instance 35345e1c-cd70-42cc-812c-fae9df7db36b on nch1-master-1 Aug 27 22:06:57.630308 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-f56ec0c1-bfdb-4b71-b1e5-bfad6bf7eb13 req-8724d11d-c8f8-4644-951f-17ee0037a7bb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094135 Aug 27 22:06:57.631096 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3569/7235] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:06:57.693754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:06:57.694779 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:06:57.696874 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:06:57.702265 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:57.702983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:57.703690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:57.704403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:06:57.704869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:06:57.705280 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:06:57.853554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:06:57.862161 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5af742c4-b474-4c22-ac9f-360479fcb333 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1565 microversion: 2.1 time: 0.328515 Aug 27 22:06:57.862993 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3667/7236] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:06:57 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1565 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:07:29.194468 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=38 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:07:29.195692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:07:29.200937 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:07:29.203284 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:07:29.211370 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:07:29.211866 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:07:29.212301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:07:29.213066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:07:29.213514 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:07:29.213936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:07:29.285189 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-603c2961-b51f-4d90-8952-7373907bc4bc tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action" status: 200 len: 24562 microversion: 2.1 time: 0.095124 Aug 27 22:07:29.285852 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3570/7237] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:07:29 2022] POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action => generated 24562 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:08:08.324913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:08.325729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=42 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:08.331127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:08.331850 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:08.342188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:08.342923 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:08.343673 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:08.344738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:08.345814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:08.346598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:08.371374 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lazy-loading 'flavor' on Instance uuid 35345e1c-cd70-42cc-812c-fae9df7db36b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 22:08:08.444315 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-e66b0256-af49-47df-aa3d-96f2e195e36e tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action" status: 202 len: 0 microversion: 2.1 time: 0.122384 Aug 27 22:08:08.444994 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3668/7238] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:08:08 2022] POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:08:08.454211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:08.455014 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:08.458049 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:08.458729 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:08.465822 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:08.466425 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:08.466930 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:08.467686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:08.468138 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:08.468576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:08.617444 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:08.625813 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6316307a-0f9f-4bb8-bdbb-a8fb2850d1d1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1692 microversion: 2.1 time: 0.176095 Aug 27 22:08:08.626390 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3571/7239] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:08 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:09.649660 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:09.650368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:09.658263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:09.658757 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:09.659255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:09.659986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:09.660445 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:09.660877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:09.806514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:09.817483 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe7fa160-9c67-4c4b-9e55-bb909202332c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1692 microversion: 2.1 time: 0.172254 Aug 27 22:08:09.818068 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3669/7240] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:09 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:10.842694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:10.843742 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:10.853209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:10.853694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:10.854143 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:10.854861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:10.855319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:10.855782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:10.998763 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:11.009145 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b973bd9c-b872-4e0a-b94d-50806a313c01 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1675 microversion: 2.1 time: 0.173047 Aug 27 22:08:11.009727 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3572/7241] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:10 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:12.118628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:12.121046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:12.128736 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.129266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.129679 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.130531 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.130844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.131277 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.198213 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c1022ebd-2d70-4d4e-93cb-608c886be261 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action" status: 200 len: 38333 microversion: 2.1 time: 0.083120 Aug 27 22:08:12.199248 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3670/7242] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:08:12 2022] POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action => generated 38333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 22:08:12.214901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:12.215507 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:12.223493 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.223997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.224448 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.225151 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.225675 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.226113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.303707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b088e299-76a1-4c46-8961-d4216887dd02 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action" status: 202 len: 0 microversion: 2.1 time: 0.092565 Aug 27 22:08:12.304473 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3573/7243] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:08:12 2022] POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:08:12.313734 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:12.314453 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:12.322520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.323053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.323640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.324381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:12.324830 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:12.325263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:12.466093 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:12.475073 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b711239b-b91f-4511-be36-c68ea4cca425 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1681 microversion: 2.1 time: 0.165660 Aug 27 22:08:12.475683 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3671/7244] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:12 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:13.503528 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:13.504516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:13.515127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:13.515996 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:13.516741 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:13.517878 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:13.518649 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:13.519401 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:13.663683 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:13.671707 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fc92f513-f001-4763-9d94-aa1ab9013c27 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1681 microversion: 2.1 time: 0.176960 Aug 27 22:08:13.672261 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3574/7245] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:13 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:14.695208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:14.695893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:14.704394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:14.704892 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:14.705340 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:14.706029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:14.706489 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:14.706944 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:14.862276 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:14.873994 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b33f65c2-95a7-4acb-9be8-fbb004e2d3ac tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1684 microversion: 2.1 time: 0.183346 Aug 27 22:08:14.874623 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3672/7246] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:14 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:14.977005 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:14.979318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:14.986402 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:14.986894 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:14.987424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:14.988068 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:14.988551 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:14.989323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:15.056537 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-b747d0c9-9bbc-4705-8667-2cf8b47bd1c4 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action" status: 200 len: 38333 microversion: 2.1 time: 0.083749 Aug 27 22:08:15.057112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3575/7247] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:08:14 2022] POST /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b/action => generated 38333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 22:08:16.091907 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:16.092474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:16.094477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35345e1c-cd70-42cc-812c-fae9df7db36b", "tag": "f4a71015-2798-4935-8322-76652ca77fac"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:16.100951 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:16.101572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:16.102138 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:16.103085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:16.104123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:16.104545 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:16.105622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:16.106104 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:16.106547 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:16.118024 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] Creating event network-changed:f4a71015-2798-4935-8322-76652ca77fac for instance 35345e1c-cd70-42cc-812c-fae9df7db36b on nch1-master-1 Aug 27 22:08:16.123838 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-b5af7143-ef90-472d-881b-43e0f83c9dea req-f9649fec-2e81-4f78-8d61-bfa4f99d054e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032744 Aug 27 22:08:16.127426 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3576/7248] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:08:16.135102 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:08:16.232821 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-07cca5db-9edb-4ebf-a42b-396e61920d67 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 204 len: 0 microversion: 2.1 time: 0.144455 Aug 27 22:08:16.233775 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3673/7249] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:08:16 2022] DELETE /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:08:16.245337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:16.246211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:16.254044 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:16.254706 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:16.255485 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:16.256348 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:16.256936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:16.257445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:16.439076 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:16.452032 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a53e0ec1-a720-4090-a298-2360b1d99fd1 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1690 microversion: 2.1 time: 0.213285 Aug 27 22:08:16.452848 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3577/7250] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:16 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:17.481285 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:17.482272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:17.491777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:17.492275 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:17.492710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:17.493414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:17.493868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:17.494293 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:17.633509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:17.644345 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-db440955-2280-4660-839b-a800556bcd46 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1690 microversion: 2.1 time: 0.169796 Aug 27 22:08:17.644937 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3674/7251] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:17 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:18.530736 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35345e1c-cd70-42cc-812c-fae9df7db36b", "name": "network-vif-deleted", "tag": "f4a71015-2798-4935-8322-76652ca77fac"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:18.544275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:18.544809 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:18.545393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:18.557642 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] Creating event network-vif-deleted:f4a71015-2798-4935-8322-76652ca77fac for instance 35345e1c-cd70-42cc-812c-fae9df7db36b on nch1-master-1 Aug 27 22:08:18.563922 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9e73896b-153c-4bcb-b13e-0e4ad6773d92 req-58bc1038-21c7-4cc7-ac36-ea4628d44ee9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036994 Aug 27 22:08:18.564532 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3578/7252] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:08:18.666188 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:18.666972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:18.674621 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:18.675119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:18.675607 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:18.676349 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:18.676770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:18.677204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:18.710712 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:18.711413 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:18.711868 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:18.712365 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lazy-loading 'fault' on Instance uuid 35345e1c-cd70-42cc-812c-fae9df7db36b {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 22:08:18.757748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7cdfb52b654fb4a46664b3043f8e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e90292bcae4ce7995cce7a8b67780f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:18.765949 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-38fc410a-b9ee-4701-ab0b-97095a497c9f tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 200 len: 1357 microversion: 2.1 time: 0.104440 Aug 27 22:08:18.766525 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3675/7253] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:18 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:19.791374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:19.792113 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] [instance: 35345e1c-cd70-42cc-812c-fae9df7db36b] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:19.798985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:19.799520 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:19.799978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:19.800694 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:19.801125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:19.801597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:19.815925 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] HTTP exception thrown: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Request method failure captured: Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b HTTP/1.1 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpMamkfsxmnYNCoceuv8zagP_ZZNdYZoovVgXUsg2rLlnbsws0AsbsbEUpJ0aYoCpndsnkWW7YB5lO9OkDLSPT5FsyMKh4wolBqBSGC07JNVt1mqLsTuUWCX8Ntfn20-odtY5URGEepAKIw13xyJLsjYrdlMSYScItsyW-YtS1m7otw Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a7e90292bcae4ce7995cce7a8b67780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a7e90292bcae4ce7995cce7a8b67780f", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a7e90292bcae4ce7995cce7a8b67780f"}]}] Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: a7e90292bcae4ce7995cce7a8b67780f Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-764148955 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1a7cdfb52b654fb4a46664b3043f8e70 Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestNetworkAdvancedServerOps-764148955-project Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '35345e1c-cd70-42cc-812c-fae9df7db36b'} Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:08:19.817592 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Returning 404 to user: Instance 35345e1c-cd70-42cc-812c-fae9df7db36b could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7c151432-e3bc-4a97-839c-0b6a67120a0c tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b" status: 404 len: 111 microversion: 2.1 time: 0.034774 Aug 27 22:08:19.823175 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3579/7254] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:19 2022] GET /compute/v2.1/servers/35345e1c-cd70-42cc-812c-fae9df7db36b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:08:23.648207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-25e0fd96-9b14-42c4-8fab-342b06753c68 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] Calling method '.version_select at 0x7ff84dce7670>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:23.676152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-25e0fd96-9b14-42c4-8fab-342b06753c68 tempest-TestNetworkAdvancedServerOps-764148955 tempest-TestNetworkAdvancedServerOps-764148955-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1672335576" status: 202 len: 0 microversion: 2.1 time: 0.033704 Aug 27 22:08:23.676840 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3676/7255] 10.222.0.40 () {58 vars in 1284 bytes} [Sat Aug 27 22:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1672335576 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:08:34.738445 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=18 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:34.739214 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:34.921882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6ff91eaf-78e1-44ac-8f5f-c7d1f3574309 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Action: 'create', calling method: .version_select at 0x7ff857d194c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-842032540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRn0DiYbOFxI+6vnaLv+J+ASeD/6YXEDIxhMG5qPrR2JSYogN0QRrrl4rlQ0Y681usnB9fuclc0MvIvwGtU9QAUP2qIB81ZCuX3xpgANmiHmgUGzhdxlWlJ3jCuEOgSfg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:34.941353 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6ff91eaf-78e1-44ac-8f5f-c7d1f3574309 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for project 4a0e462d905a4e939b540783e6848291. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:08:34.947669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-6ff91eaf-78e1-44ac-8f5f-c7d1f3574309 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for user 2c1e0e53e74d444a975ec2236d7b7d4a and project 4a0e462d905a4e939b540783e6848291. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:08:34.977820 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6ff91eaf-78e1-44ac-8f5f-c7d1f3574309 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.245250 Aug 27 22:08:34.979229 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3580/7256] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:08:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 22:08:36.123224 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:36.124016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:36.128408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-329178381", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-842032540", "security_groups": [{"name": "tempest-secgroup-smoke-631404695"}], "networks": [{"uuid": "d760874b-3e3f-4cb5-9ba3-339ae7956e85"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:36.250018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] validate_networks() for [('d760874b-3e3f-4cb5-9ba3-339ae7956e85', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:08:36.784272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:08:36.784954 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:08:36.785620 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:08:36.786036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:08:36.786459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:08:36.796384 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:36.796877 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:36.797319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:36.798053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:36.798515 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:36.798948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:36.817302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for project 4a0e462d905a4e939b540783e6848291. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:08:36.822937 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for user 2c1e0e53e74d444a975ec2236d7b7d4a and project 4a0e462d905a4e939b540783e6848291. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:08:36.836053 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:08:36.838514 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:08:36.887209 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [e9640538-c885-460f-ad95-7640e954d9bc] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:08:37.896146 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [e9640538-c885-460f-ad95-7640e954d9bc] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38204. Aug 27 22:08:37.911790 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-9b5be14b-4fa0-4bc9-b460-7a7c8c3565a3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.786478 Aug 27 22:08:37.912490 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3677/7257] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:08:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 22:08:37.926868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7fca7823-5e9a-49ac-9c80-baee5d74589c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:37.927580 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7fca7823-5e9a-49ac-9c80-baee5d74589c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:38.001994 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7fca7823-5e9a-49ac-9c80-baee5d74589c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:38.011549 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7fca7823-5e9a-49ac-9c80-baee5d74589c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1245 microversion: 2.1 time: 0.091121 Aug 27 22:08:38.012766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3581/7258] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:37 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:39.033879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-c4e3db6d-e2e9-465b-8fd4-69e4b5b58865 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:39.034796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-c4e3db6d-e2e9-465b-8fd4-69e4b5b58865 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:39.091682 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-c4e3db6d-e2e9-465b-8fd4-69e4b5b58865 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:39.100124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-c4e3db6d-e2e9-465b-8fd4-69e4b5b58865 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1245 microversion: 2.1 time: 0.071236 Aug 27 22:08:39.100966 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3678/7259] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:39 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:40.124598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:40.125127 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:40.134924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:40.135447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:40.135895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:40.136598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:40.137064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:40.137503 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:40.210954 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:40.219388 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9db8a8d7-b4fc-434d-8d65-abf1612c304a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1249 microversion: 2.1 time: 0.101229 Aug 27 22:08:40.219956 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3582/7260] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:40 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:41.241857 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:41.242573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:41.249649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:41.250145 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:41.251009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:41.251753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:41.252321 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:41.252904 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:41.337401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:41.348236 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-47fa0c3b-ecec-4f00-8873-75c835eade63 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1305 microversion: 2.1 time: 0.110230 Aug 27 22:08:41.349024 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3679/7261] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:41 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:42.371082 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:42.371786 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:42.378071 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:42.378569 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:42.379016 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:42.379754 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:42.380188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:42.380640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:42.521936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:42.530678 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d4656ca5-cb6a-42a2-9e70-a01f0c827b1d tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.164443 Aug 27 22:08:42.531176 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3583/7262] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:42 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:42.946302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:42.957976 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:42.958763 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:42.959204 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:42.971495 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] Creating event network-changed:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:08:42.977472 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e16a3c80-0754-4245-a997-7f03a0d19a71 req-d5cfa364-4900-43a2-bcd0-0e07a0d92128 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 Aug 27 22:08:42.978183 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3680/7263] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:08:43.555534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:43.556147 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:43.563889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:43.564376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:43.564813 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:43.565511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:43.565964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:43.566393 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:43.711880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:43.719945 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0f0eda00-c9e0-4fcf-bc70-967c3f46e0bd tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.169784 Aug 27 22:08:43.720935 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3584/7264] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:43 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:44.743544 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:44.744115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:44.751217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:44.751758 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:44.752339 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:44.753060 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:44.753527 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:44.753955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:44.901555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:44.913270 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6abece45-2151-4ff2-873e-f25ee2fad62c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.174655 Aug 27 22:08:44.914192 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3681/7265] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:44 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:45.935633 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:45.936263 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:45.945025 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:45.945618 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:45.946090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:45.946898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:45.947365 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:45.947814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:46.106567 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:46.118010 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-428edfc6-9d6b-469e-8868-5dee81f8864e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.186088 Aug 27 22:08:46.118752 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3585/7266] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:45 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:47.143960 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:47.144579 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:47.147956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:47.153533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:47.154047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:47.154481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:47.155186 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:47.155690 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:47.156125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:47.297208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:47.305735 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0a095feb-a50a-4c05-81c1-d18896aaa9c8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.165689 Aug 27 22:08:47.306324 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3682/7267] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:47 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:48.332378 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:48.332886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:48.336605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:48.344326 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:48.344976 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:48.345886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:48.346970 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:48.347669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:48.348249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:48.498153 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:48.506115 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0e4b0975-94c1-4be8-b564-cf1f354bdf5f tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.180054 Aug 27 22:08:48.506703 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3586/7268] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:48 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:48.989869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "name": "network-vif-plugged", "status": "completed", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:49.002756 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:49.004046 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:49.004490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:49.020663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] Creating event network-vif-plugged:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:08:49.026496 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-f76105d4-307a-42ee-a6b3-d14e492e90cf req-675e79aa-5720-42c8-807b-63534721a2e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040954 Aug 27 22:08:49.027830 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3683/7269] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:08:49.529397 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:49.530204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:49.540888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:49.541530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:49.542134 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:49.543118 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:49.543788 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:49.544411 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:49.692948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:49.701160 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-015c4e03-aff2-47f1-8a07-325c02ef97fa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1370 microversion: 2.1 time: 0.177679 Aug 27 22:08:49.701744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3587/7270] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:49 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:50.724071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=8 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:08:50.729623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:50.730534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:50.737329 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:50.737811 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:50.738244 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:50.738933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:50.739403 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:50.739832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:50.883033 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:50.891152 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe7679d9-a52d-477e-9785-7872df43a15c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1554 microversion: 2.1 time: 0.168049 Aug 27 22:08:50.891776 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3684/7271] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:50 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:50.919622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:08:50.920211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:08:50.927625 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:50.928123 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:50.928597 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:50.929315 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:50.929780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:50.930223 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:51.065928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:08:51.074201 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-458b235e-468f-4e8a-8a12-6db709232903 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1554 microversion: 2.1 time: 0.165451 Aug 27 22:08:51.074792 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3588/7272] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:08:50 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:08:53.107801 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:08:53.118027 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:08:53.118507 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:08:53.119019 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:08:53.130382 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] Creating event network-changed:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:08:53.135848 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-a78b51c8-f64f-477e-8f2f-c0e25b12b24b req-be6a9974-c427-4807-86fa-4dd2e7c75f1f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032584 Aug 27 22:08:53.137006 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3685/7273] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:11:20.010100 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:11:20.011293 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:11:20.012019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:20.012784 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=42 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:20.013779 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 22:11:20.013946 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action (ip 10.222.0.40) !!! Aug 27 22:11:20.016609 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:11:20.016783 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action (ip 10.222.0.40) !!! Aug 27 22:11:20.028777 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:11:20.029332 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:20.040413 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:20.040902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:20.041377 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:20.042088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:20.042554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:20.042992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:20.067188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.objects.instance [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lazy-loading 'flavor' on Instance uuid da043aeb-0da9-4484-84bd-a3428ef16183 {{(pid=140433) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 22:11:20.486893 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-6461b42c-f881-4c5f-8d9a-171bc4ebb350 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "POST /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action" status: 202 len: 0 microversion: 2.1 time: 0.478497 Aug 27 22:11:20.487528 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3589/7274] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:11:20 2022] POST /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:11:20.495224 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:11:20.496575 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:11:20.497212 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:20.497972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=32 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:20.499186 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:11:20.499318 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 22:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 (ip 10.222.0.40) !!! Aug 27 22:11:20.500782 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 27 22:11:20.505843 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:20.506557 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:20.520513 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:20.521016 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:20.521459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:20.522162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:20.522618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:20.523040 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:20.717416 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:20.726037 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d56f232e-1fa5-4431-bf42-19c088b0916c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.232831 Aug 27 22:11:20.726659 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3686/7275] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:20 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:21.751610 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:21.752351 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:21.762062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:21.762554 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:21.762997 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:21.763767 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:21.764227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:21.764679 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:21.769693 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38346. Aug 27 22:11:21.771965 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38348. Aug 27 22:11:21.913227 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:21.921193 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c831df43-a292-4866-9f45-6ff951e2c6e5 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.176228 Aug 27 22:11:21.921783 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3590/7276] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:21 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:22.947376 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:22.948000 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:22.960195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:22.960752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:22.961290 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:22.962115 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:22.962643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:22.963135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:22.975176 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38356. Aug 27 22:11:22.986175 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38354. Aug 27 22:11:23.112167 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:23.120390 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-543e863f-b0c5-46fb-adc5-cce87038cf8c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.179271 Aug 27 22:11:23.120915 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3687/7277] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:22 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:24.145267 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:24.145898 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:24.154019 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:24.154571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:24.155066 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:24.155888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:24.156403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:24.156890 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:24.310826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:24.319668 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-4e4add04-c06e-4b19-8168-4ab99d5f4bb9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.180412 Aug 27 22:11:24.320249 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3591/7278] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:24 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:25.344477 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:25.345393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:25.353977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:25.354474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:25.354918 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:25.355659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:25.356125 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:25.356588 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:25.503258 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:25.511874 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f987edad-64e1-446f-9634-7bce49cb7002 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.173711 Aug 27 22:11:25.512465 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3688/7279] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:25 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:26.538243 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:26.539330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:26.552020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:26.552595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:26.553126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:26.553946 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:26.554318 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:26.554902 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:26.698472 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:26.706457 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-124744c8-c1bf-46bf-b0a4-9fa93a4883ca tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.175064 Aug 27 22:11:26.707135 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3592/7280] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:26 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:27.729687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:27.730330 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:27.738401 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:27.738933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:27.739431 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:27.740214 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:27.740687 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:27.741148 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:27.880273 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:27.892878 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-f9ef6a32-19f8-404b-92ee-7c0d9c95f9f3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.167133 Aug 27 22:11:27.893757 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3689/7281] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:27 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:28.916181 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:28.917057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:28.926053 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:28.926601 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:28.927096 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:28.927882 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:28.928424 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:28.928948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:29.103058 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:29.112647 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7685c938-fabe-4718-a115-75515caae855 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.201301 Aug 27 22:11:29.113310 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3593/7282] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:28 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:30.144994 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:30.145670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:30.152919 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:30.153419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:30.153869 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:30.154568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:30.155042 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:30.155479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:30.308670 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:30.319858 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2dc74ddf-254e-4b70-b279-b0b8db9da515 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.181320 Aug 27 22:11:30.320718 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3690/7283] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:30 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:31.346015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:31.346636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:31.354738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:31.355230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:31.355720 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:31.356410 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:31.356869 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:31.357301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:31.502927 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:31.511459 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73f2b7fa-9d8d-4f1f-a79b-b4deab4a66bb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.169420 Aug 27 22:11:31.512048 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3594/7284] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:31 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:32.538393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:32.539526 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:32.551326 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:32.551860 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:32.552309 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:32.553021 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:32.553487 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:32.553922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:32.691817 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:32.700052 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8d06059b-2870-45fa-b9cf-1cb3204bc4c4 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1700 microversion: 2.1 time: 0.168352 Aug 27 22:11:32.700643 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3691/7285] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:32 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:33.729403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:33.730085 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:33.737428 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:33.737931 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:33.738417 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:33.739090 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:33.739680 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:33.740105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:33.881064 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:33.889076 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f419b482-40e5-4c56-96b0-86ad6968e4cf tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1700 microversion: 2.1 time: 0.164006 Aug 27 22:11:33.889650 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3595/7286] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:33 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:34.913231 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:34.913872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:34.921182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:34.921680 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:34.922129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:34.922838 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:34.923303 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:34.923804 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:35.058769 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:35.067376 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba0d211f-03a0-4a44-9edd-b97601dd8a2c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1700 microversion: 2.1 time: 0.159381 Aug 27 22:11:35.067991 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3692/7287] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:34 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:35.779944 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "name": "network-vif-plugged", "status": "completed", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:11:35.791122 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:35.791657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:35.792105 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:35.805127 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] Creating event network-vif-plugged:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:11:35.810588 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-83033364-7595-443d-a0cd-f5d95701dd93 req-b2158db7-c80d-4a7b-b7ae-117fd0f36d1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Aug 27 22:11:35.811412 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3596/7288] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:11:36.090388 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:36.091103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:36.101410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:36.102119 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:36.102846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:36.104024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:36.104747 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:36.105479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:36.254424 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:36.263041 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-71b56c66-7e49-45ef-9b64-5bb288b99b85 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1700 microversion: 2.1 time: 0.177388 Aug 27 22:11:36.263652 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3693/7289] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:36 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:37.289615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:37.291075 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:37.299513 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:37.300620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:37.301891 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:37.302721 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:37.303494 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:37.304150 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:37.463565 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:37.473916 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-eeea33ab-43c3-4a1f-a998-3a69ae7a615c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.192419 Aug 27 22:11:37.474879 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3597/7290] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:37 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:38.501926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:38.502935 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:38.511618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:38.513427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:38.514152 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:38.515392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:38.515997 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:38.516891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:38.673452 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:38.681802 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-50ebaf89-8776-4484-a3c8-de9c899dc9c2 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.184264 Aug 27 22:11:38.682397 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3694/7291] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:38 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:39.706523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:39.707759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:39.714579 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:39.715400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:39.716861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:39.716861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:39.716861 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:39.717340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:39.871205 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:39.880514 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-943d7ff7-9c1d-4025-84d5-a4cfdd5ae86c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.181104 Aug 27 22:11:39.881231 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3598/7292] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:39 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:40.902479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:40.903254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:40.913076 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:40.913894 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:40.914547 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:40.916221 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:40.916748 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:40.917184 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:41.078035 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:41.086667 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3563500c-da7d-45b8-8931-2d83f91d85f9 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.188230 Aug 27 22:11:41.087230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3695/7293] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:40 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:42.113045 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:42.114489 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:42.122746 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:42.123248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:42.124152 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:42.124905 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:42.125383 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:42.125824 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:42.275191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:42.283418 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d7f06b2d-1a46-4607-aa93-fce33aa2a609 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.177165 Aug 27 22:11:42.284064 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3599/7294] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:42 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:43.310073 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:43.314146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:43.323249 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:43.323884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:43.324521 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:43.325381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:43.325913 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:43.326440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:43.486962 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:43.496807 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b9988993-43e1-4b23-ab42-69ed85bafc37 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.190596 Aug 27 22:11:43.496807 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3696/7295] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:43 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:44.517447 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:44.518173 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:44.526240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:44.526794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:44.527480 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:44.530810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:44.531291 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:44.531922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:44.687920 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:44.696837 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8a405375-6728-4458-b9ee-bd61154e5657 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.183343 Aug 27 22:11:44.697646 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3600/7296] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:44 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:45.723863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:45.724816 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:45.732318 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:45.732813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:45.733256 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:45.733930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:45.734420 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:45.734845 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:45.886596 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:45.896410 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fe45aa52-69c9-477b-9e24-fb259732ecd8 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1695 microversion: 2.1 time: 0.179118 Aug 27 22:11:45.896998 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3697/7297] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:45 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:46.925895 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:46.926605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:46.936622 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:46.937330 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:46.937955 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:46.938820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:46.939312 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:46.939776 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:47.075050 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:47.083242 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-70a70857-eb1b-4493-8508-11d0fd1f02ef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1677 microversion: 2.1 time: 0.161848 Aug 27 22:11:47.083847 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3601/7298] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:46 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:48.109723 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:48.110623 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:48.118978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:48.119494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:48.119936 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:48.120630 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:48.121080 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:48.121505 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:48.264458 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:48.272923 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2999d659-9d75-472b-9c6c-19160ebf6217 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1677 microversion: 2.1 time: 0.169935 Aug 27 22:11:48.273495 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3698/7299] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:48 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:49.300574 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:49.301571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:49.313499 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.314337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.315099 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.316325 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.317106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.317836 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.473699 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:49.485761 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-098bb59d-ecf2-40c0-bf90-4ff8b8de43cb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1620 microversion: 2.1 time: 0.191739 Aug 27 22:11:49.486550 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3602/7300] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:49 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1620 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:49.507005 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:11:49.508085 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:49.515685 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.516166 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.516609 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.517307 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.517767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.518196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.564619 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140434) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 22:11:49.637709 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6225b8fc-37f1-4bff-8415-4b1df8f5ce09 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "POST /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action" status: 202 len: 0 microversion: 2.1 time: 0.134726 Aug 27 22:11:49.638552 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3699/7301] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:11:49 2022] POST /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:11:49.646921 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:49.648024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:49.654184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.654686 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.655136 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.655879 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.656337 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.656901 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.795465 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "name": "network-vif-unplugged", "status": "completed", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:11:49.806638 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:49.806930 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:49.807369 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:49.821829 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:49.823844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.compute.server_external_events [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] Unable to find a host for instance da043aeb-0da9-4484-84bd-a3428ef16183. Dropping event network-vif-unplugged {{(pid=140434) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 22:11:49.824741 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-19ac0cd0-78cc-424f-9e49-6ed26f0ad589 req-7beb90e4-2c9d-4987-8917-70293f53b901 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033266 Aug 27 22:11:49.825348 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3700/7302] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 22:11:49.830762 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-edecedfb-ef06-4bf5-9ab9-9e3f8e36423e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1628 microversion: 2.1 time: 0.187839 Aug 27 22:11:49.831481 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3603/7303] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:49 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1628 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:50.853030 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:50.853649 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:50.856442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:50.861977 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:50.862503 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:50.862940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:50.863664 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:50.864127 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:50.864560 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:50.867956 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:51.007092 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:51.019771 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-15d1c87b-f542-4168-8402-9e753b485cd3 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.170352 Aug 27 22:11:51.020520 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3701/7304] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:50 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:52.043277 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:52.044583 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:52.047399 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=31 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:52.064248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:52.064764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:52.066258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:52.067070 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:52.067669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:52.068491 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:52.075591 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:11:52.243999 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:52.259619 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cec64c1e-6068-4d85-967b-8daae22eab1e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.220456 Aug 27 22:11:52.274479 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3604/7305] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:52 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:53.282915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:53.284208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:53.291140 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:53.292006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:53.292616 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:53.293510 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:53.294147 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:53.294762 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:53.450768 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:53.460751 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-56257eb8-6b5b-4a7a-9c79-091a167d8baa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.183068 Aug 27 22:11:53.462014 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3702/7306] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:53 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:54.486922 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:54.487793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:54.499020 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:54.500015 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:54.500656 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:54.501764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:54.502473 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:54.503126 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:54.670880 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:54.679649 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-5c169dab-c7ba-4bda-be01-0e882fabd573 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.198867 Aug 27 22:11:54.680790 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3605/7307] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:54 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:55.702377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:55.702980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:55.710217 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:55.710754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:55.711232 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:55.712361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:55.712858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:55.713363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:55.881087 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:55.890124 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3977303e-5ce8-4764-849f-ce5cdc81efcb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.191678 Aug 27 22:11:55.890724 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3703/7308] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:55 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:56.912596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:56.913240 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:56.921072 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:56.921570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:56.922010 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:56.922727 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:56.923186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:56.923724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:57.068128 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:57.076825 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-8dc23a48-fbf8-40f5-9178-10124c224877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.168214 Aug 27 22:11:57.077404 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3606/7309] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:56 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:58.099450 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:58.100829 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:58.109044 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:58.109572 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:58.110009 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:58.110764 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:58.111252 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:58.111709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:58.296168 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:58.305161 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-46753ef6-a020-4b14-a721-4921b06a65c0 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.210612 Aug 27 22:11:58.305947 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3704/7310] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:58 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:11:59.328403 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:11:59.329369 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:11:59.338254 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:59.338781 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:59.339427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:59.340164 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:11:59.340650 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:11:59.341073 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:11:59.482197 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:11:59.490944 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cb1d6a0a-f666-4504-aa0a-66d0b7077465 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.167841 Aug 27 22:11:59.491780 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3607/7311] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:11:59 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 22:12:00.515172 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:00.515985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:00.526646 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:00.527566 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:00.528216 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:00.529213 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:00.529875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:00.530494 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:00.676041 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:00.684480 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8c582326-a7e6-46dc-af37-33389462fb39 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.175134 Aug 27 22:12:00.685077 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3705/7312] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:00 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:01.709780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:01.710486 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:01.719682 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:01.720174 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:01.720599 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:01.721342 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:01.721796 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:01.722607 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:01.861430 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:01.869494 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9a4481df-3dad-4694-951e-abe2407e1380 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.165708 Aug 27 22:12:01.870068 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3608/7313] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:01 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:02.893872 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:02.894746 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:02.904441 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:02.904942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:02.905392 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:02.906095 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:02.906553 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:02.906971 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:03.054338 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:03.062621 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-7fdb4fdd-eaff-4879-a212-1020c4a8cfef tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.174497 Aug 27 22:12:03.063185 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3706/7314] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:02 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:04.087268 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:04.088114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:04.098451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:04.099065 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:04.099644 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:04.100527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:04.101074 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:04.101620 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:04.239262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:04.247676 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-cfb271a9-ed16-4478-9752-23db1d4472f6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.166338 Aug 27 22:12:04.248258 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3609/7315] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:04 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:05.274220 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:05.275126 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:05.283983 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:05.284471 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:05.284915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:05.285618 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:05.286082 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:05.286517 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:05.423972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:05.432132 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-08477450-e6e5-4de9-a70d-73f08a637244 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.164764 Aug 27 22:12:05.432712 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3707/7316] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:05 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:06.455814 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:06.456738 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:06.465302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:06.466017 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:06.466536 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:06.467386 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:06.467936 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:06.468431 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:06.623722 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:06.636230 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-1d75d6f3-0bfa-4ff5-ba3f-bdfccd771397 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.184853 Aug 27 22:12:06.637112 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3610/7317] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:06 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:07.668827 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:07.669406 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:07.676900 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:07.677399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:07.677863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:07.678546 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:07.679018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:07.679502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:07.818132 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:07.826318 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-55aca225-7da7-4e8a-8526-c67849f92eb1 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.164438 Aug 27 22:12:07.826886 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3708/7318] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:07 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:08.852008 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:08.852884 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:08.864219 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:08.864978 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:08.865660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:08.866730 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:08.867446 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:08.868145 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:09.016275 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:09.026377 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e43ab0d2-bca5-4e76-a313-d92cee516c76 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.181062 Aug 27 22:12:09.026995 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3611/7319] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:08 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:10.025738 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "name": "network-vif-plugged", "status": "completed", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:12:10.035708 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:10.036142 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:10.036583 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:10.048161 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] Creating event network-vif-plugged:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:12:10.049534 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:10.050158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:10.051789 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] [678caf6d-91aa-414d-8ecf-29db2f62ab03] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:12:10.057576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:10.058057 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:10.058502 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:10.059212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:10.059693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:10.060165 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:10.199636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:10.208459 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3823bb77-c834-4f45-830a-ea1abc64d7eb tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.163438 Aug 27 22:12:10.209042 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3612/7320] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:10 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 22:12:11.062224 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] [678caf6d-91aa-414d-8ecf-29db2f62ab03] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 38548. Aug 27 22:12:11.066097 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-e64704ed-3643-4788-9d67-0836682db2b4 req-9b34ea0a-b1c7-423a-bddc-227173f93cdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.111012 Aug 27 22:12:11.066832 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3709/7321] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:12:11.230872 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:11.231780 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:11.239928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:11.240516 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:11.240964 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:11.241657 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:11.242120 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:11.242548 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:11.388484 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:11.396978 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-bfb2969b-99c6-4023-83bb-d4253993b301 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.170734 Aug 27 22:12:11.397533 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3613/7322] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:11 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:12.423655 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:12.424446 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:12.432884 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:12.433485 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:12.434006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:12.434825 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:12.435398 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:12.436162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:12.591439 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:12.600330 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2ebad6b3-6a0d-4a23-8fa7-3f254f417877 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1686 microversion: 2.1 time: 0.184118 Aug 27 22:12:12.600914 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3710/7323] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:12 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:12:13.626048 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:12:13.626759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:12:13.635470 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:13.636103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:13.636631 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:13.637456 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:12:13.638003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:12:13.638511 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:12:13.782098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:12:13.790152 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-233b6295-713a-4b31-85a8-9915e067f731 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1673 microversion: 2.1 time: 0.170519 Aug 27 22:12:13.790731 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3614/7324] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:12:13 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:13:58.672717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=19 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:13:58.673947 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=55 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:13:58.674652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=21 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:13:58.675481 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=65 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:13:58.676470 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:13:58.676860 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Aug 27 22:13:58.682760 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:13:58.684833 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:13:58.693978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:13:58.694470 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:13:58.694910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:13:58.698426 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:13:58.698911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:13:58.699367 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:13:58.726767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:13:58.745248 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:13:58.755940 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:13:58.756421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:13:58.756857 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:13:58.770022 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] Creating event network-changed:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:13:58.776154 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-1ee3b29e-a91d-4784-a958-4955e771687f req-3308e0a9-e0c5-4c23-8298-421a53abfe4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103216 Aug 27 22:13:58.776954 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3615/7325] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:13:58.811482 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-fcd8d66f-e074-473e-8a5e-89771999ae1c tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "DELETE /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 204 len: 0 microversion: 2.1 time: 0.140655 Aug 27 22:13:58.812118 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3711/7326] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:13:58 2022] DELETE /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:13:58.821323 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:13:58.822026 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:13:58.829262 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:13:58.829765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:13:58.830212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:13:58.830985 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:13:58.831522 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:13:58.831960 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:13:58.975811 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:13:58.984356 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e8258ada-5d44-4a20-ba8e-a93f6f193a10 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.167239 Aug 27 22:13:58.985100 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3616/7327] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:13:58 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 22:14:00.007049 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:00.007791 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:00.018662 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:00.019399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:00.020024 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:00.020985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:00.021625 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:00.022199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:00.163693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:00.172018 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-87d95ab0-eb7e-47b7-be0e-257b368bbfaa tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1679 microversion: 2.1 time: 0.169294 Aug 27 22:14:00.172616 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3712/7328] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:00 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:01.036098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da043aeb-0da9-4484-84bd-a3428ef16183", "name": "network-vif-deleted", "tag": "f0093c41-c70d-4f20-af03-47e5caa45f95"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:01.046826 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:01.047313 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:01.047802 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:01.063263 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] Creating event network-vif-deleted:f0093c41-c70d-4f20-af03-47e5caa45f95 for instance da043aeb-0da9-4484-84bd-a3428ef16183 on nch1-master-1 Aug 27 22:14:01.068349 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-cd1bfe06-4dfe-4e31-a5d7-f40a697e8c05 req-49a08968-1acd-4bb8-a22f-69e554733171 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103214 Aug 27 22:14:01.068960 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3617/7329] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:14:01.197955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:01.198479 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:01.205846 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:01.206395 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:01.206842 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:01.207598 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:01.208066 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:01.208502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:01.242911 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:01.243449 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:01.243901 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:01.245018 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.objects.instance [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lazy-loading 'fault' on Instance uuid da043aeb-0da9-4484-84bd-a3428ef16183 {{(pid=140434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 22:14:01.287054 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1e0e53e74d444a975ec2236d7b7d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0e462d905a4e939b540783e6848291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:01.295983 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b6bce87a-cf8e-4dc1-91a9-ea500f916bb6 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 200 len: 1335 microversion: 2.1 time: 0.104549 Aug 27 22:14:01.296579 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3713/7330] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:01 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:02.320984 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:02.321794 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] [instance: da043aeb-0da9-4484-84bd-a3428ef16183] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:02.330390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:02.330995 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:02.331581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:02.332452 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:02.333037 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:02.333545 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:02.349171 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] HTTP exception thrown: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Request method failure captured: Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 HTTP/1.1 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpXdQleg1kabNFPi5vn_YLI4n-CUygfuqe6V8QTh745WdDuUpKcECOLUrTT81QmX_isrMl0cE-7UOYPee3sFQ9IsGroydsKiX60Fw5VFkfj4ZjofITMhhZgOq63JpiX5IWXDs4NklRbv3bN2z6kIf5aTB6VdrG_lnXfJ5ivsCgx3FlM Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 4a0e462d905a4e939b540783e6848291 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestShelveInstance-1783775777 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a0e462d905a4e939b540783e6848291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/4a0e462d905a4e939b540783e6848291"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_4a0e462d905a4e939b540783e6848291", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/4a0e462d905a4e939b540783e6848291"}]}] Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestShelveInstance-1783775777 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 4a0e462d905a4e939b540783e6848291 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestShelveInstance-1783775777 Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestShelveInstance-1783775777-project Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 2c1e0e53e74d444a975ec2236d7b7d4a Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestShelveInstance-1783775777-project Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': 'da043aeb-0da9-4484-84bd-a3428ef16183'} Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:14:02.350832 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Returning 404 to user: Instance da043aeb-0da9-4484-84bd-a3428ef16183 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a0158a6a-3d72-4f60-bab1-8e57aefb8f5a tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183" status: 404 len: 111 microversion: 2.1 time: 0.037516 Aug 27 22:14:02.356338 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3618/7331] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:02 2022] GET /compute/v2.1/servers/da043aeb-0da9-4484-84bd-a3428ef16183 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:14:02.531967 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-52a167a4-101e-4016-a370-4c5db0ed1e2e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '.version_select at 0x7ff84dfd8940>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:02.562281 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-52a167a4-101e-4016-a370-4c5db0ed1e2e tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-842032540" status: 202 len: 0 microversion: 2.1 time: 0.034348 Aug 27 22:14:02.562879 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3714/7332] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 22:14:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-842032540 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:14:02.590765 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7f39d423-0b70-4805-aace-7ea7fb98a3af tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Action: 'create', calling method: .version_select at 0x7ff857d60a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-357763460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKNpiiPKM2I06P/dPyumud+dzMjNPCGFkwrSSmKeWHttBcZMmQNBuABCwIe3isRmBGwQZ9gHlkmXgOHGOaVSo8pdfENY2UUtDOgqPp/YCk+MZI1tJnwbZtjPDcXzKfOUg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:02.607212 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7f39d423-0b70-4805-aace-7ea7fb98a3af tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for project 4a0e462d905a4e939b540783e6848291. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:14:02.612594 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-7f39d423-0b70-4805-aace-7ea7fb98a3af tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Getting quotas for user 2c1e0e53e74d444a975ec2236d7b7d4a and project 4a0e462d905a4e939b540783e6848291. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:14:02.644610 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7f39d423-0b70-4805-aace-7ea7fb98a3af tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.058796 Aug 27 22:14:02.645214 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3619/7333] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:14:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 22:14:05.521863 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3b3fdff0-26d6-4b4d-bf2b-7e9c56e5e478 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] Calling method '.version_select at 0x7ff84f0ee310>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:05.544689 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3b3fdff0-26d6-4b4d-bf2b-7e9c56e5e478 tempest-TestShelveInstance-1783775777 tempest-TestShelveInstance-1783775777-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-357763460" status: 202 len: 0 microversion: 2.1 time: 0.026623 Aug 27 22:14:05.545275 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3715/7334] 10.222.0.40 () {58 vars in 1251 bytes} [Sat Aug 27 22:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-357763460 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 22:14:23.149570 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=12 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:23.150772 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=4 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:23.151692 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:23.350716 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-9ab79700-11c9-4c7e-97d8-8a506d0ba607 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Action: 'create', calling method: .version_select at 0x7ff84f204160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1562208968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvG/N5PazDuIm//cow613phnZqJuC4rD4sMDTUDVdgbxO3B8oTrFD3QchI0U2IvKDRNt5D9ANEimGCXywYwdHPuZlHlF5m1w5WGCGDszxkBnRIbnU1p0qixmHiakndkBg=="}} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:23.368816 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9ab79700-11c9-4c7e-97d8-8a506d0ba607 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for project 37c30f8e025e45968525cc0b8c777b50. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:14:23.375269 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.quota [None req-9ab79700-11c9-4c7e-97d8-8a506d0ba607 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for user 1a55aa52617849b0b9a6089529ee1910 and project 37c30f8e025e45968525cc0b8c777b50. Resources: {'key_pairs'} {{(pid=140433) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:14:23.414282 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-9ab79700-11c9-4c7e-97d8-8a506d0ba607 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.269488 Aug 27 22:14:23.415417 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3620/7335] 10.222.0.40 () {60 vars in 1159 bytes} [Sat Aug 27 22:14:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:14:24.547940 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:24.548819 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:24.553305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-776462089", "imageRef": "3c9ca970-c391-4d4a-9934-78cc80446a1e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1562208968", "security_groups": [{"name": "tempest-secgroup-smoke-1617771944"}], "networks": [{"uuid": "12520b56-b874-413d-adf7-4ac0e9941904"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:24.675891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] validate_networks() for [('12520b56-b874-413d-adf7-4ac0e9941904', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:14:25.162675 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:14:25.163103 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:14:25.163717 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:14:25.164133 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:14:25.164565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:14:25.174586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:25.175072 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:25.175554 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:25.176363 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:25.176824 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:25.177254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:25.195593 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for project 37c30f8e025e45968525cc0b8c777b50. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:14:25.201751 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for user 1a55aa52617849b0b9a6089529ee1910 and project 37c30f8e025e45968525cc0b8c777b50. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:14:25.216254 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:14:25.218729 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3c9ca970-c391-4d4a-9934-78cc80446a1e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:14:25.268055 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-0487d39e-8e1b-4fe7-9502-17b94cf20d2d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722074 Aug 27 22:14:25.268927 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3716/7336] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:14:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 22:14:25.280144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-169ddb4c-adbb-4bfa-9702-6788fd8ffb81 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:25.280782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-169ddb4c-adbb-4bfa-9702-6788fd8ffb81 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:25.346077 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-169ddb4c-adbb-4bfa-9702-6788fd8ffb81 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:25.354862 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-169ddb4c-adbb-4bfa-9702-6788fd8ffb81 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1248 microversion: 2.1 time: 0.078826 Aug 27 22:14:25.355546 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3621/7337] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:25 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:26.377153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:26.377770 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:26.384715 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:26.385207 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:26.385643 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:26.386410 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:26.386866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:26.387283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:26.450590 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:26.458581 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-dc2b609f-dd11-44a5-8118-b6adc18d5bc0 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1300 microversion: 2.1 time: 0.086592 Aug 27 22:14:26.459183 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3717/7338] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:26 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:27.480733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:27.481319 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:27.489759 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:27.490258 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:27.490734 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:27.491475 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:27.491942 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:27.492372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:27.554933 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:27.564367 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-0128c48e-10ba-4964-baa4-e5974a2670e4 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1306 microversion: 2.1 time: 0.087753 Aug 27 22:14:27.564957 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3622/7339] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:27 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:28.585654 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:28.586237 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:28.593916 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:28.594440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:28.594878 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:28.595626 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:28.596079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:28.596499 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:28.738644 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:28.748047 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-97044e56-29e0-4735-9236-5fdfd805663e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.166128 Aug 27 22:14:28.748436 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3718/7340] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:28 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:28.775924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:28.787983 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:28.788474 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:28.788910 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:28.801106 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] Creating event network-changed:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:14:28.806499 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-96ce03a2-d552-43fe-9a2d-4f6203201b69 req-6b62e872-f138-446a-b0fe-78f67774da1d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034507 Aug 27 22:14:28.807469 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3623/7341] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:14:29.778419 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:29.779283 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:29.786464 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:29.786955 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:29.787393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:29.788105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:29.788555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:29.788986 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:29.932921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:29.942357 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-df6aca44-2943-4c96-bec8-b7b0ca6d6296 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.170820 Aug 27 22:14:29.942968 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3719/7342] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:29 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:30.969368 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:30.970372 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:30.980598 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:30.981186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:30.981640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:30.982340 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:30.982807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:30.983246 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:31.125232 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:31.137338 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f5577f0b-d4db-45e4-ab85-fe47d9dd97e5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.175935 Aug 27 22:14:31.137920 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3624/7343] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:30 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:32.160241 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:32.160815 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:32.170699 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:32.171565 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:32.172302 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:32.173483 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:32.174324 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:32.175048 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:32.346569 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:32.355293 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba9a2a7e-dc6a-43d7-bd6c-46359ce59e36 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.199196 Aug 27 22:14:32.355948 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3720/7344] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:32 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:33.377381 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:33.377948 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:33.385766 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:33.386235 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:33.386687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:33.387669 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:33.388186 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:33.388634 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:33.527220 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:33.536390 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3169f4cf-4da0-4c3b-9e08-07468d2702c3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.163337 Aug 27 22:14:33.536955 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3625/7345] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:33 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:34.220841 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "name": "network-vif-plugged", "status": "completed", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:34.232313 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:34.232879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:34.233298 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:34.244688 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] Creating event network-vif-plugged:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:14:34.249822 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-885edca5-f1a2-4538-9f06-57075926770a req-0ff41871-b6e6-4ae8-80ab-609468a4b7ce service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Aug 27 22:14:34.250426 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3721/7346] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:14:34.563563 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:34.564589 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:34.576581 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:34.577084 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:34.577538 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:34.578256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:34.578724 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:34.579191 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:34.734595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:34.743027 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-7200a790-45f0-4d31-a685-be8599ff86d3 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.187266 Aug 27 22:14:34.743660 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3626/7347] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:34 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:35.762731 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:35.764238 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:35.770875 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:35.771803 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:35.779922 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:35.780418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:35.781793 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:35.783427 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:35.783891 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:35.784323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:35.926528 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:35.934494 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ece67a90-372d-4c37-9b44-368776af42d9 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1374 microversion: 2.1 time: 0.173557 Aug 27 22:14:35.935050 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3722/7348] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:35 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:36.960636 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:36.961858 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:36.964958 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=6 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:14:36.973733 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:36.974229 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:36.974697 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:36.975477 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:36.975947 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:36.976385 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:37.125178 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:37.133983 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d49edf0e-9626-41c6-89a6-44e959b98830 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1559 microversion: 2.1 time: 0.180720 Aug 27 22:14:37.134570 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3627/7349] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:36 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:37.155749 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:14:37.156495 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:14:37.164272 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:37.164767 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:37.165211 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:37.165909 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:37.166368 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:37.166796 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:37.306921 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:14:37.315484 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-6e1e9f60-227e-4e89-88db-89c0adb9eff1 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1559 microversion: 2.1 time: 0.164714 Aug 27 22:14:37.316013 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3723/7350] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:14:37 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:14:39.063374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:14:39.074302 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:14:39.074793 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:14:39.075321 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:14:39.087612 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] Creating event network-changed:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:14:39.093095 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-87a0741a-7ccd-45ef-9ea6-643f90fdc486 req-f1876557-1c22-4e68-95a1-ccdbbb735ff3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Aug 27 22:14:39.095400 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3628/7351] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:17:05.585672 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:17:05.586975 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:17:05.587915 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:05.589014 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=40 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:05.591104 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 22:17:05.591447 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 22:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94/action (ip 10.222.0.40) !!! Aug 27 22:17:05.594648 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 22:17:05.594895 ncdv-master-1 devstack@n-api.service[140434]: Sat Aug 27 22:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94/action (ip 10.222.0.40) !!! Aug 27 22:17:05.606481 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-565492212"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:05.608920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:05.618697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:05.619196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:05.619668 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:05.620381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:05.620844 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:05.621414 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:05.978562 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-5ba048df-7261-475a-9223-7777db71ec18 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "POST /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94/action" status: 202 len: 0 microversion: 2.1 time: 0.396585 Aug 27 22:17:05.979230 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3724/7352] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:17:05 2022] POST /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 22:17:12.939204 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:17:12.940342 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 22:17:12.941335 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:12.942043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=34 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:12.942925 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 22:17:12.943068 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:17:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Aug 27 22:17:12.944691 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 22:17:12.944855 ncdv-master-1 devstack@n-api.service[140433]: Sat Aug 27 22:17:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Aug 27 22:17:13.016359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "name": "network-vif-plugged", "status": "completed", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:13.026264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:13.026748 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:13.027188 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:13.038890 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] Creating event network-vif-plugged:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:17:13.044104 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-02a11ff0-cfd8-431f-a81e-092624008c53 req-6010eea8-cc64-480b-9ce1-72da4c763031 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106876 Aug 27 22:17:13.044687 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3629/7353] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:17:24.739516 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:24.740319 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:24.744534 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1950748886", "imageRef": "08c3d031-52bb-4035-8ba7-4f616b03a366", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1562208968", "security_groups": [{"name": "tempest-secgroup-smoke-1617771944"}], "networks": [{"uuid": "12520b56-b874-413d-adf7-4ac0e9941904"}]}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:24.768588 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [a36f0485-8f52-4642-b22b-5dac477c96e1] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39118. Aug 27 22:17:24.770700 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [-] [24bbe9d6-4875-41d0-91ec-55c44e13610b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39120. Aug 27 22:17:24.863964 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.network.neutron [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] validate_networks() for [('12520b56-b874-413d-adf7-4ac0e9941904', None, None, None, None, None)] {{(pid=140434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 22:17:25.252079 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Flavor limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 22:17:25.252509 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Image limits 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 22:17:25.252987 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Flavor pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 22:17:25.253637 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Image pref 0:0:0 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 22:17:25.253899 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.virt.hardware [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 22:17:25.264020 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:25.264511 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:25.264952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:25.265683 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:25.266177 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:25.266605 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:25.284996 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for project 37c30f8e025e45968525cc0b8c777b50. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 22:17:25.293393 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.quota [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Getting quotas for user 1a55aa52617849b0b9a6089529ee1910 and project 37c30f8e025e45968525cc0b8c777b50. Resources: {'ram', 'instances', 'cores'} {{(pid=140434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 22:17:25.307788 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Going to run 1 instances... {{(pid=140434) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 22:17:25.310436 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='08c3d031-52bb-4035-8ba7-4f616b03a366',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 22:17:25.363957 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b0936e45-5967-42cf-8f3c-9fc63521895b tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.627099 Aug 27 22:17:25.364631 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3725/7354] 10.222.0.40 () {60 vars in 1147 bytes} [Sat Aug 27 22:17:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 22:17:25.374193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:25.375761 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:25.381549 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-e0c5ebd5-3e49-47b9-b268-6170b7f35eb8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:25.382279 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-e0c5ebd5-3e49-47b9-b268-6170b7f35eb8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:25.400203 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39136. Aug 27 22:17:25.404598 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39134. Aug 27 22:17:25.510571 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-e0c5ebd5-3e49-47b9-b268-6170b7f35eb8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:25.518390 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-e0c5ebd5-3e49-47b9-b268-6170b7f35eb8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1249 microversion: 2.1 time: 0.146455 Aug 27 22:17:25.518965 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3630/7355] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:25 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:26.541835 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:26.542421 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:26.549832 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:26.550377 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:26.550813 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:26.551580 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:26.552163 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:26.552591 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:26.931573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:26.939840 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-a2d636b8-c926-44b9-a8e7-b6f0d1d0e613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1309 microversion: 2.1 time: 0.403993 Aug 27 22:17:26.940709 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3726/7356] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:26 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:27.961596 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:27.962256 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:27.969827 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:27.970338 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:27.970782 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:27.971525 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:27.971987 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:27.972421 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:28.128971 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:28.138058 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-01fcfc37-c7fa-472e-8d91-74f3b2cceb71 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.180673 Aug 27 22:17:28.138655 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3631/7357] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:27 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:28.933361 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "name": "network-vif-unplugged", "status": "completed", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:28.949533 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:28.950109 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:28.950640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:28.967384 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] Creating event network-vif-unplugged:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:17:28.971462 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-26c01a33-2a09-4c5f-a6f4-9fa0f8ddec97 req-cf8d0d25-0198-44a9-8127-8dfb0b1ddd92 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042368 Aug 27 22:17:28.972518 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3727/7358] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:17:29.160236 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:29.160804 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:29.168609 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:29.169213 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:29.169652 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:29.170888 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:29.171463 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:29.171893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:29.314062 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:29.324606 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-d299e803-80c9-4f7a-8663-93becf95cb97 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.168279 Aug 27 22:17:29.327370 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3632/7359] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:29 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:30.350866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:30.352110 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:30.361417 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:30.361981 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:30.362855 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:30.363604 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:30.364350 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:30.364786 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:30.511015 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:30.519373 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-66b3659d-674c-4ee7-a85d-385fbb7d276d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.174743 Aug 27 22:17:30.531789 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3728/7360] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:30 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:31.543576 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:31.544290 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:31.551705 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:31.552206 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:31.552646 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:31.553357 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:31.553819 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:31.554271 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:31.702578 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:31.711153 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-73fb672c-3549-4b3a-8f75-d4f2200caecd tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.172162 Aug 27 22:17:31.712296 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3633/7361] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:31 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:32.732573 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:32.733199 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:32.740455 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:32.740972 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:32.741409 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:32.742267 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:32.742752 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:32.743139 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:32.881880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:32.890135 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-ba3c7f98-909e-4f67-ac21-4fba1331b5e8 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.161591 Aug 27 22:17:32.890715 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3729/7362] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:32 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:33.912661 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:33.913336 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:33.921478 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:33.921986 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:33.922434 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:33.923160 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:33.923654 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:33.924310 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:34.082791 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:34.099958 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-fa606525-90d8-40b3-9893-71b221f7581a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.191042 Aug 27 22:17:34.108120 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3634/7363] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:33 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:35.124263 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:35.124932 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:35.132858 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:35.133694 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:35.134952 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:35.136399 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:35.137208 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:35.137910 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:35.274182 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:35.301490 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell0:SELECT=6 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:35.307889 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:35.318053 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-57f380e3-bfa9-4d26-b64c-54cf704a65de tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.198558 Aug 27 22:17:35.318655 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3730/7364] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:35 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:36.340718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:36.341374 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:36.344204 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell0:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:17:36.350868 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:36.351379 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:36.351924 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:36.352638 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:36.353103 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:36.353825 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:36.493184 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:36.505832 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-12f78aba-99a1-4eaa-82eb-f7be5aad0016 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.168777 Aug 27 22:17:36.506754 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3635/7365] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:36 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:37.539697 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:37.540939 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:37.555135 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:37.555792 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:37.556240 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:37.556945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:37.557408 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:37.557834 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:37.722753 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:37.731722 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3627e906-faa4-49a9-a248-3cd342b32011 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.200797 Aug 27 22:17:37.732313 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3731/7366] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:37 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:38.512249 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:38.525185 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:38.525664 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:38.526106 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:38.537626 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] Creating event network-changed:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:17:38.542739 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-8a42d38d-4a9e-40ae-b8c6-37284d3d954a req-2e86ac20-abc2-4f09-ab75-95b74998f937 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039898 Aug 27 22:17:38.544174 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3636/7367] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:17:38.753777 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:38.754497 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:38.762178 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:38.762754 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:38.763203 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:38.764036 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:38.764502 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:38.764933 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:38.905418 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:38.913312 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-d9ce89de-71ad-499c-b6ca-b93d708a7d8e tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.163696 Aug 27 22:17:38.913899 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3732/7368] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:38 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:39.938501 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:39.939651 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:39.949982 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:39.950739 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:39.951418 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:39.952530 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:39.953230 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:39.953886 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:40.096358 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:40.105069 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-3ad30e3a-88cd-45d0-878b-ae38aff0dde2 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.174532 Aug 27 22:17:40.105660 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3637/7369] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:39 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:41.130153 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:41.131282 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:41.142394 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:41.143160 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:41.143897 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:41.144980 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:41.145693 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:41.146356 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:41.325315 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:41.333835 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b02f8aa8-4bab-47ea-ba01-d42d086d9634 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.209514 Aug 27 22:17:41.334567 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3733/7370] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:41 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:42.361687 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:42.362615 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:42.373198 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:42.373889 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:42.374529 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:42.375573 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:42.376242 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:42.376870 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:42.518893 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:42.528175 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-164dd65e-33bf-40e0-a018-ba6a5d5c28ad tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.172201 Aug 27 22:17:42.528766 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3638/7371] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:42 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:43.408896 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "name": "network-vif-plugged", "status": "completed", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:43.421586 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:43.422078 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:43.422520 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:43.435214 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] Creating event network-vif-plugged:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:17:43.440460 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-dac5e550-fc26-49a5-ab98-bc284c14cba4 req-60c77229-c4ba-4c96-9301-8911b04c2dd7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035476 Aug 27 22:17:43.441435 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3734/7372] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:17:43.550088 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:43.550718 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:43.558860 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:43.559400 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:43.559853 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:43.560750 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:43.561211 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:43.561640 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:43.702820 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:43.716406 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-875ecfea-415d-4b29-9c0d-96e674ad3d8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.170141 Aug 27 22:17:43.717178 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3639/7373] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:43 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:44.749772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:44.750945 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:44.761628 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:44.762003 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:44.762454 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:44.763155 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:44.763640 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:44.764071 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:44.905783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:44.913939 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-41e68506-91ae-4a6f-9b62-01ec85b03b8d tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1375 microversion: 2.1 time: 0.172782 Aug 27 22:17:44.914524 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3735/7374] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:44 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:45.943376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:45.944462 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:45.953492 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:45.953998 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:45.954451 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:45.955158 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:45.955660 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:45.956098 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:46.104382 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:46.113974 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-faa1be93-9b79-4577-83cc-dc492e6d2c8a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1560 microversion: 2.1 time: 0.181099 Aug 27 22:17:46.114567 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3640/7375] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:45 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:46.137179 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:17:46.137781 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:17:46.145227 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:46.145722 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:46.146162 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:46.146903 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:46.147362 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:46.147814 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:46.284440 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:17:46.293070 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-295c4417-d2e4-4eef-9e5f-ccd3a8b73285 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1560 microversion: 2.1 time: 0.159954 Aug 27 22:17:46.293661 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3736/7376] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:17:46 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:17:47.978959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:17:47.989479 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:17:47.989959 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:17:47.990390 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:17:48.005424 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] Creating event network-changed:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:17:48.010627 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9a856eea-d545-43c4-954a-3ddbf2de4a5e req-3700d2d3-9e98-4d20-858b-401789a39884 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Aug 27 22:17:48.011906 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3641/7377] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:19:51.562196 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:19:51.562978 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=60 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:19:51.635195 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1497883964"}} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:19:51.637711 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:19:51.644209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:19:51.644709 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:19:51.645149 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:19:51.645851 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:19:51.646305 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:19:51.646862 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:19:51.851167 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-8fa663bb-a51b-4464-ba7f-440eff114f23 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "POST /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081/action" status: 202 len: 0 microversion: 2.1 time: 0.290315 Aug 27 22:19:51.857051 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3737/7378] 10.222.0.40 () {60 vars in 1278 bytes} [Sat Aug 27 22:19:51 2022] POST /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 22:19:57.840887 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 22:19:57.842277 ncdv-master-1 devstack@n-api.service[140433]: ERROR oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 22:19:57.843087 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=26 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:19:57.844245 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=58 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:19:57.853537 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "name": "network-vif-plugged", "status": "completed", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:19:57.865949 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:19:57.866595 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:19:57.867187 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:19:57.879187 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] Creating event network-vif-plugged:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:19:57.884685 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-bb984eec-45ac-4445-bb0b-4d7b376692ca req-1f4039f5-b689-45a6-ba6d-b35712b8d8d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046170 Aug 27 22:19:57.885427 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3642/7379] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:20:09.707129 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_api:SELECT=2 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:20:09.708474 ncdv-master-1 devstack@n-api.service[140434]: DEBUG dbcounter [-] [140434] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:20:09.710193 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_api:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:20:09.710991 ncdv-master-1 devstack@n-api.service[140433]: DEBUG dbcounter [-] [140433] Writing DB stats nova_cell1:SELECT=2 {{(pid=140433) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 22:20:09.713659 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:09.714268 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:09.722381 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:09.722926 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:09.724146 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:09.724444 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:09.724920 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:09.725333 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:09.733414 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [92b4d132-7dc8-4b8c-a593-1bcabd7647ba] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39454. Aug 27 22:20:09.734492 ncdv-master-1 devstack@n-api.service[140433]: INFO oslo.messaging._drivers.impl_rabbit [-] [577eee6a-4173-4356-9840-13886e47c72a] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39452. Aug 27 22:20:09.759304 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Going to try to terminate instance {{(pid=140434) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:20:09.795693 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:20:09.807764 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:09.808264 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:09.808928 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:09.822869 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] Creating event network-changed:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:20:09.829963 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-9e2020a5-429e-4e59-be7a-2edbc366e39c req-d3b12e01-8755-4f50-ad72-682b5ba19559 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122243 Aug 27 22:20:09.832337 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3643/7380] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:20:09.846973 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-3a7fd205-5287-44dd-84b7-e2bdd91e3b5a tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 204 len: 0 microversion: 2.1 time: 0.141726 Aug 27 22:20:09.848009 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3738/7381] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:20:09 2022] DELETE /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:20:09.859523 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:09.860394 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:09.866992 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:09.867535 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:09.871527 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:09.872361 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:09.872956 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:09.873415 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:10.013557 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:20:10.021616 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-f1543747-a2cd-448a-b014-9ff2d0817010 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1685 microversion: 2.1 time: 0.167819 Aug 27 22:20:10.022209 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3644/7382] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:09 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:20:11.046559 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:11.047425 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:11.058105 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:11.058602 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:11.059047 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:11.059783 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:11.060247 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:11.060703 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:11.213608 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:20:11.222001 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-de40dc42-9a3d-49d5-8b27-0c47c9cd7613 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1685 microversion: 2.1 time: 0.181593 Aug 27 22:20:11.222584 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3739/7383] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:11 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:20:11.856807 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "name": "network-vif-unplugged", "status": "completed", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:20:11.869144 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:11.870043 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:11.870678 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:11.884374 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] Creating event network-vif-unplugged:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:20:11.890075 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-6594394e-f191-4c42-9523-785dd224ecec req-c216f4ae-6dfd-4c51-aff0-d36efce7ac6a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037433 Aug 27 22:20:11.890744 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3645/7384] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:20:12.246942 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:12.247617 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:12.255442 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:12.255948 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:12.256390 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:12.257108 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:12.257568 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:12.258029 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:12.327255 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:20:12.336394 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-625256e1-f8c6-457c-8227-4468457565e7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 200 len: 1498 microversion: 2.1 time: 0.095058 Aug 27 22:20:12.337316 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3740/7385] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:12 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 1498 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:20:12.344810 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc7c714-5b55-480b-b73e-c8b1ef125081", "name": "network-vif-deleted", "tag": "f7714f92-7f90-46a2-8380-90db190c8bb0"}]} {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:20:12.356114 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:12.356605 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:12.357051 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:12.368214 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.compute.server_external_events [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] Creating event network-vif-deleted:f7714f92-7f90-46a2-8380-90db190c8bb0 for instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 on nch1-master-1 Aug 27 22:20:12.373737 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [req-d59bdd29-b7b1-460a-ac46-87bb8937476c req-714193bb-31be-4ef5-b32b-717f8f220237 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Aug 27 22:20:12.374426 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3646/7386] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 22:20:13.363501 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:13.364192 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 8cc7c714-5b55-480b-b73e-c8b1ef125081] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:13.372323 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:13.372985 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:13.373536 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:13.374266 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:13.374893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:13.375512 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:13.391138 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.wsgi [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] HTTP exception thrown: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Request method failure captured: Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: request: GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 HTTP/1.1 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Accept: application/json Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Accept-Encoding: identity Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Connection: close Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Content-Length: 0 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Content-Type: application/json Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Host: 10.222.0.40 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: Openstack-System-Scope: None Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: User-Agent: python-urllib3/1.26.11 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Auth-Token: gAAAAABjCpc6zGjnsE34IiHrQZFrQuDdeHJ8u5zH1Vsw_nfaq6jbCobsBFhAhV1aw_9zAyBJsd01ydqeUjMgZnQOExzBIjGGlplfD89CAgTGwht6gPRrJEguu3uHSvuVALtjE5x1fqp2gNZqtYFQ6gydim4_7aaF329Vh_bNKrdKANmQ8atbKDU Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Id: None Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Domain-Name: None Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Identity-Status: Confirmed Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Is-Admin-Project: True Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Id: default Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Domain-Name: Default Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Id: 37c30f8e025e45968525cc0b8c777b50 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Project-Name: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Role: reader,member Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Roles: reader,member Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37c30f8e025e45968525cc0b8c777b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37c30f8e025e45968525cc0b8c777b50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37c30f8e025e45968525cc0b8c777b50", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37c30f8e025e45968525cc0b8c777b50"}]}] Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Id: 37c30f8e025e45968525cc0b8c777b50 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-Tenant-Name: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-User: tempest-TestSnapshotPattern-1674556184-project Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Id: default Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Domain-Name: Default Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Id: 1a55aa52617849b0b9a6089529ee1910 Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: X-User-Name: tempest-TestSnapshotPattern-1674556184-project Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: method: > Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: exception: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: action_args: {'id': '8cc7c714-5b55-480b-b73e-c8b1ef125081'} Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:20:13.392866 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: ERROR nova.api.openstack.wsgi Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Returning 404 to user: Instance 8cc7c714-5b55-480b-b73e-c8b1ef125081 could not be found. {{(pid=140434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-b46f5660-a6f1-4339-a631-087b284b1bb7 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081" status: 404 len: 111 microversion: 2.1 time: 0.037136 Aug 27 22:20:13.400459 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3741/7387] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:13 2022] GET /compute/v2.1/servers/8cc7c714-5b55-480b-b73e-c8b1ef125081 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:20:15.151974 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:15.153710 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:20:15.154169 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:15.160359 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:15.160856 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:15.161301 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:15.162024 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:15.162698 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:15.163135 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:15.166564 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:15.167123 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:15.167810 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:15.179663 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] Creating event network-changed:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:20:15.185551 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-34a827df-fdba-4f38-9e9c-325889a2d268 req-69e67075-f548-417f-a7c9-5be586419def service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035864 Aug 27 22:20:15.186502 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3742/7388] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:20:15.190427 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Going to try to terminate instance {{(pid=140433) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 22:20:15.281425 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-2b447530-6422-4cc6-bf96-de4187fb1208 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "DELETE /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 204 len: 0 microversion: 2.1 time: 0.134336 Aug 27 22:20:15.282457 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3647/7389] 10.222.0.40 () {58 vars in 1239 bytes} [Sat Aug 27 22:20:15 2022] DELETE /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 22:20:15.293151 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:15.293880 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.compute.api [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140434) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:15.300895 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:15.301555 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:15.302006 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:15.308154 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:15.313893 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:15.314613 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:15.462650 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.policy [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140434) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:20:15.471245 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-68f44e96-d21b-42f2-8b59-4ce3cebd8180 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1684 microversion: 2.1 time: 0.184071 Aug 27 22:20:15.471909 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3743/7390] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:15 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:20:16.493950 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:16.494787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:16.502416 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:16.502907 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:16.503376 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:16.504081 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:16.504543 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:16.505003 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:16.657042 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.policy [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a55aa52617849b0b9a6089529ee1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c30f8e025e45968525cc0b8c777b50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140433) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 22:20:16.667255 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-c292d18b-a521-4333-a139-d34532ab00e6 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 200 len: 1565 microversion: 2.1 time: 0.177665 Aug 27 22:20:16.668090 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3648/7391] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:16 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 22:20:17.201772 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cfe23d-c786-4ec2-8b59-22eb79c32c94", "name": "network-vif-deleted", "tag": "f20e939c-3eb9-41be-846f-02f30c642f07"}]} {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 22:20:17.212308 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:17.212784 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:17.213209 ncdv-master-1 devstack@n-api.service[140434]: DEBUG oslo_concurrency.lockutils [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:17.225033 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.compute.server_external_events [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] Creating event network-vif-deleted:f20e939c-3eb9-41be-846f-02f30c642f07 for instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 on nch2-master-1 Aug 27 22:20:17.230355 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [req-45080c84-cbe0-415e-930f-c526c7061fdb req-2c281541-960b-4c2d-b941-b21e40c7e259 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Aug 27 22:20:17.230989 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3744/7392] 10.222.0.40 () {64 vars in 1317 bytes} [Sat Aug 27 22:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 22:20:17.693787 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '>' {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:17.694769 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.compute.api [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [instance: 68cfe23d-c786-4ec2-8b59-22eb79c32c94] Fetching instance by UUID {{(pid=140433) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 22:20:17.707967 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:17.708792 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:17.709519 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:17.710688 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Acquiring lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 22:20:17.711443 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 22:20:17.712209 ncdv-master-1 devstack@n-api.service[140433]: DEBUG oslo_concurrency.lockutils [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Lock "041b2571-2ebd-443e-8235-90f2a1f62fd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140433) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 22:20:17.731440 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.wsgi [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] HTTP exception thrown: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Request method failure captured: Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: request: GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 HTTP/1.1 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Accept: application/json Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Accept-Encoding: identity Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Connection: close Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Content-Length: 0 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Content-Type: application/json Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Host: 10.222.0.40 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: Openstack-System-Scope: None Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: User-Agent: python-urllib3/1.26.11 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Auth-Token: gAAAAABjCpc6zGjnsE34IiHrQZFrQuDdeHJ8u5zH1Vsw_nfaq6jbCobsBFhAhV1aw_9zAyBJsd01ydqeUjMgZnQOExzBIjGGlplfD89CAgTGwht6gPRrJEguu3uHSvuVALtjE5x1fqp2gNZqtYFQ6gydim4_7aaF329Vh_bNKrdKANmQ8atbKDU Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Id: None Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Domain-Name: None Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Identity-Status: Confirmed Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Is-Admin-Project: True Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Id: default Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Domain-Name: Default Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Id: 37c30f8e025e45968525cc0b8c777b50 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Project-Name: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Role: reader,member Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Roles: reader,member Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37c30f8e025e45968525cc0b8c777b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/37c30f8e025e45968525cc0b8c777b50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_37c30f8e025e45968525cc0b8c777b50", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/37c30f8e025e45968525cc0b8c777b50"}]}] Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Id: 37c30f8e025e45968525cc0b8c777b50 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-Tenant-Name: tempest-TestSnapshotPattern-1674556184 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-User: tempest-TestSnapshotPattern-1674556184-project Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Id: default Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-User-Domain-Name: Default Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-User-Id: 1a55aa52617849b0b9a6089529ee1910 Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: X-User-Name: tempest-TestSnapshotPattern-1674556184-project Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: method: > Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: exception: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: action_args: {'id': '68cfe23d-c786-4ec2-8b59-22eb79c32c94'} Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: {{(pid=140433) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 22:20:17.733125 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: ERROR nova.api.openstack.wsgi Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: DEBUG nova.api.openstack.wsgi [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Returning 404 to user: Instance 68cfe23d-c786-4ec2-8b59-22eb79c32c94 could not be found. {{(pid=140433) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: INFO nova.api.openstack.requestlog [None req-a9076c42-16e5-498d-a3c3-678c0909d6b5 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94" status: 404 len: 111 microversion: 2.1 time: 0.047373 Aug 27 22:20:17.738939 ncdv-master-1 devstack@n-api.service[140433]: [pid: 140433|app: 0|req: 3649/7393] 10.222.0.40 () {58 vars in 1236 bytes} [Sat Aug 27 22:20:17 2022] GET /compute/v2.1/servers/68cfe23d-c786-4ec2-8b59-22eb79c32c94 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 22:20:17.918879 ncdv-master-1 devstack@n-api.service[140434]: DEBUG nova.api.openstack.wsgi [None req-2e0d254a-b002-4408-afff-7edf8e10a107 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] Calling method '.version_select at 0x7ff84dc4eca0>' {{(pid=140434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 22:20:17.923443 ncdv-master-1 devstack@n-api.service[140434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e0d254a-b002-4408-afff-7edf8e10a107 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 22:20:18.936278 ncdv-master-1 devstack@n-api.service[140434]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e0d254a-b002-4408-afff-7edf8e10a107 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] [cd9a6ed5-777b-4700-9968-d581b7915ef9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 39530. Aug 27 22:20:18.960222 ncdv-master-1 devstack@n-api.service[140434]: INFO nova.api.openstack.requestlog [None req-2e0d254a-b002-4408-afff-7edf8e10a107 tempest-TestSnapshotPattern-1674556184 tempest-TestSnapshotPattern-1674556184-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1562208968" status: 202 len: 0 microversion: 2.1 time: 1.045688 Aug 27 22:20:18.960823 ncdv-master-1 devstack@n-api.service[140434]: [pid: 140434|app: 0|req: 3745/7394] 10.222.0.40 () {58 vars in 1257 bytes} [Sat Aug 27 22:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1562208968 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)